GT AI OS Server

The GT AI OS Server software provides an out of the box solution for organizations wanting to deploy generative AI with data privacy, compliance and control. The software offers a user friendly web UI, role based access to Agents & Datasets, no code RAG with admin selectable embedding models, support for local and remote LLM inference, immutable audit trail, access logs, financial controls and activity metric dashboards. All conversations, datasets and files are stored in the local Postgres database. The software has been validated on NVIDIA DGX OS 7 and Ubuntu 24.04. Minimum 8GB RAM and 4 CPU cores and 100GB disk required.