GT AI OS Community

Everyone can install GT AI OS Community Edition to learn how to build generative AI agents with local & external inference in a “click and go” deployment experience. Basic command line skills and admin access to your computer are needed. The installer scripts will deploy Docker and all needed dependencies. GT AI OS CE offers the same user experience as GT AI OS Server with a reduced feature set.

The software requires a minimum of 4 CPU cores, 100GB disk and 8GB available RAM (taking into account that some of your installed RAM will be used by the underlying operating system).

The installer will check to ensure that sufficient RAM is available to run AI OS CE. The installation process will stop there is insufficient RAM available to run the software. If an NVIDIA GPU is detected by the installer, it will be used to run the RAG embedding model, which will accelerate your file uploads and RAG workflows.

You can install the software on NVIDIA DGX OS, Ubuntu 24.04+ and Apple Silicon computers. Up to 10 users can be configured on the software, enabling you to create an AI OS deployment that can be accessed by multiple users. Full instructions are provided on the wiki. Please note that GT AI OS CE is not intended for production use in commercial settings. Enjoy building your own private AI service!