Overview
This page includes basic small-size hardware requirements (typically supporting around 150 users) and other relevant system requirements for all sizes.
Please go to https://agatsoftware.atlassian.net/wiki/spaces/VA/pages/3741450244 to determine the size needed.
Hardware Requirements
Local Model
GPU Requirements
CUDA 12.x–compatible GPU
Compute Capability ≥ 7.0 (Volta/Ampere/Ada/Hopper)
Unsupported: Maxwell (SM 5.x) or Pascal (SM 6.x) GPUs
GPU:
2 GPUs ( 1x 12 GB or larger + 1 x 24GB VRAM or larger)
Note: Additional GPU VRAM may be required for data analysis tasks.
CPU:
12 cores total
Memory:
48 GB RAM total
Storage:
256GB SSD
Cloud Model
CPU:
4 cores total
Memory:
16GB RAM total
Storage:
256GB SSD
Server and Software Requirements
You’ll need two virtual or physical servers. One Windows server and another Linux server to host the docker containers. The docker containers may be collocated on an existing Linux Docker host.
Windows Virtual Machine:
Windows Server 2019 or newer, including IIS Web Server features configured by installer.
Allocated Resources:
8 GB RAM
4 CPU cores
Services Hosted:
Dashboard
Ingestor
API
Linux Docker Host:
Ubuntu Server 22.04 LTS or newer. Other distributions supported too.
Allocated Resources:
Uses the remaining hardware resources from the total
Containers Deployed:
Gateway
Embedder
LLM
MS SQL Database
Postgres Vector Database
Additional Software Dependencies:
CUDA 12.8
Docker CE version 27.3.1 or later
Network
Source | Destination | Ports | Notes |
|---|---|---|---|
Windows Dashboard VM | Linux docker host | 8080, 443, 1433 | Gateway API + MS SQL DB |
Windows Dashboard VM | AI services used by end users | 443 | Send AI traffic to AI services after inspection |
File Uploading Agent installation location | Windows Dashboard/Ingestor VM | 8080, 443 | Required if using file uploading agent |
End user workstations | Windows Dashboard/Ingestor VM | 443 | |
End user workstations | Bastion proxy on Windows VM | 8080 | Route users AI traffic to Bastion proxy |
Windows VM | LDAP server | 389/636 | Only for Local AD authentication |
Bastion proxy Windows VM | Windows Admin/CoreAPI VM | 443 | Required for Dashboard/Admin and Core/Firewall API calls. Direct SQL access (1433) is not required by the current filter unless AGAT confirms a legacy or customer-specific direct-database provider. |
Internet Access
Source | Hosts | Notes |
|---|---|---|
Docker Container Host | *.docker.io, *.docker.com, *.auth0.com, production.cloudflare.docker.com, docker-images-prod.6aa30f8b08e16409b46e0173d6de2f56.r2.cloudflarestorage.com | Authenticating to Docker Hub and downloading container images. |
Docker Container Host | *.hf.co, huggingface.co, cdn-lfs.huggingface.co | Downloading LLM models and relevant files. |
Installer workstation | customers.agatsoftware.com | Download installer files and upload logs for AGAT review if required. |
Azure AD\Local AD integration
If you wish to authenticate to the Admin Site with Azure authentication, please create an Azure app integration
https://agatsoftware.atlassian.net/wiki/spaces/VA/pages/3974594561
(We can also provide you with an Azure app)
If you wish to authenticate to the Admin Site with Local AD, please prepare the LDAP settings and domain user credentials
Software requirements on Windows server
Notepad ++
SQL Server Management Studio (SSMS)
Certificates: a trusted certificate for the Admin Site on Windows/IIS and a trusted certificate for the inbound AI Gateway on Linux/Nginx. Use two certificates, or one wildcard/multi-SAN certificate that covers both DNS names.
Permissions
A user with permissions to add DNS records for the Admin Site and the inbound AI Gateway.
Bastion Proxy Service (for public AI control)
https://agatsoftware.atlassian.net/wiki/spaces/VA/pages/3348168762
Only for Private AI
File Uploading Agent
Needs to run from a location where it has access to files to be uploaded (locally or via network share) and run as Local System user.
SharePoint
The service user needs to be a Site Collection Admin and have read-only access to all relevant sites.
Confluence
Service user required that has read access to relevant pages
Jira
Service user required that has read access to relevant pages
More details
https://agatsoftware.atlassian.net/wiki/spaces/VA/pages/3080192044
https://agatsoftware.atlassian.net/wiki/spaces/VA/pages/3741450244