Overview

This page includes basic small-size hardware requirements (typically supporting around 150 users) and other relevant system requirements for all sizes.
Please go to Hardware Sizing to determine the size needed.

Hardware Requirements

GPU:
- 2 GPUs (each with a minimum of 24GB VRAM)
- Note: Additional GPU VRAM may be required for data analysis tasks.
CPU:
- 12 cores total
Memory:
- 48 GB RAM total
Storage:
- 256GB SSD

Server and Software Requirements

You’ll need two virtual or physical servers. One Windows server and another Linux server to host the docker containers. The docker containers may be collocated on an existing Linux Docker host.

Windows Virtual Machine:
- Windows Server 2019 or newer, including IIS Web Server features configured by installer.
- Allocated Resources:
  - 8 GB RAM
  - 4 CPU cores
- Services Hosted:
  - Dashboard
  - Ingestor
  - API
Linux Docker Host:
- Ubuntu Server 22.04 LTS or newer. Other distributions supported too.
- Allocated Resources:
  - Uses the remaining hardware resources from the total
- Containers Deployed:
  - Gateway
  - Embedder
  - LLM
  - MS SQL Database
  - Postgres Vector Database
- Additional Software Dependencies:
  - CUDA 12.4
  - Docker CE version 27.3.1 or later

Network

Source	Destination	Ports	Notes

Source	Destination	Ports	Notes
Windows Dashboard/Ingestor VM	Linux docker host	8080, 443, 1433	Gateway API + MS SQL DB
File Uploading Agent installation location	Windows Dashboard/Ingestor VM	8080, 443	Required if using file uploading agent
End user workstations	Windows Dashboard/Ingestor VM	443

Internet Access

Source	Hosts	Notes

Source	Hosts	Notes
Docker Container Host	.docker.io, .docker.com, *.auth0.com, production.cloudflare.docker.com, docker-images-prod.6aa30f8b08e16409b46e0173d6de2f56.r2.cloudflarestorage.com	Authenticating to Docker Hub and downloading container images. Full details here Allowlist
Docker Container Host	*.hf.co, huggingface.co, cdn-lfs.huggingface.co	Downloading LLM models and relevant files.
Installer workstation	customers.agatsoftware.com downloads.agatsoftware.com	Download installer files and upload logs for AGAT review if required.

Permissions

SQL server for data analysis / ingestion

A user with full read only permissions to existing company database to be used as source for data analysis or ingestion

Windows Dashboard/Ingestor VM

Should be domain joined to enable user authentication. Alternately Azure SSO may be used.

File Uploading Agent

Needs to run from a location where it has access to files to be uploaded (locally or via network share) and run as Local System user.

SharePoint

Service user needs to be Site Collection Admin as well as have read only access to all relevant sites.

Confluence

Service user required that has read access to relevant pages

Jira

Service user required that has read access to relevant pages

Miscellaneous

Customer may provide SSL certificate to secure HTTPS access by end users to the dashboard. Certificate will be installed on Dashboard VM certificate store and accessed by IIS.
Remote installation / support sessions using Microsoft Teams or Webex with remote screen control.