Versions Compared

Version Old Version 30 New Version 31
Changes made by

Meir Davis

Meir Davis

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Purpose

Option 1 (GPU)

Option 2 (CPU)

Gateway (Linux)

(Vector DB, SQL DB, Gateway API)

16 GB RAM (32 GB for larger databases)

4 vCPUscores

16 GB RAM

4 vCPUscores

Embedder (Linux)

16 GB RAM

16 GB GPU

2 vCPUs4 cores

16 GB RAM

4 vCPUscores

LLM (Linux)

16 GB RAM

24 GB GPU

2 vCPUs4 cores

To be determined.

Dashboard/Ingestor (Windows Server- Not a container)

8 GB RAM

4 vCPUscores

8 GB RAM

4 vCPUscores

Info

  1. Example CPU processors: Intel Xeon Platinum 8000.

  2. Example GPU for embedding: NVIDIA T4 Tensor Core.

  3. Example GPU for LLM: NVIDIA L4 Tensor Core.

  4. Database can be installed on the Windows server or any other convenient location, including an existing instance of Microsoft SQL Server.

  5. The Linux containers may be deployed on one server or spread over multiple servers.

  6. Recommended host OS: Ubuntu Linux 22.04 LTS +

...