Table of Contents |
---|
Containers
Container Purpose | Option 1 (GPU) | Option 2 (CPU) |
---|---|---|
Gateway (Linux) | 16 GB 4 vCPUs | 32 GB 8 vCPUs |
Embedder (Linux) | 16 GB 16GB GPU | None. Embedding happens on Gateway. |
LLM (Linux) | 16 GB 24 GB GPU | To be determined. |
Dashboard | t3a.large | t3a.large |
...