Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Table of Contents

Containers

Container Purpose

Option 1 (GPU)

Option 2 (CPU)

Gateway (Linux)

16 GB

4 vCPUs

32 GB

8 vCPUs

Embedder (Linux)

16 GB

16GB GPU

None. Embedding happens on Gateway.

LLM (Linux)

16 GB

24 GB GPU

To be determined.

Dashboard

t3a.large

t3a.large

...