Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Gateway Vector DB

The gateway stores the text of the content uploaded.
Assuming a five-char average per word and 500 words per page, it is estimated that 1 page of content should take 5kb.
The system stores the original text and a vector representation (chunk) of the content, approximately 2kb per page.

...

For 1M chunks, it takes around 8G ram (around 350,000 documents according to AGAT)

Gateway SQL server BD sizing