...
Document | Description | Chunks | Time Taken (seconds) |
|---|---|---|---|
10 pages, 2155 words | 20 | 7 | |
Example
To be safe, we assume, on average, 10 pages per document based on ChatGPT, but in our experience at AGAT, the ratio is four pages per document.
| Info |
|---|
100,000 documents would take approximately 8 days with 1 embedding GPU |
or 3 days using the embedding GPU + LLM GPU temporarily (on prem)
...