...
The main cost of the BusinessGPT deployment is the AI servers responsible for answering questions. These are utilizing graphic card GPUs (Graphic Process Units).
These servers will also be used for creating embedding for processing and preparing the data for AI.
Graphics Cards
Below are two card options of two cards that are available for purchase for standard servers. The difference between the cards is the number of questions per minute that can be processed.
...
In case of budget restraints, all components can be deployed on the same server.
Embedding servers
The embedding servers are responsible for processing the data and preparing it for AI.
Below are the specs for this
Word/ M size per min.