Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 3 Next »

AI model servers

The main cost of the BusinessGPT deployment is the AI servers responsible for answering questions. These are utilizing graphic card GPUs (Graphic Process Units).

Graphics Cards

Card

Answer Speed

Purchase cost - Amazon

Nvidia RTX 4090

24 GB VRAM  4 vCPU

2.1sec ( 29 Questions /Min)

$2289

Nvidia RTX 4070 Ti

12GB VRAM 8vCPU

4.2 sec (14 Questions /Min)

$790

  • No labels