This article is also available in:
French
NVIDIA launched ChatRTX, a free AI-boosted chatbot that can assist you in your daily tasks.
Specifically, it “lets you personalize a GPT large language model (LLM) connected to your own content—docs, notes, or other data”. One major difference with ChatGPT: everything is done locally, on your computer, and accelerated by GPU. Your sensitive data doesn’t have to be sent online.
ChatRTX supports different types of file formats, such as .txt, .pdf, .doc., xml. You just need to indicate ChatRTX which folder to use, then converse with the chatbot using natural language.
ChatRTX can be used to retrieve information from old reports, delve into your software documentation, and more.
Here is a video overview:
ChatRTX requires a PC running Windows 11 with at least 16GB of RAM, and a NVIDIA GeForce RTX series 30 or 40 graphics card with at least 8GB of VRAM.
Please note that the file is quite big (about 35GB).
NVIDIA explains that the tool is mainly a tech demo. For those looking to develop more advanced tools, the reference project used is available on GitHub.
ChatRTX can be downloaded directly from the NVIDIA website.
