Enthusiast arms 12-slot NVMe NAS with an Nvidia RTX GPU to run local ChatGPT

[Pelican Press 0]

Enthusiast arms 12-slot NVMe NAS with an Nvidia RTX GPU to run local ChatGPT

News outlet StorageReview is

This is the hidden content, please

• Sign In
• or
• Sign Up

powered by Nvidia’s RTX A4000 graphics card, putting ChatGPT capabilities on a local server.

This is the hidden content, please

• Sign In
• or
• Sign Up

computer hardware creators typically have a penchant for the unusual and silly, but StorageReview has created a solution that’s matched in its uniqueness by its usefulness.

As seen in the embedded

This is the hidden content, please

• Sign In
• or
• Sign Up

video above, Jordan from StorageReview has accomplished this task without too much rigorous DIY. The base of the project is a

This is the hidden content, please

• Sign In
• or
• Sign Up

, a prebuilt NAS with 12 NVMe slots, an AMD Epyc processor, and 256 GB of RAM out of the box. The reason for this specific NAS is two-fold: It allows for an internal GPU to be added, and it supports the QNAP hypervisor program Virtualization Station for creating virtual machines (VMs). To this shell is added the Nvidia RTX A4000, an Ampere GPU that is Nvidia’s most powerful single-slot graphics card. 

With a NAS full of terabytes of data and an RTX workhorse ready to go, Jordan could use the new program “Chat with RTX,” an Nvidia creation that sets up a ChatGPT experience on a PC powered by your graphics card, that can draw from local files for data. 

Having a NAS with AI inside may seem impractical, but for an increasingly AI-reliant world, this solution makes a lot of sense. The enterprise world’s use of AI includes analyzing and optimizing data and performance, which is potentially connected to sensitive data one wouldn’t want on the open internet. The online ChatGPT model trains itself on its own use, which would justifiably scare users with sensitive data away from potentially getting it leaked into an AI database. Having a local AI chatbot, disconnected from the open internet, but plugged into your data for these solutions, is potentially a game changer for security-focused companies, and putting that tool on a NAS allows everyone on a network to access the AI tools. 

This project is refreshingly useful in an increasingly novelty-focused

This is the hidden content, please

• Sign In
• or
• Sign Up

tech environment. Adding the ChatGPT capabilities to a NAS that is already a powerhouse in its own right (15 TB NVMe drives are becoming more common in enterprise settings, and this QNAP ****** fits 12 of them) is a no-brainer for companies who want to use the power of AI to make themselves more competitive in a fast-evolving world. Some of the moral concerns or fears with AI language models are avoided here too: Using a fully off-the-grid language model keeps you safe from AI stealing your responses, and having the **** trained on your data alone ensures no piracy or data theft of others is being perpetuated after you download the LLM model to power the chat app. 

For a deeper ***** into the project and how to replicate it for yourself, check the article

This is the hidden content, please

• Sign In
• or
• Sign Up

. For help starting your own AI NAS project, you’ll want the best SSDs and HDDs as reviewed by us. And if you want to go really DIY, consider 3D printing your own NAS case.

Join the experts who read Tom’s Hardware for the inside track on enthusiast PC tech news — and have for over 25 years. We’ll send breaking news and in-depth reviews of CPUs, GPUs, AI, maker hardware and more straight to your inbox.

This is the hidden content, please

• Sign In
• or
• Sign Up

#Enthusiast #arms #12slot #NVMe #NAS #Nvidia #RTX #GPU #run #local #ChatGPT

This is the hidden content, please

• Sign In
• or
• Sign Up