I got a desktop supercomputer? | NVIDIA DGX Spark overview
Tim Carambat
@timcarambatAbout
Software Engineer, Founder and CEO of Mintplex Labs. Creator of AnythingLLM.
Latest Posts
Video Description
Hey everyone!! Today, I can finally launch a video about my experience with the new *NVIDIA DGX Spark* , a bespoke device for specifically AI workloads, which is great because local AI is literally my day job! In this video, I go over my experience with the DGX Spark, the tools it comes with, and showcase some dead-simple capabilities running OpenAI's GPT-OSS 120B as well as fine-tuning a Gemma 4B model for a customer support use case with *Unsloth* . You can run and fine-tune much larger models on this device. If you have something you want me to try on this - let me know! ## Resources and Links NVIDIA DGX Spark Press Release: https://nvidianews.nvidia.com/ ### AnythingLLM https://anythingllm.com AnythingLLM Desktop: https://anythingllm.com/desktop AnythingLLM Mobile on Google Play: https://play.google.com/store/apps/details?id=com.anythingllm GitHub: https://github.com/Mintplex-Labs/anything-llm ### Unsloth (Fine-tuning) https://unsloth.ai FineTuning Notebook w/Granite4: https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Granite4.0.ipynb ## CHAPTERS 0:00 Introduction 0:37 Unboxing the NVIDIA DGX Spark 1:45 DGX Overview, Look, Feel, and Specs 5:00 DGX Available Configurations 6:00 Reddit Criticisms - this is not a personal PC 7:20 The HomeLab setup use case 8:13 External form factor and craftsmanship 10:00 Using the built-in Operating system (DGX OS) 11:00 Running Ollama and GPT-OSS 120b 12:30 Document analysis use-case in AnythingLLM Desktop 16:00 Fine-Tuning demonstration on the DGX Spark! 25:54 Wrapping up my thoughts 26:32 What am I going to do with this now?
Supercharge Your Workstation
AI-recommended products based on this video

PNY NVIDIA Quadro RTX 4000 - The World’S First Ray Tracing GPU

High-Performance Laptop Heatsink Compatible with 17 9700, RTX 2060 6GB, Precision 5750, Quadro RTX 3000 6GB - 0YC6P3 YC6P3 460.0JD02.0012

VGA PNY Quadro RTX 4000 ADA 20GB Retail (VCNRTX4000ADA-PB)

PNY NVIDIA Quadro RTX 4000 8GB GDDR6 Graphics Card

PNY NVIDIA Quadro RTX 4000 - The World’S First Ray Tracing GPU

130W USB C Laptop Charger Compatible with Dell Precision 5550 5560 3560 3590 3550 5540 5570 5750 5530 5520 5510 Latitude 5520 5510 5420 7410 7310 7210 9410 9510 9520 XPS 15 17 AC Adapter Power Cord

UCANUUP 130W Tip 4.5mm Compatible with Dell XPS 15 7590 9530 9550 9560 9570 9575 Inspiron 7348 Precision M3800 5510 5520 5530 06TTY6 AC Adapter Power Replacement Supply Cord

Replacement for Dell 130W Laptop Charger USB C - XPS 17 15 7590 9700 9500 9510 Precision 5560 3560 5540 5570 5550 3561 3550 5510 5520 Latitude 7410 7310 7210 Type C Computer AC Adapter Power Cord

NVIDIA RTX A2000 - Graphics Card - RTX A2000-6 GB GDDR6 - PCIe 4.0 x16-4 x Mini DisplayPort

PNY NVIDIA RTX A2000 12GB

Skytech Legacy Gaming PC Desktop, Ryzen 7 9800X3D 4.7 GHz (5.2 GHz Turbo Boost), NVIDIA RTX 5080 16GB GDDR7, 1TB Gen4 SSD, 32GB DDR5 RAM 6000 RGB, 1000W Gold ATX 3.0 PSU, 360 ARGB AIO, Wi-Fi, Win 11

Dell UltraSharp 24 Monitor - U2424H

Dell UltraSharp U2723QE 27" 4K UHD WLED LCD Monitor - 16:9 - Black, Silver EPEAT

Crucial 64GB DDR5 RAM, 5600MHz (or 5200MHz or 4800MHz) Desktop Memory Kit, UDIMM 288-Pin, Compatible with 13th Gen Intel Core and AMD Ryzen 7000 - CT2K32G56C46U5

Corsair RM1000e Fully Modular Low-Noise ATX Power Supply - Dual EPS12V Connectors - 105°C-Rated Capacitors - 80 Plus Gold Efficiency - Modern Standby Support - Black

Western Digital 2TB WD Blue SA510 SATA Internal Solid State Drive SSD - SATA III 6 Gb/s, 2.5"/7mm, Up to 560 MB/s - WDS200T3B0A

Western Digital 4TB Elements Desktop External Hard Drive, USB 3.0 external hard drive for plug-and-play storage - WDBWLG0040HBK-NESN

Western Digital 4TB My Book Desktop External Hard Drive, USB 3.0, External HDD with Password Protection and Backup Software - WDBBGB0040HBK-NESN

















![[Breaking] ChatGPT new features leaked prior to OpenAI developer conference. #ai #chatgpt](https://imgz.pc97.com/?width=500&fit=cover&image=https://i.ytimg.com/vi/OjW9BtwQMnE/hqdefault.jpg)

![[FREE] AnythingLLM v2 | The last document chatbot you will ever need](https://imgz.pc97.com/?width=500&fit=cover&image=https://i.ytimg.com/vi/f95rGD9trL0/hqdefault.jpg)