Build Your Own AI server

Video Description

I built a DIY AI server to see how far a home setup can go without a DGX or a pricey custom workstation. This video covers the options, the parts I chose (and why), and real benchmarks across LLMs, image generation, and ML training. Chapters (timestamps): 00:00 Intro 00:54 AI server options 01:29 Parts: Motherboard 02:24 Parts: CPU 02:48 Parts: RAM 02:56 Parts: Cooling 03:18 Parts: PSU 03:28 Parts: GPU 04:33 LLM Benchmarks: gpt‑oss 20B (parallel) 06:04 LLM Benchmarks: gpt‑oss 20B (single‑request) 07:28 LLM Benchmarks: gpt‑oss 120B (sharded) 08:20 Image Gen Benchmarks: FLUX.1 dev 09:48 ML Training Benchmarks: ResNet50 11:19 Cost comparison 12:09 Wrap‑up & plans 14:18 Extra stuff / credits Corrections: 08:22 FLUX.1 isn’t a Stable Diffusion model but it’s a transformer-based, rectified-flow diffusion model. 10:18 not a GPU, but this is Nvidia's Grace CPU. Wrong image. Related Videos: https://youtu.be/AL7C5yCx6FM Deep Dives with Christina — https://youtu.be/SeXXQ-HLU2I Ways to support: Subscribe -- https://www.youtube.com/c/JunYamog?sub_confirmation=1 Videos Mentioned: @theNittyGritty — Why I am not gonna buy the NVIDIA DGX Spark https://youtu.be/R197j4x82SM?si=I4gP83lSoigvi7Db @DigitalSpaceport — INSANE Home AI Server - Quad 3090 Build https://youtu.be/JN4EhaM7vyw?si=j5ADHOjQW_ztqmIS References: gpt-oss - https://openai.com/index/introducing-gpt-oss/ vLLM - https://docs.vllm.ai/en/latest/ llama.cpp - https://github.com/ggml-org/llama.cpp nVidia GenAI-Perf - https://docs.nvidia.com/deeplearning/triton-inference-server/user-guide/docs/perf_benchmark/genai_perf.html Apple MLX - https://opensource.apple.com/projects/mlx/ ML Training ResNet50 (forked from M Bourke's benchmarks and added torch discributed for multi GPU runs) - https://github.com/jkyamog/mac-ml-speed-test/blob/main/pytorch_test_computer_vision_cifar100.py If you’d rather buy than build, check out Bizon Tech (not sponsored) — https://bizon-tech.com/deep-learning-ai-workstation Motion 5 animations by Simple Video Making (not sponsored) — https://simplevideomaking.com/