100 Tokens per Second from a Lunchbox

2 months ago

Description

I turn a mini PC and a GPU dock nto a 100-tokens/sec LLM rig and stress-test its limits. 👉 Try TryHackMe — many rooms are free, and use code ALEX25 for 25% off the annual plan: https://tryhack...

100 Tokens per Second from a Lunchbox

Description

Related Videos

I built a 2500W LLM monster... it DESTROYS EVERYTHING

10-Gig Everywhere… It Went Horribly Right

2025 favorite gadgets and new Desk Setup

Four Framework boards... One Giant Model | MEMBERS

The Keyboard So Ridiculous It Demands a Supercomputer

You’re Using the WRONG VS Code… Here’s Why Green Wins

The Most Powerful APU on Earth

Local AI just leveled up... Llama.cpp vs Ollama

New Apple Silicon Drive record... For LLMs

New clustering solution | MEMBERS

You were right... I DID want the 400Gbps | MEMBERS

Goodbye Nanometers...18A Era Starts Now