The Radxa Orion O6 Crushes LLMs with 14B Models at 30W
Technically Unsure
•
June 9, 2025
About
No channel description available.
Latest Posts
Video Description
Today we're diving deep into the Radxa Orion O6—a single-board computer that's redefining what's possible in compact AI computing! I installed Debian 12, ran extensive benchmarks, and tested some demanding AI workloads, including a hefty 14-billion-parameter LLM model. The Orion O6 didn't just handle these tasks—it absolutely crushed them, all while sipping only 30 watts of power! If you're curious whether the Orion O6 can dethrone boards like the Raspberry Pi 5 or NVIDIA Jetson Orin Nano, you won’t want to miss this. Let's see what this tiny AI powerhouse can really do! #radxa #oriono6 #ai #singleboardcomputer #sbc #arm #linux #debian12 #machinelearning #artificialintelligence #edgeai #benchmark #llm #opensource #techreview #tech #raspberrypi #nvidiajetson #computing #techenthusiast #hardware #geek #minipc #maker #homelab #developer #diy #innovation #technicallyunsure #techcommunity
Boost Your AI Power
AI-recommended products based on this video
Loading...
GMKtec EVO-X2 AI Mini PC Ryzen Al Max+ 395 (up to 5.1GHz) Mini Gaming Computers, 96GB LPDDR5X 8000MHz (12GB*8) 1TB PCIe 4.0 SSD, Quad Screen 8K Display, WiFi 7 & USB4, SD Card Reader 4.0 Global Recycled Standard
(69)
$3,259.99
FREE delivery Sat, Jan 3
Loading...
GMKtec EVO-X2 AI Mini PC, Ryzen Al Max+ 395 (up to 5.1GHz) Mini Gaming Computers, 64GB LPDDR5X 8000MHz (8GB*8) 1TB PCIe 4.0 SSD, Quad Screen 8K Display, WiFi 7 & USB4, SD Card Reader 4.0 Global Recycled Standard
(71)
$2,799.99
FREE delivery Sat, Jan 3Only 10 left in stock.
Loading...
Lenovo LOQ 15.6" FHD 144Hz Gaming Laptop, Intel Core i5-12450HX, NVIDIA GeForce RTX 2050, 16GB DDR5, 2TB Storage (1TB SSD+1TB Docking Station Set), Number Pad, 720p Camera, Wi-Fi 6, Win 11, Gray
(2)
$1,369.00
FREE delivery Feb 24 - Mar 5
Loading...
MSI Ultra-Slim Thin 15 VR-Ready High FPS Gaming Laptop, 15.6 FHD 144Hz, Intel Core i5-13420H, NVIDIA GeForce RTX 4060, 32GB RAM, 2TB SSD, Backlit KB, Wi-Fi 6, Bundle with PCO Notebook Fold Radiator
(0)
$4,697.44
FREE delivery Jun 23 - Jul 3Only 3 left in stock.
Loading...
acer Nitro 50 N50-620-UA91 Gaming Desktop | 11th Gen Intel Core i5-11400F 6-Core Processor | NVIDIA GeForce GTX 1650 | 8GB DDR4 | 512GB NVMe M.2 SSD | Intel Wi-Fi 6 AX201 | Keyboard and Mouse
(283)
$1,658.99
Loading...
Skytech Blaze 3.0 Gaming PC Desktop – Intel Core i5 12400F 2.5 GHz, NVIDIA RTX 3060, 500GB NVME SSD, 16GB DDR4 RAM 3200, 600W Gold PSU, 11AC Wi-Fi, Windows 11 Home 64-bit
(786)
$1,414.11
FREE delivery Thu, Feb 19Only 4 left in stock.
Loading...
Intel NUC 13 Pro Mini PC, NUC13ANKI7 Intel Core i7-1360P (12C/16T & Up to 5.0GHz), 32GB 3200Mhz DDR4 RAM & 1TB PCIe 4.0 NVMe SSD, Support 8K/HDR/WiFi6E/BT5.3/Windows 11 Pro/Office/Business
(0)
$1,149.00
FREE delivery Wed, Jun 18
Loading...
Beelink SER8 Mini PC, AMD Ryzen 7 8845HS(up to 5.1GHz) 8C/16T, Mini Computer 32GB DDR5 RAM 1TB NVMe PCIE 4.0 SSD, Mini Desktop Computer 4K 144Hz Quad Screen Display WiFi6/BT5.2/WOL/W-11 Pro
(346)
$789.00
Prime
Loading...
ORICO 4TB NVMe SSD PCIe 4.0- Up to 7200MB/s, M.2 SSD 2280 PCIe 4.0X4 Internal Solid State Drive SSD, Fast Heat Dissipation, Compatible with macOS Windows for Gamers and Creators-e7000
(357)
$299.99
Only 8 left in stock.
Loading...
ORICO IG740-PRO 2TB M.2 NVMe Enterprise SSD, PCIe 4.0- Up to 7400MB/s, 2280 PCIe 4.0X4 Internal Solid State Drive, Support LDPC ECC, SE, AES, Compatible with Laptop, POS Terminal, Automotive System
(83)
$149.99
FREE delivery Tue, Jun 17
100+ bought in past month
Loading...
【DDR3 RAM Laptop Only】 GIGASTONE 16GB Kit (2x8GB) DDR3/DDR3L 1600MHz (1333MHz) PC3-12800 (PC3-10600) CL11 1.35V/1.5V 2Rx8 SODIMM 204 Pin Unbuffered Non ECC High Performance Notebook Memory Upgrade
(1,599)
$32.99
FREE delivery Sun, Jun 15 on your first order
50+ bought in past month
Loading...
Dell Performance Dock - WD19DCS Docking Station with 240W Power Adapter for Monitors (Provides 210W Power Delivery; 90W to Non-Dell Systems)
(206)
$249.99$189.00
FREE delivery Sun, Aug 24
Loading...
Best Seller
UGREEN Revodok USB C Hub, 5-in-1 USB C Adapter with 4K HDMI, 100W Power Delivery, 3 USB A Data Ports, Multiport USB Hub for MacBook Pro/Air, iPad Pro, Surface, XPS, Thinkpad, Galaxy and More, Gray
(17,667)
$19.99
3K+ bought in past month
Loading...
USB C Hub, MacBook Pro Adapter USB C Dongle with 4K HDMI,Thunderbolt 3 100W Power Delivery Port,USB C 5Gbps Data Port,SD/TF Card Reader,2 USB 3.0 Ports Compatible for MacBook Pro Air 2022/2021/2020
(4,449)
$25.99
FREE delivery Sat, Jun 14 on your first order
100+ bought in past month
Loading...
MINISFORUM AMD Ryzen 9 9955HX MS-A2 Mini PC (16C/32T, up to 5.4GHz), 64GB DDR5 1TB SSD, PCIe×16, HDMI/2x USB-C (8K@60Hz), 2X SFP+ 10G, 2X 2.5G LAN, 3X SSD M.2 (2280/22110/U.2)
(3)
$1,899.99
FREE delivery Sun, Aug 10
Loading...
82599ES 10G SFP+ Mini PC, Core i3-N305 Firewall Router, 2 x 2.5GbE i226-V LAN Computer Hardware, 32GB RAM 1TB SSD Micro Router Appliance, AES-NI, OPNsense, TF, 2xHD, Type-C
(0)
$818.99
FREE delivery Jul 3 - 24
Loading...
for 90MM Video Card Cooler Fan for GPU for MSI GeForce for RTX 3060 3070 3080 3090 3060Ti 3070TI for Gaming X Trio Graphics(1pcs)
(0)
$38.13
FREE delivery Mar 19 - Apr 10
Loading...
Laptop Parts 1 Set FY09015M12LPA Dual Graphics Card Fan for Manli RTX 3060 3070 3050 3060Ti LHR for Gallardo VGA GPU Video Cooler(2 Plugs FY09015M)
(0)
$54.02
FREE delivery Mar 19 - Apr 10