How to make LLMs fast: KV Caching, Speculative Decoding, and Multi-Query Attention | Cursor Team
Lex Clips
•
November 5, 2024
Lex Clips
View ChannelAbout
Clips from the Lex Fridman podcast. Visit the main channel for full conversations and other videos.
Latest Posts
Speed Up Your LLM Workflow
AI-recommended products based on this video
Loading...
Seasonic Focus V4 GX-1000 (ATX3) - 1000W - 80+ Gold - ATX 3.0 & PCIe 5.1 Ready -Full-Modular -ATX Form Factor -Premium Japanese Capacitor -10 Year Warranty -Nvidia RTX 30/40 Super & AMD GPU Compatible
(22)
$423.35
FREE delivery Oct 8 - 10
Loading...
Lenovo IdeaPad Laptop (15.6" FHD Anti-Glare, Intel 12th Gen i5-1235U (> i7-1165G7), 40GB RAM, 1TB SSD), for Home, Student, Webcam w/Shutter, 10-Hour Long Battery Life, Win 11 Home in S Mode
(0)
$2,314.30
FREE delivery Jun 26 - Jul 7Only 3 left in stock.
Loading...
Corsair MP600 Elite 4TB M.2 PCIe Gen4 x4 NVMe SSD for PS5 – Included Heatsink – M.2 2280 – Up to 7,000MB/sec Sequential Read – High-Density 3D TLC NAND – White
(313)
$439.99
FREE delivery Tue, Jun 17
Loading...
Fikwot FS810 4TB SSD, 2.5" SSD SATA III 6Gb/s, Solid State Drives, Up to 560MB/s, 3D NAND TLC, Internal SSD for Desktops and Laptops(Black)
(2,429)
$284.99
FREE delivery Tue, Jun 17
Loading...
Corsair MP600 PRO LPX 4TB M.2 NVMe PCIe x4 Gen4 SSD - Optimized for PS5 (Up to 7,100MB/sec Sequential Read & 6,800MB/sec Sequential Write Speeds, High-Speed Interface, Compact Form Factor) Black
(8,521)
$449.99
FREE delivery Tue, Jun 17
Loading...
BOSGAME P3 Lite Mini PC, AMD Ryzen 7 6800H Mini Computer (8C/16T, up to 4.7GHz), 24GB DDR4 1TB M.2 NVMe SSD, Triple Display Desktop Gaming PC, Pre-in Win 11 Pro, Dual LAN, WiFi 6E, BT 5.2
(67)
$549.00
FREE delivery Sun, Aug 10
Loading...
ORIGIMAGIC N1 Mini PC, Ryzen 7 5825U(8C/16T, UP to 4.5GHz) 32GB RAM 1TB M.2 NVMe SSD, Mini Computer 4K Quad Display/Dual USB-C(Support Data/PD3.0/DP) /WiFi 6E/BT5.2, Light Gaming/Office
(33)
$589.99
FREE delivery Sun, Aug 10
Loading...
ORIGIMAGIC N1 Mini PC Ryzen 7 5825U(8C/16T, UP to 4.5GHZ), Mini Computers 16GB DDR4 RAM 512GB M.2 NVMe SSD, Support 4K Quad Display/WiFi 6E/BT5.2/2.5G LAN/Dual USB-C(Data/PD3.0/DP),Home/Office
(19)
$489.99
FREE delivery Sat, Jun 21
Loading...
origimagic N1 Gaming Mini PC, AMD Ryzen 7 5825U(8C/16T, UP to 4.5GHz) 32GB RAM 1TB M.2 NVMe SSD, Mini Computer Support 4K Quad Display/WiFi 6E/BT5.2/Dual USB-C(Support Data/PD3.0/DP) Gaming/Office
(19)
$539.99
FREE delivery Wed, Jun 18
Loading...
45W Charger for Nintendo Switch, AC Power Adapter for Switch, Fast Charging Power Supply Compatible with Switch OLED/Lite/Steam Deck Dock, Support TV Mode, 15V 2.6A (5ft)
(324)
$19.99
FREE delivery Thu, Aug 21 on your first order
500+ bought in past month
Loading...
Mcbazel Dobe Dual Controller Charging Station Fast Charging Docking with LED Indicator for Switch Pro/PS5/Xbox Elite 2/Xbox Series S/Series X/Controller
(69)
$18.99
FREE delivery Sun, Aug 24 on your first order
Loading...
Best Seller
Charger for Nintendo Switch and Lite and OLED with 5FT Charger Cable for Nintendo Switch, Support Switch TV Dock Mode AC Power Supply Adapter, Output 15V2.6A Fast Charge Nintendo
(14)
$15.99
FREE delivery Fri, Oct 3 on your first order
500+ bought in past month
Loading...
Corsair MP600 PRO LPX 4TB M.2 NVMe PCIe x4 Gen4 SSD - Optimized for PS5 (Up to 7,100MB/sec Sequential Read & 6,800MB/sec Sequential Write Speeds, High-Speed Interface, Compact Form Factor) Black
(8,521)
$449.99
FREE delivery Tue, Jun 17