The Attention Mechanism in Large Language Models
Serrano.Academy
•
November 23, 2023
Serrano.Academy
View ChannelAbout
Welcome to Serrano.Academy! I'm Luis Serrano and I love demystifying concepts, capturing their essence, and sharing these videos with you. I prefer illustrations, analogies, and cartoons, rather than formulas (although we don't shy away from the math when needed). The topics I have are machine learning, mathematics (probability and statistics), but I'm open to many others. If you have any topics you'd like to suggest, feel free to add them in the comments or drop me a line! For more information, check out http://serrano.academy. And also check out my book! Grokking Machine Learning http://manning.com/books/grokking-machine-learning (40% discount code: serranoyt)
Latest Posts
Upgrade Your AI Toolkit
AI-recommended products based on this video
Loading...

Seasonic Focus V4 GX-1000 (ATX3) - 1000W - 80+ Gold - ATX 3.0 & PCIe 5.1 Ready -Full-Modular -ATX Form Factor -Premium Japanese Capacitor -10 Year Warranty -Nvidia RTX 30/40 Super & AMD GPU Compatible
(22)
$423.35
FREE delivery Oct 8 - 10
Loading...

Freenove Ultimate Starter Kit for BBC micro bit (V2 Included), 316-Page Detailed Tutorial, 225 Items, 44 Projects, Blocks and Python Code
(382)
$94.95
PrimeFREE delivery Sat, Jun 14
Loading...

Reatan S8 Mini PC Gaming with Intel Core i9 12900H(14C/20T 5.0 GHz), 32GB DDR5 Dual Channel 1TB NVMe SSD, Mini Desktop Computer Triple Display Support 8K WiFi6 BT5.2 USB-C
(8)
$865.00
FREE delivery Mon, Aug 11
Loading...

GMKtec Mini PC Workstation, Intel Core i9 13900HK(14C/20T) up to 5.4GHz, Mini Computer 32GB DDR5 RAM 1TB SSD, 8X USB Ports/COM/HDMI/DP Office Business
(316)
$1,029.99$1,029.00
FREE delivery Sun, Aug 10
Loading...

GMKtec Mini PC Workstation, Intel Core i9 13900HK(14C/20T) up to 5.4GHz, Mini Computer 64GB DDR5 RAM 1TB SSD W11 Pro, 8X USB Ports/COM/HDMI/DP Office Business
(259)
$1,159.99
PrimeFREE delivery Sat, Jun 14
Loading...

GMKtec Mini PC Workstation, Intel Core i9 13900HK(14C/20T) up to 5.4GHz, Mini Computer 16GB DDR5 RAM 1TB SSD W11 Pro, 8X USB Ports/COM/HDMI/DP Office Business K10
(345)
$1,009.99
FREE delivery Tue, Oct 21
Loading...

Corsair MP600 PRO LPX 4TB M.2 NVMe PCIe x4 Gen4 SSD - Optimized for PS5 (Up to 7,100MB/sec Sequential Read & 6,800MB/sec Sequential Write Speeds, High-Speed Interface, Compact Form Factor) Black
(8,521)
$449.99
FREE delivery Tue, Jun 17








![How Attention Got So Efficient [GQA/MLA/DSA]](https://imgz.pc97.com/?width=500&fit=cover&image=https://i.ytimg.com/vi/Y-o545eYjXM/hqdefault.jpg)




![What the Books Get Wrong about AI [Double Descent]](https://imgz.pc97.com/?width=500&fit=cover&image=https://i.ytimg.com/vi/z64a7USuGX0/hqdefault.jpg)






![How Rotary Position Embedding Supercharges Modern LLMs [RoPE]](https://imgz.pc97.com/?width=500&fit=cover&image=https://i.ytimg.com/vi/SMBkImDWOyQ/hqdefault.jpg)
