Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters (Paper)
Yannic Kilcher
•
October 5, 2024
Yannic Kilcher
View ChannelAbout
I make videos about machine learning research papers, programming, and issues of the AI community, and the broader impact of AI in society. Twitter: https://twitter.com/ykilcher Discord: https://ykilcher.com/discord BitChute: https://www.bitchute.com/channel/yannic-kilcher LinkedIn: https://www.linkedin.com/in/ykilcher BiliBili: https://space.bilibili.com/2017636191 If you want to support me, the best thing to do is to share out the content :) If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this): SubscribeStar: https://www.subscribestar.com/yannickilcher Patreon: https://www.patreon.com/yannickilcher Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2 Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n
Latest Posts
![Latent Reasoning: Scaling Test-Time Compute for Smarter LLMs [Jonas Geiping] - 723](https://imgz.pc97.com/?width=500&fit=cover&image=https://i.ytimg.com/vi/dY90DXLi0vk/hqdefault.jpg)
![Learning at test time in LLMs [Jonas Hübotter]](https://imgz.pc97.com/?width=500&fit=cover&image=https://i.ytimg.com/vi/vei7uf9wOxI/hqdefault.jpg)
![Test-Time Adaptation: A New Frontier in AI [Dr. Jonas Hübotter]](https://imgz.pc97.com/?width=500&fit=cover&image=https://i.ytimg.com/vi/C6sSs6NgANo/hqdefault.jpg)
Essential Compute Tools for LLM Enthusiasts
AI-recommended products based on this video
Loading...
Dell Inspiron 3535 Laptop - 15.6 inch FHD (1920 x 1080) 120Hz Display, AMD Ryzen 5-7520U Processor, 8GB LPDDR5 RAM, 512GB SSD, AMD Radeon Graphics, Windows 11 Home, Migrate Service - Carbon Black EPEAT
(449)
$649.99
FREE delivery Sun, Aug 24
50+ bought in past month
Loading...
MINISFORUM UM890 Pro Mini PC Ryzen 9 8945HS (up to 5.2GHz) Desktop Computer 64GB RAM DDR5 5600MHz &1TB PCIe 4.0 SSD, Cculink Mini PC Quad Display HDMI/DP1.4/USB-C, AMD Radeon 780M/Dual LAN 2.5G
(521)
$1,389.99
FREE delivery Sun, Aug 10
Loading...
HP 17.3" FHD Laptop, AMD Ryzen 5 5500U, 16GB RAM, 1TB SSD, AMD Radeon Graphics, Numeric Keyboard, 720p HD Webcam, WiFi, Windows 11 Pro, Silver, 32GB Hotface USB Card
(13)
$899.00
FREE delivery Wed, Jun 18
Loading...
AtomMan G7 Pt Mini PC AMD Ryzen 9 7945HX(16C/32T, up to 5.4GHz) 32GB DDR5 1TB PCIe4.0 SSD Micro Computer, HDMI+DP+USB-C Output, 2.5G LAN, WiFi7, BT5.4, 4xUSB AMD Radeon RX 7600M XT Graphics Gaming PC
(14)
$1,999.90
Loading...
Beelink EQR5 Mini PC, AMD Ryzen 5 5650U(7nm, 6C/12T) up to 4.2GHz, Mini Computer 32GB DDR4 RAM 1TB PCIe3.0x4 SSD, Micro PC 4K@60Hz Dual HDMI Display/WiFi6/BT5.2/Office/Home/HTPC/W-11 Pro
(425)
$419.00
FREE delivery Sun, Aug 10
Loading...
BOSGAME Mini PC Intel Core i5 12600H(12C/16T, up 4.5GHz), 32GB DDR4 RAM 512GB PCIe SSD, Mini Desktop Computers Dual LAN/4x USB3.2/WiFi6E/BT5.2/HDMI+DP+USB-C/4K Triple Display
(35)
$413.10
FREE delivery Sun, Aug 10
Loading...
Beelink Mini PC, AMD Ryzen 7 5825U(6nm, 8C/16T) up to 4.5GHz, Mini Computer 32GB DDR4 RAM 500GB PCIe3.0x4 SSD, Micro PC 4K@60Hz Dual HDMI Display/WiFi6/BT5.2/Office/Home/HTPC/W-11 Pro
(790)
$426.54
Prime
Loading...
M9 Plus Mini PC with 2.1" Display, Intel Core i9-12900HK (14C/20T 5.0GHz), 32GB DDR4 RAM + 1TB NVMe SSD, Mini Desktop Computer, Compact Desktop Triple 4K Display, WiFi6, BT5.2, USB-C
(23)
$799.99
FREE delivery Wed, Jun 18
Loading...
BOSGAME P3 Lite Mini PC, AMD Ryzen 7 6800H Mini Computer (8C/16T, up to 4.7GHz), 24GB DDR4 1TB M.2 NVMe SSD, Triple Display Desktop Gaming PC, Pre-in Win 11 Pro, Dual LAN, WiFi 6E, BT 5.2
(67)
$549.00
FREE delivery Sun, Aug 10
Loading...
ORIGIMAGIC N1 Mini PC, Ryzen 7 5825U(8C/16T, UP to 4.5GHz) 32GB RAM 1TB M.2 NVMe SSD, Mini Computer 4K Quad Display/Dual USB-C(Support Data/PD3.0/DP) /WiFi 6E/BT5.2, Light Gaming/Office
(33)
$589.99
FREE delivery Sun, Aug 10
Loading...
ORIGIMAGIC N1 Mini PC Ryzen 7 5825U(8C/16T, UP to 4.5GHZ), Mini Computers 16GB DDR4 RAM 512GB M.2 NVMe SSD, Support 4K Quad Display/WiFi 6E/BT5.2/2.5G LAN/Dual USB-C(Data/PD3.0/DP),Home/Office
(19)
$489.99
FREE delivery Sat, Jun 21
Loading...
origimagic N1 Gaming Mini PC, AMD Ryzen 7 5825U(8C/16T, UP to 4.5GHz) 32GB RAM 1TB M.2 NVMe SSD, Mini Computer Support 4K Quad Display/WiFi 6E/BT5.2/Dual USB-C(Support Data/PD3.0/DP) Gaming/Office
(19)
$539.99
FREE delivery Wed, Jun 18
Loading...
MOSISO Laptop Case 13.3 inch, 13-13.3 inch Laptop Sleeve Bag Compatible with MacBook Air/Pro 13 / Pro 14, HP Dell ASUS Lenovo Notebook, Neoprene Computer Sleeve Bag with Small Case, Rock Gray Global Recycled Standard
(22,189)
$23.07$12.18
FREE delivery Tue, Jun 17 on your first order
Loading...
MOSISO Laptop Case 13.3 inch, 13-13.3 inch Laptop Sleeve Bag Compatible with MacBook Air/Pro 13 / Pro 14, HP Dell ASUS Lenovo Notebook, Neoprene Computer Sleeve Bag with Small Case, Black Global Recycled Standard
(22,184)
$22.49$20.89
FREE delivery Sat, Jun 14 on your first order
200+ bought in past month
Loading...
Crucial 64GB DDR5 RAM, 5600MHz (or 5200MHz or 4800MHz) Desktop Memory Kit, UDIMM 288-Pin, Compatible with 13th Gen Intel Core and AMD Ryzen 7000 - CT2K32G56C46U5
(2,409)
$181.38
FREE delivery Mon, Aug 11
Loading...
Western Digital 2TB WD Blue SA510 SATA Internal Solid State Drive SSD - SATA III 6 Gb/s, 2.5"/7mm, Up to 560 MB/s - WDS200T3B0A
(74,910)
$169.97
FREE delivery Tue, Jun 17
50+ bought in past month
Loading...
Intel Core i9-12900KF Desktop Processor 16 (8P+8E) Cores up to 5.2 GHz Unlocked LGA1700 600 Series Chipset 125W
(949)
$459.95
Loading...
Pc Motherboard Fit for Gigabyte B560M AORUS PRO AX Motherboard 128GB LGA 1200 DDR4 Micro ATX Mainboard
(0)
$360.47
$5.54 delivery Oct 28 - Nov 18