Mamba - a replacement for Transformers?

Samuel Albanie • November 22, 2024

Samuel Albanie

About

AI research. Note that opinions expressed are my own. However, for conflict of interest purposes, please note that I'm employed by Google DeepMind (GDM). This almost certainly biases my judgment to some degree. I think GDM is pretty great. Other related content: - misc/outdoor stuff channel: https://www.youtube.com/@samuelalbaniemisc - https://x.com/SamuelAlbanie - https://bsky.app/profile/samuelalbanie.bsky.social FAQ: Software used to make videos - keynote on mac (to make slides) - Adobe Premiere Pro for editing

Mamba - a replacement for Transformers?

Samuel Albanie

About

Latest Posts

The Agent Company: Benchmarking LLM Agents on Consequential Real World Tasks

Prover-Verifier Games improve legibility of LLM outputs

Deliberative Alignment: Reasoning Enables Safer Language Models

Alignment Faking in Large Language Models

You May Also Like

Transform Your Workflow Today

Cmokifuly GMK67 65% Mechanical Keyboard Kit Tri-Mode South-Facing RGB LED for 3/5pin Switches,66 Keys+1 Knob Hotswap Socket PCB Gasket Mounted Plate Gaming DIY Keyboard Kit (White)

Logitech G203 Wired Gaming Mouse, 8,000 DPI, Rainbow Optical Effect LIGHTSYNC RGB, 6 Programmable Buttons, On-Board Memory, Screen Mapping, PC/Mac Computer and Laptop Compatible - Black

Logitech G305 LIGHTSPEED Wireless Gaming Mouse, Hero 12K Sensor, 12,000 DPI, Lightweight, 6 Programmable Buttons, 250h Battery Life, On-Board Memory, PC/Mac - Black

Logitech K400 Plus Wireless Touch TV Keyboard With Easy Media Control and Built-in Touchpad, HTPC Keyboard for PC-connected TV, Windows, Android, Chrome OS, Laptop, Tablet - Black

Logitech M185 Wireless Mouse, 2.4GHz with USB Mini Receiver, 12-Month Battery Life, 1000 DPI Optical Tracking, Ambidextrous, Compatible with PC, Mac, Laptop - Black

T8Plus Mini PC W-11 Pro, 12th Gen Ιntel Alder Lake N100 (up to 3.40Ghz) Mini Computers,12GB DDR5 256GB M.2 SSD Mini Office Desktop PC, Dual Ethernet/4K HDMI*3, 2,4/5 G WiFi,BT4.2

Razer Universal Quick Charging Stand for Xbox Series X|S: Magnetic Secure Charging - Matches Forza Horizon 5 Limited Edition Xbox Wireless Controller - USB Powered - (Controller Sold Separately)

Logitech M185 Wireless Mouse, 2.4GHz with USB Mini Receiver, 12-Month Battery Life, 1000 DPI Optical Tracking, Ambidextrous, Compatible with PC, Mac, Laptop - Black

Logitech G203 Wired Gaming Mouse, 8,000 DPI, Rainbow Optical Effect LIGHTSYNC RGB, 6 Programmable Buttons, On-Board Memory, Screen Mapping, PC/Mac Computer and Laptop Compatible - Black

Logitech G305 LIGHTSPEED Wireless Gaming Mouse, Hero 12K Sensor, 12,000 DPI, Lightweight, 6 Programmable Buttons, 250h Battery Life, On-Board Memory, PC/Mac - Black

Logitech G502 HERO High Performance Wired Gaming Mouse, HERO 25K Sensor, 25,600 DPI, RGB, Adjustable Weights, 11 Programmable Buttons, On-Board Memory, PC / Mac, Black

Turtle Beach Stealth 600 Wireless Multiplatform Amplified Gaming Headset for Xbox Series X|S, Xbox One, PC, PS5, PS4, Nintendo Switch, &amp; Mobile – Bluetooth, 80-Hr Battery, Noise-Cancelling Mic – Black

Turtle Beach Recon 50 Gaming Headset for Nintendo Switch, Xbox Series X|S, Xbox One, PS5, PS4, PlayStation, Mobile, &amp; PC with 3.5mm – Removable Mic, 40mm Speakers – Red/Blue

Monster Mission 300 Wireless Gaming Headset, 2.4GHz/Bluetooth Gaming Headphones,Low Latency, Stereo, Audio Location Recognition, 48H Battery Life, Suitable for PS5, PC, PS4 and Other Gaming Devices

Logitech G435 Lightspeed and Bluetooth Wireless Gaming Headset - Lightweight Over-Ear Headphones, Built-in mics, 18h Battery, Compatible with Dolby Atmos, PC, Mobile - Black

Loading...

Turtle Beach Stealth 600 Wireless Multiplatform Amplified Gaming Headset for Xbox Series X|S, Xbox One, PC, PS5, PS4, Nintendo Switch, & Mobile – Bluetooth, 80-Hr Battery, Noise-Cancelling Mic – Black

Turtle Beach Recon 50 Gaming Headset for Nintendo Switch, Xbox Series X|S, Xbox One, PS5, PS4, PlayStation, Mobile, & PC with 3.5mm – Removable Mic, 40mm Speakers – Red/Blue