Account

MAMBA from Scratch: Neural Nets Better and Faster than Transformers

Algorithmic Simplicity • May 1, 2024

Video Thumbnail

Algorithmic Simplicity

About

This is an educational channel for all things algorithmic, including but not limited to computer science, machine learning, physics, and mathematics.

Latest Posts

Video Thumbnail

THIS is why large language models can understand the world

Algorithmic Simplicity

Video Thumbnail

Why Does Diffusion Work Better than Auto-Regression?

Algorithmic Simplicity

Video Thumbnail

Transformer Neural Networks Derived from Scratch

Algorithmic Simplicity

Video Thumbnail

But what is a neural network REALLY?

Algorithmic Simplicity

You May Also Like

Intuition behind Mamba and State Space Models | Enhancing LLMs!

Intuition behind Mamba and State Space Models | Enhancing LLMs!

Maarten Grootendorst8 months ago

Mamba: Linear-Time Sequence Modeling with Selective State Spaces (Paper Explained)

Mamba: Linear-Time Sequence Modeling with Selective State Spaces (Paper Explained)

Yannic Kilcher1 year ago

The Strange Math That Predicts (Almost) Anything

The Strange Math That Predicts (Almost) Anything

Veritasium4 months ago

AlphaFold - The Most Useful Thing AI Has Ever Done

AlphaFold - The Most Useful Thing AI Has Ever Done

Veritasium10 months ago

The Code That Revolutionized Orbital Simulation

The Code That Revolutionized Orbital Simulation

braintruffle6 days ago

The Most Important Algorithm in Machine Learning

The Most Important Algorithm in Machine Learning

Artem Kirsanov1 year ago

How Attention Got So Efficient [GQA/MLA/DSA]

How Attention Got So Efficient [GQA/MLA/DSA]

Jia-Bin Huang2 weeks ago

Cybersecurity Architecture: Networks

Cybersecurity Architecture: Networks

IBM Technology2 years ago

Visualizing transformers and attention | Talk for TNG Big Tech Day '24

Visualizing transformers and attention | Talk for TNG Big Tech Day '24

Grant Sanderson1 year ago

Generative Model That Won 2024 Nobel Prize

Generative Model That Won 2024 Nobel Prize

Artem Kirsanov1 year ago

Gradient descent, how neural networks learn | Deep Learning Chapter 2

Gradient descent, how neural networks learn | Deep Learning Chapter 2

3Blue1Brown8 years ago

MAMBA and State Space Models explained | SSM explained

MAMBA and State Space Models explained | SSM explained

AI Coffee Break with Letitia1 year ago

Something Weird Happens When E=−mc²

Something Weird Happens When E=−mc²

Veritasium1 week ago

Transformers, the tech behind LLMs | Deep Learning Chapter 5

Transformers, the tech behind LLMs | Deep Learning Chapter 5

3Blue1Brown1 year ago

The Real Reason Huge AI Models Actually Work [Prof. Andrew Wilson]

The Real Reason Huge AI Models Actually Work [Prof. Andrew Wilson]

Machine Learning Street Talk2 months ago

But what is quantum computing? (Grover's Algorithm)

But what is quantum computing? (Grover's Algorithm)

3Blue1Brown7 months ago

State Space Models (SSMs) and Mamba

State Space Models (SSMs) and Mamba

Serrano.Academy1 year ago

The Misconception that Almost Stopped AI [How Models Learn Part 1]

The Misconception that Almost Stopped AI [How Models Learn Part 1]

Welch Labs7 months ago

Deep Dive into LLMs like ChatGPT

Deep Dive into LLMs like ChatGPT

Andrej Karpathy10 months ago

RWKV: Reinventing RNNs for the Transformer Era (Paper Explained)

RWKV: Reinventing RNNs for the Transformer Era (Paper Explained)

Yannic Kilcher2 years ago

Home AiChat Shop Saved Account