Signin

How Rotary Position Embedding Supercharges Modern LLMs

Jia-Bin Huang • October 23, 2024
Video Thumbnail

You May Also Like

Video Thumbnail

A Visual Guide to Mixture of Experts (MoE) in LLMs

Maarten Grootendorst

Video Thumbnail

Word Embedding and Word2Vec, Clearly Explained!!!

StatQuest with Josh Starmer

Video Thumbnail

4-Bit Training for Billion-Parameter LLMs? Yes, Really.

AI Coffee Break with Letitia

Video Thumbnail

The Attention Mechanism in Large Language Models

Serrano.Academy

Video Thumbnail

How FlashAttention Accelerates Generative AI Revolution

Jia-Bin Huang

Video Thumbnail

Transformers (how LLMs work) explained visually | DL5

3Blue1Brown

Video Thumbnail

How I Understand Flow Matching

Jia-Bin Huang

Video Thumbnail

Veritasium: What Everyone Gets Wrong About AI and Learning – Derek Muller Explains

Perimeter Institute for Theoretical Physics

Video Thumbnail

Rotary Positional Embeddings: Combining Absolute and Relative

Efficient NLP

Video Thumbnail

3D Gaussian Splatting! - Computerphile

Computerphile

Video Thumbnail

RoPE (Rotary positional embeddings) explained: The positional workhorse of modern LLMs

DeepLearning Hero

Video Thumbnail

But What Are Transformers?

Jia-Bin Huang

Video Thumbnail

How I Understand Diffusion Models

Jia-Bin Huang

Video Thumbnail

How might LLMs store facts | DL7

3Blue1Brown

Video Thumbnail

Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

Yannic Kilcher

Video Thumbnail

Visualizing transformers and attention | Talk for TNG Big Tech Day '24

Grant Sanderson

Video Thumbnail

What Makes ChatGPT Chat? Modern AI for the layperson

Natasha Jaques

Video Thumbnail

How to train a model to generate image embeddings from scratch

Underfitted

Video Thumbnail

Round and Round We Go! What makes Rotary Positional Encodings useful?

Gabriel Mongaras

Video Thumbnail

Rotary Positional Embeddings (RoPE): Part 1

West Coast Machine Learning

Video Thumbnail

How to Capture, Review, and Use Your Notes

Capacities

Video Thumbnail

The Biggest Misconception in Physics

Veritasium

Video Thumbnail

The Unreasonable Effectiveness of JPEG: A Signal Processing Approach

Reducible

Video Thumbnail

The Continuity of Splines

Freya Holmér

Video Thumbnail

Knowledge Graph or Vector Database… Which is Better?

Adam Lucek

Jia-Bin Huang

View Channel

About

No channel description available.

Latest Posts

Video Thumbnail

How FlashAttention Accelerates Generative AI Revolution

Jia-Bin Huang

Video Thumbnail

How I Understand Flow Matching

Jia-Bin Huang

Video Thumbnail

But What Are Transformers?

Jia-Bin Huang

Video Thumbnail

How I Understand Diffusion Models

Jia-Bin Huang

AI Assistant

Loading...