Rotary Positional Embeddings Explained | Transformer
20:28
YouTubeOutlier
Rotary Positional Embeddings Explained | Transformer
In this video I'm going through RoPE (Rotary Positional Embeddings) which is a key method in Transformer models of any modality - text, image or video. RoPE is used to teach Transformers about positions in your input data. For example which text tokens come first in a sentence or how frames are ordered in a video. It is a necessity if you are ...
14.7K views9 months ago
RoFormer: Enhanced Transformer with Rotary Position Embedding RoFormer Paper Review
TriAttention: Trigonometric KV Compression for Efficient LLM Reasoning
7:14
TriAttention: Trigonometric KV Compression for Efficient LLM Reasoning
YouTubeResearch Paper Review
134 views1 month ago
DoPE: Denoising Rotary Position Embedding
10:49
DoPE: Denoising Rotary Position Embedding
YouTubeKeyur
35 views4 months ago
Rotary Positional Encoding: a ideia que mudou como transformers lidam com posição
51:49
Rotary Positional Encoding: a ideia que mudou como transformers lidam com posição
YouTubeLuisChary
4 weeks ago
Top videos
Let's understand Rotary Positional Embeddings in transformers
18:40
Let's understand Rotary Positional Embeddings in transformers
YouTubeHugging Face
2.5K views1 month ago
How Rotary Position Embedding Supercharges Modern LLMs [RoPE]
13:39
How Rotary Position Embedding Supercharges Modern LLMs [RoPE]
YouTubeJia-Bin Huang
25.4K viewsOct 19, 2024
RoFormer: Enhanced Transformer with Rotary Position Embedding Explained
39:52
RoFormer: Enhanced Transformer with Rotary Position Embedding Explained
YouTubeGabriel Mongaras
8K viewsJul 6, 2023
RoFormer: Enhanced Transformer with Rotary Position Embedding RoFormer Vs Bert
Implementing RoPE: From Mathematical Formula to Triton Code
10:23
Implementing RoPE: From Mathematical Formula to Triton Code
YouTubeQooba
1.4K views2 months ago
Decoupling the "What" and "Where" With Polar Coordinate Positional Embeddings
13:14
Decoupling the "What" and "Where" With Polar Coordinate Positional Embeddings
YouTubeXiaol.x
126 views4 months ago
Stop Wasting GPU Power: The Secret to 3x Faster RoPE (RoME)
4:24
Stop Wasting GPU Power: The Secret to 3x Faster RoPE (RoME)
YouTubeCollapsedLatents
1 views1 month ago
Let's understand Rotary Positional Embeddings in transformers
18:40
Let's understand Rotary Positional Embeddings in transformers
2.5K views1 month ago
YouTubeHugging Face
How Rotary Position Embedding Supercharges Modern LLMs [RoPE]
13:39
How Rotary Position Embedding Supercharges Modern LLMs [RoPE]
25.4K viewsOct 19, 2024
YouTubeJia-Bin Huang
RoFormer: Enhanced Transformer with Rotary Position Embedding Explained
39:52
RoFormer: Enhanced Transformer with Rotary Position Embedding E…
8K viewsJul 6, 2023
YouTubeGabriel Mongaras
Why Rotating Vectors Solves Positional Encoding in Transformers | Rotary Positional Embeddings(ROPE)
23:06
Why Rotating Vectors Solves Positional Encoding in Transform…
3.5K views4 months ago
YouTubeExplainingAI
RoFormer
16:12
RoFormer
75 views7 months ago
YouTubeAIDAS Lab
Transformer Architecture: Fast Attention, Rotary Positional Embeddings, and Multi-Query Attention
1:21
Transformer Architecture: Fast Attention, Rotary Positional Embe…
887 viewsJul 29, 2023
YouTubeRajistics - data science, AI, and machine learning
RoPE Rotary Position Embedding to 100K context length
39:56
RoPE Rotary Position Embedding to 100K context length
7.7K viewsMay 23, 2024
YouTubeDiscover AI
10:45
Rotary Positional Embeddings (RoPE) Explained for LLM Engineers
16 views1 month ago
YouTubeWei Sun
0:59
What is Rotary Positional Embedding (RoPE)
16 views6 months ago
YouTubeData Science Made Easy
How Rotary Position Embedding Supercharges Modern LLMs [RoP…
7 months ago
makeagif.com
23:26
Rotary Position Embedding explained deeply (w/ code)
5.8K viewsSep 25, 2024
YouTubeJakZee
10:49
DoPE: Denoising Rotary Position Embedding
35 views4 months ago
YouTubeKeyur
11:17
Rotary Positional Embeddings: Combining Absolute and Relative
75.7K viewsAug 8, 2023
YouTubeEfficient NLP
30:18
Rotary Positional Embeddings
5.3K viewsAug 5, 2023
YouTubeData Science Gems
14:06
RoPE (Rotary positional embeddings) explained: The positi…
53.7K viewsAug 2, 2023
YouTubeDeepLearning Hero
33:47
RoPE旋转位置编码原理解读
10.8K viewsSep 12, 2023
bilibili机智翔学长
11:05
Rotary Positional Embeddings & Rotation Matrix + Python LLM code
593 viewsSep 19, 2024
YouTubeVuk Rosić
24:15
什么是Rotary Embedding
3.3K viewsMay 7, 2023
bilibiliwharton0
10:23
Implementing RoPE: From Mathematical Formula to Triton C…
1.4K views2 months ago
YouTubeQooba
41:06
旋转位置编码论文详细解读(ROFORMER：ENHANCED TRAN…
2.6K viewsNov 23, 2024
bilibili紫陌洛西
22:02
Rotary Positional Embedding (RoPE) Explained
13 views5 months ago
YouTubeMarwan Elghitany
1:10:55
LLaMA explained: KV-Cache, Rotary Positional Embedding, RMS Norm…
118.2K viewsAug 24, 2023
YouTubeUmar Jamil
2:59
DoPE: Denoising RoPE for Long-Context LLMs
36 views6 months ago
YouTubeAI Research Roundup
11:18
旋转位置嵌入：绝对和相对位置嵌入的优雅结合
3.1K viewsSep 22, 2023
bilibili刘未央2035
7:00
[AI Podcast] RoFormer: Enhanced Transformer with Rotary Position …
22 views9 months ago
YouTubeListening to AI Papers
0:17
大模型-旋转位置编码（Rotary Positional Embedding）视频
12 views7 months ago
bilibili人工智能技术AI
0:20
Transformer-位置编码（Position Embedding）
3 views8 months ago
bilibili高洁01
9:40
Positional embeddings in transformers EXPLAINED | Demys…
91.7K viewsJul 12, 2021
YouTubeAI Coffee Break with Letitia
13:41
DoPE: Denoising Rotary Position Embedding (Nov 2025)
35 views6 months ago
YouTubeAI Paper Slop
See more videos
Static thumbnail place holder