
Why GPT Can't Count: Visualizing the BPE Tokenization Trap
Interactive visualization of Byte Pair Encoding (BPE) tokenization. Discover why GPT thinks 9.11 > 9.9 and watch the tokenizer chop your text in real-time.
Loading...
Teach machines to think, learn, and surprise you
56 posts
Showing 49-56 of 56 posts

Interactive visualization of Byte Pair Encoding (BPE) tokenization. Discover why GPT thinks 9.11 > 9.9 and watch the tokenizer chop your text in real-time.

Interactive visualization of RNN vs Transformer architecture. See why RNNs forget and how Transformers solve the vanishing gradient problem.

See how large language models decide which words matter in a sentence. Interactive Query, Key, Value simulator shows self-attention live.

Interactive visualization of Word2Vec and word embeddings. See why good and great were strangers in one-hot encoding but neighbors in vector space.

Drag points between classes and watch split quality update live. Interactive calculator shows why decision trees split where they do.

Interactive SVM kernel trick visualization. Draw non-linear data and watch it get lifted into higher dimensions where a simple line can separate it.

See why K-Means clustering fails with bad initialization. Place centroids yourself and watch the algorithm get trapped in local optima live.

Drag the classification threshold slider and watch the confusion matrix update live. See the precision-recall tradeoff with visual examples.