What Makes LLM Tokenization Slow? 0 ▲ Andrew Healey's Blog 76 days ago · Tech · hide · Fediverse post Exploring the performance of byte-pair encoding by optimizing a GPT-2 tokenizer. Commenting on Bubbles has been removed. Why? If you want to talk about this post, write to the author, use the comments on their blog if it has them, or reply with a "RE:" post on your own blog. Suggestions? feedback@bubbles.town