Titan AI LogoTitan AI

minbpe

9,952
949
Python

Project Description

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

Project Information

Created on 2/16/2024
Updated on 9/23/2025