Describe how byte-pair encoding works and where it breaks down (numbers, code, non-Latin scripts).

BPE repeatedly merges the most frequent adjacent token pair learned from the corpus. It is simple and reversible, but vocabulary fertility and boundary choices can be poor for numbers, code, and underrepresented scripts.

Use equations or tensor shapes where they clarify the claim, then name an experiment or ablation that would distinguish competing explanations.