Tokenizer

Byte-Level Distillation Solves Cross-Tokenizer LLM Knowledge Transfer

Researchers propose Byte-Level Distillation (BLD) to simplify cross-tokenizer distillation for LLMs. This method operates at the byte level, avoiding complex heuristic strategies.