
OpenLanguageModel (OLM): An Open-Source PyTorch Library for Readable, Composable Small Language Model Pretraining
OpenLanguageModel (OLM) is an open-source PyTorch library that makes small language model pretraining readable and composable. Its code mirrors the architecture using components like Block, Residual, Repeat, and Parallel, enabling use in teaching notebooks, full pretraining runs, and research ablations without modification.






















