New Scaling Law for Word Arrangement Discovered in Human Language Across 10 Languages
Researchers have identified a new scaling law, the contextual persistence function P(d), that governs how word arrangement affects meaning in human language. Using LLMs as probes across 10 languages, they found the impact of prior context follows a power-law decay, which could improve AI language models.