Researchers Introduce 'Background Temperature' to Explain Hidden Randomness in LLMs
A new study formalizes the concept of 'background temperature' to describe implementation-level nondeterminism in large language models. This helps explain why identical inputs can produce divergent outputs even at temperature T=0.