ArXiv Study Benchmarks GPU Power Draw of 1B–7B Open-Source LLMs on an RTX 4060Ti
A new ArXiv paper provides the first reproducible hardware-level energy benchmark of nine open-source LLMs (1B–7B parameters) running on a consumer RTX 4060Ti 16GB GPU, revealing that larger models draw nearly twice the power of smaller ones and that prompt complexity significantly affects energy consumption.