New Benchmark Tests AI Coding Skills in KillSwitch, an Adversarial Language Designed to Stump Models
A new benchmark at bench.killswitch-lang.org tests AI models' coding abilities in KillSwitch, a programming language intentionally designed to be difficult for AI to process. Results show current models, including GPT-4 and Claude, struggle significantly with syntax interpretation, debugging, and optimization in this adversarial language.