Interventional Grounding Audits: Black-Box Test Checks If LLM Reasoning Actually Uses Its Premises
Researchers introduce interventional grounding audits, a black-box method that substitutes predicates in LLM chain-of-thought reasoning to test whether conclusions genuinely depend on stated premises, evaluated on the ProntoQA benchmark.