RealCLI Benchmark Evaluates How Well AI Agents Collaborate with Humans on Command-Line Tasks
Researchers introduced RealCLI, a new benchmark that evaluates both task execution and the quality of human-agent collaboration on command-line tasks. It uses a five-dimensional framework with 22 sub-dimensions and 51 interaction metrics.