The evaluation loop is the benchmark
Pause Flow
Reset
EXTRACT
PROMPT
EXEC CMD
SOURCE
RETRY
RESULTS
SCORE
EXAM PDF
PDF TEXT EXTRACTION
AGENT HARNESS
DOCKER SANDBOX (CLICK)
COMPILE AND RUN
HOST-SIDE VERIFICATION
LEADERBOARD OUTPUT
LIBCE
QEMU-CE
AUTOCORR=1
PROMPT PARSING ERROR
TURN-LIMIT EXHAUSTION
COMPILE ERROR
WRONG OUTPUT