All evidence cases
Terminal-Bench 2.1terminalCMakefile

Build headless pMARS from Debian sources

Build and install pMARS from Debian source packages with X11 disabled while retaining a working debugger and source tree.

build-pmars

Normalized profile

What this task asks for

Build and install pMARS from Debian source packages with X11 disabled while retaining a working debugger and source tree. Use Debian source packages. Build without X11 dependencies. Leave the extracted source tree in place. Retain debugger functionality.

  • systems setup
  • configuration tuning
  • build system
  • native binary
  • pMARS
  • Debian
  • X11
  • Core War
  • /usr/local/bin/pmars
  • /app/pmars-<version> source tree
  • native compilation and dependency integration
  • cross-language or cross-format integration

Published evidence

Model × harness outcomes

Counts are tied to these exact configurations. Harnesses are not treated as equivalent across benchmarks.

Models
13
Configurations
20
Trials
100

Showing 20 of 20 configurations

ModelHarnessEffortResultPasses
claude-fable-5anthropic · 2026-06-07claude-code2.1.167xhighAll passed5/5
claude-fable-5anthropic · 2026-06-05terminus-22.0.0highAll passed5/5
claude-opus-4-7anthropic · 2026-05-01claude-code2.1.123maxAll passed5/5
claude-opus-4-7anthropic · 2026-05-01terminus-22.0.0maxAll passed5/5
claude-opus-4-8anthropic · 2026-07-09claude-code2.1.205highAll passed5/5
claude-sonnet-5anthropic · 2026-07-09claude-code2.1.205highAll passed5/5
gemini-3-pro-previewgemini · 2026-05-01gemini-cli0.40.0highAll passed5/5
gemini-3-pro-previewgemini · 2026-05-01terminus-22.0.0highAll passed5/5
gemini-3.1-pro-previewgemini · 2026-05-05gemini-cli0.40.0highAll passed5/5
gemini-3.1-pro-previewgemini · 2026-05-05terminus-22.0.0highAll passed5/5
glm-5.1zai · 2026-05-01claude-code2.1.123maxMixed4/5
gpt-5.5openai · 2026-05-01codex0.125.0xhighAll passed5/5
gpt-5.5openai · 2026-05-01terminus-22.0.0xhighAll passed5/5
gpt-5.6-lunaopenai · 2026-07-10codex0.144.0maxAll passed5/5
gpt-5.6-lunaopenai · 2026-07-11codex0.144.1maxAll passed5/5
gpt-5.6-solopenai · 2026-07-10codex0.144.0maxAll passed5/5
gpt-5.6-terraopenai · 2026-07-10codex0.144.0maxAll passed5/5
gpt-5.6-terraopenai · 2026-07-11codex0.144.1maxAll passed5/5
grok-4.5cursor · 2026-07-09cursor-cli2026.07.08-0c04a8adefaultAll passed5/5
muse-spark-1.1openai · 2026-07-09mini-swe-agent2.4.5xhighAll passed5/5