Terminal-Bench 2.1terminalCJavaScript
Cross-compile DOOM for a MIPS emulator
Build the supplied DOOM source into the expected MIPS ELF so vm.js runs it and the custom frame writer produces bitmap frames.
make-doom-for-mips
Normalized profile
What this task asks for
Build the supplied DOOM source into the expected MIPS ELF so vm.js runs it and the custom frame writer produces bitmap frames. Use the supplied doomgeneric_img.c frame backend. Produce a MIPS ELF named doomgeneric_mips. Run under node vm.js. Write rendered frames to /tmp/frame.bmp.
Intent
- systems setup
- feature implementation
- test and validation
Work surfaces
- cross-compiler toolchain
- game runtime
- frame output
Technology
- DOOM
- MIPS
- LLVM
- Node.js
- ELF
- BMP
Expected artifacts
- /app/doomgeneric_mips
What makes it difficult
- cross-platform or cross-architecture execution
- quantitative performance, accuracy, or resource constraints
- native compilation and dependency integration
- specialized algorithmic or domain reasoning
- cross-language or cross-format integration
Published evidence
Model × harness outcomes
Counts are tied to these exact configurations. Harnesses are not treated as equivalent across benchmarks.
- Models
- 13
- Configurations
- 20
- Trials
- 100
Showing 20 of 20 configurations
| Model | Harness | Effort | Result | Passes |
|---|---|---|---|---|
| claude-fable-5anthropic · 2026-06-07 | claude-code2.1.167 | xhigh | No passes5 errors | 0/5 |
| claude-fable-5anthropic · 2026-06-05 | terminus-22.0.0 | high | No passes5 errors | 0/5 |
| claude-opus-4-7anthropic · 2026-05-01 | claude-code2.1.123 | max | No passes5 errors | 0/5 |
| claude-opus-4-7anthropic · 2026-05-01 | terminus-22.0.0 | max | No passes5 errors | 0/5 |
| claude-opus-4-8anthropic · 2026-07-09 | claude-code2.1.205 | high | No passes5 errors | 0/5 |
| claude-sonnet-5anthropic · 2026-07-09 | claude-code2.1.205 | high | No passes5 errors | 0/5 |
| gemini-3-pro-previewgemini · 2026-05-01 | gemini-cli0.40.0 | high | No passes5 errors | 0/5 |
| gemini-3-pro-previewgemini · 2026-05-01 | terminus-22.0.0 | high | No passes5 errors | 0/5 |
| gemini-3.1-pro-previewgemini · 2026-05-05 | gemini-cli0.40.0 | high | No passes5 errors | 0/5 |
| gemini-3.1-pro-previewgemini · 2026-05-05 | terminus-22.0.0 | high | No passes5 errors | 0/5 |
| glm-5.1zai · 2026-05-01 | claude-code2.1.123 | max | No passes5 errors | 0/5 |
| gpt-5.5openai · 2026-05-01 | codex0.125.0 | xhigh | No passes4 errors | 0/5 |
| gpt-5.5openai · 2026-05-01 | terminus-22.0.0 | xhigh | No passes4 errors | 0/5 |
| gpt-5.6-lunaopenai · 2026-07-10 | codex0.144.0 | max | No passes2 errors | 0/5 |
| gpt-5.6-lunaopenai · 2026-07-11 | codex0.144.1 | max | No passes2 errors | 0/5 |
| gpt-5.6-solopenai · 2026-07-10 | codex0.144.0 | max | No passes3 errors | 0/5 |
| gpt-5.6-terraopenai · 2026-07-10 | codex0.144.0 | max | Mixed1 errors | 1/5 |
| gpt-5.6-terraopenai · 2026-07-11 | codex0.144.1 | max | No passes2 errors | 0/5 |
| grok-4.5cursor · 2026-07-09 | cursor-cli2026.07.08-0c04a8a | default | No passes2 errors | 0/5 |
| muse-spark-1.1openai · 2026-07-09 | mini-swe-agent2.4.5 | xhigh | No passes5 errors | 0/5 |