Terminal-Bench 2.1terminalRedcode
Write a Core War warrior with target win rates
Create a Redcode warrior that meets separate 100-round win-rate thresholds against five supplied pMARS opponents without modifying them.
winning-avg-corewars
Normalized profile
What this task asks for
Create a Redcode warrior that meets separate 100-round win-rate thresholds against five supplied pMARS opponents without modifying them. Use core size 8000 and maximum 80,000 cycles. Win at least 75 of 100 rounds against stone, vampire, and paper. Win at least 33 of 100 rounds against snake and g2-clear. Leave every opponent file unchanged.
Intent
- feature implementation
- configuration tuning
- test and validation
Work surfaces
- game program
- battle simulator
Technology
- pMARS
- Core War
- Redcode
Expected artifacts
- my_warrior.red
What makes it difficult
- strict behavioral compatibility or exact-output validation
- quantitative performance, accuracy, or resource constraints
Published evidence
Model × harness outcomes
Counts are tied to these exact configurations. Harnesses are not treated as equivalent across benchmarks.
- Models
- 13
- Configurations
- 20
- Trials
- 100
Showing 20 of 20 configurations
| Model | Harness | Effort | Result | Passes |
|---|---|---|---|---|
| claude-fable-5anthropic · 2026-06-07 | claude-code2.1.167 | xhigh | No passes5 errors | 0/5 |
| claude-fable-5anthropic · 2026-06-05 | terminus-22.0.0 | high | Mixed2 errors | 3/5 |
| claude-opus-4-7anthropic · 2026-05-01 | claude-code2.1.123 | max | Mixed1 errors | 4/5 |
| claude-opus-4-7anthropic · 2026-05-01 | terminus-22.0.0 | max | No passes5 errors | 0/5 |
| claude-opus-4-8anthropic · 2026-07-09 | claude-code2.1.205 | high | Mixed1 errors | 4/5 |
| claude-sonnet-5anthropic · 2026-07-09 | claude-code2.1.205 | high | Mixed2 errors | 2/5 |
| gemini-3-pro-previewgemini · 2026-05-01 | gemini-cli0.40.0 | high | Mixed1 errors | 2/5 |
| gemini-3-pro-previewgemini · 2026-05-01 | terminus-22.0.0 | high | Mixed | 4/5 |
| gemini-3.1-pro-previewgemini · 2026-05-05 | gemini-cli0.40.0 | high | Mixed | 4/5 |
| gemini-3.1-pro-previewgemini · 2026-05-05 | terminus-22.0.0 | high | Mixed | 3/5 |
| glm-5.1zai · 2026-05-01 | claude-code2.1.123 | max | No passes5 errors | 0/5 |
| gpt-5.5openai · 2026-05-01 | codex0.125.0 | xhigh | All passed | 5/5 |
| gpt-5.5openai · 2026-05-01 | terminus-22.0.0 | xhigh | Mixed1 disqualified | 4/5 |
| gpt-5.6-lunaopenai · 2026-07-10 | codex0.144.0 | max | Mixed1 errors · 2 disqualified | 2/5 |
| gpt-5.6-lunaopenai · 2026-07-11 | codex0.144.1 | max | Mixed | 3/5 |
| gpt-5.6-solopenai · 2026-07-10 | codex0.144.0 | max | All passed | 5/5 |
| gpt-5.6-terraopenai · 2026-07-10 | codex0.144.0 | max | Mixed2 disqualified | 3/5 |
| gpt-5.6-terraopenai · 2026-07-11 | codex0.144.1 | max | All passed | 5/5 |
| grok-4.5cursor · 2026-07-09 | cursor-cli2026.07.08-0c04a8a | default | All passed | 5/5 |
| muse-spark-1.1openai · 2026-07-09 | mini-swe-agent2.4.5 | xhigh | All passed | 5/5 |