All evidence cases
Terminal-Bench 2.1terminalPythonCSVINI

Modernize a Python 2 climate analysis script

Reimplement the legacy climate analysis for current Python using pandas and pathlib while preserving station coverage and formatted mean-temperature output.

modernize-scientific-stack

Normalized profile

What this task asks for

Reimplement the legacy climate analysis for current Python using pandas and pathlib while preserving station coverage and formatted mean-temperature output. Leave the legacy script unchanged. Read CSV with UTF-8 and paths through pathlib. Process stations 101 and 102. Print each mean to one decimal degree Celsius. Declare numpy, pandas, and matplotlib or scipy with version constraints.

  • feature implementation
  • data transformation
  • systems setup
  • analysis script
  • dependency specification
  • pandas
  • NumPy
  • configparser
  • pathlib
  • /app/analyze_climate_modern.py
  • /app/requirements.txt or /app/pyproject.toml
  • legacy compatibility with modern tooling or runtimes
  • strict behavioral compatibility or exact-output validation
  • specialized algorithmic or domain reasoning
  • cross-language or cross-format integration

Published evidence

Model × harness outcomes

Counts are tied to these exact configurations. Harnesses are not treated as equivalent across benchmarks.

Models
13
Configurations
20
Trials
100

Showing 20 of 20 configurations

ModelHarnessEffortResultPasses
claude-fable-5anthropic · 2026-06-07claude-code2.1.167xhighAll passed5/5
claude-fable-5anthropic · 2026-06-05terminus-22.0.0highAll passed5/5
claude-opus-4-7anthropic · 2026-05-01claude-code2.1.123maxAll passed5/5
claude-opus-4-7anthropic · 2026-05-01terminus-22.0.0maxAll passed5/5
claude-opus-4-8anthropic · 2026-07-09claude-code2.1.205highAll passed5/5
claude-sonnet-5anthropic · 2026-07-09claude-code2.1.205highAll passed5/5
gemini-3-pro-previewgemini · 2026-05-01gemini-cli0.40.0highAll passed5/5
gemini-3-pro-previewgemini · 2026-05-01terminus-22.0.0highAll passed5/5
gemini-3.1-pro-previewgemini · 2026-05-05gemini-cli0.40.0highAll passed5/5
gemini-3.1-pro-previewgemini · 2026-05-05terminus-22.0.0highAll passed5/5
glm-5.1zai · 2026-05-01claude-code2.1.123maxAll passed5/5
gpt-5.5openai · 2026-05-01codex0.125.0xhighAll passed5/5
gpt-5.5openai · 2026-05-01terminus-22.0.0xhighAll passed5/5
gpt-5.6-lunaopenai · 2026-07-10codex0.144.0maxAll passed5/5
gpt-5.6-lunaopenai · 2026-07-11codex0.144.1maxAll passed5/5
gpt-5.6-solopenai · 2026-07-10codex0.144.0maxAll passed5/5
gpt-5.6-terraopenai · 2026-07-10codex0.144.0maxAll passed5/5
gpt-5.6-terraopenai · 2026-07-11codex0.144.1maxAll passed5/5
grok-4.5cursor · 2026-07-09cursor-cli2026.07.08-0c04a8adefaultAll passed5/5
muse-spark-1.1openai · 2026-07-09mini-swe-agent2.4.5xhighAll passed5/5