All evidence cases
Terminal-Bench 2.1terminalPythonJSON Lines

Fix CRLF injection in Bottle headers

Identify and repair the Bottle header-validation flaw that permits CRLF injection, report its CWE, and preserve the repository's test behavior.

fix-code-vulnerability

Normalized profile

What this task asks for

Identify and repair the Bottle header-validation flaw that permits CRLF injection, report its CWE, and preserve the repository's test behavior. Report /app/bottle.py with CWE-93. Reject carriage-return and line-feed input. Raise the expected specific error type for invalid input. Make the full pytest suite pass.

  • security remediation
  • bug repair
  • test and validation
  • HTTP header handling
  • input validation
  • Bottle
  • WSGI
  • HTTP headers
  • CWE
  • patched /app/bottle.py
  • /app/report.jsonl
  • security-sensitive or adversarial behavior
  • strict behavioral compatibility or exact-output validation
  • cross-language or cross-format integration

Published evidence

Model × harness outcomes

Counts are tied to these exact configurations. Harnesses are not treated as equivalent across benchmarks.

Models
13
Configurations
20
Trials
100

Showing 20 of 20 configurations

ModelHarnessEffortResultPasses
claude-fable-5anthropic · 2026-06-07claude-code2.1.167xhighAll passed5/5
claude-fable-5anthropic · 2026-06-05terminus-22.0.0highAll passed5/5
claude-opus-4-7anthropic · 2026-05-01claude-code2.1.123maxAll passed5/5
claude-opus-4-7anthropic · 2026-05-01terminus-22.0.0maxAll passed5/5
claude-opus-4-8anthropic · 2026-07-09claude-code2.1.205highAll passed5/5
claude-sonnet-5anthropic · 2026-07-09claude-code2.1.205highAll passed5/5
gemini-3-pro-previewgemini · 2026-05-01gemini-cli0.40.0highAll passed5/5
gemini-3-pro-previewgemini · 2026-05-01terminus-22.0.0highAll passed5/5
gemini-3.1-pro-previewgemini · 2026-05-05gemini-cli0.40.0highAll passed5/5
gemini-3.1-pro-previewgemini · 2026-05-05terminus-22.0.0highMixed1 disqualified4/5
glm-5.1zai · 2026-05-01claude-code2.1.123maxAll passed5/5
gpt-5.5openai · 2026-05-01codex0.125.0xhighAll passed5/5
gpt-5.5openai · 2026-05-01terminus-22.0.0xhighAll passed5/5
gpt-5.6-lunaopenai · 2026-07-10codex0.144.0maxAll passed5/5
gpt-5.6-lunaopenai · 2026-07-11codex0.144.1maxMixed3 disqualified2/5
gpt-5.6-solopenai · 2026-07-10codex0.144.0maxAll passed5/5
gpt-5.6-terraopenai · 2026-07-10codex0.144.0maxAll passed5/5
gpt-5.6-terraopenai · 2026-07-11codex0.144.1maxMixed1 disqualified4/5
grok-4.5cursor · 2026-07-09cursor-cli2026.07.08-0c04a8adefaultAll passed5/5
muse-spark-1.1openai · 2026-07-09mini-swe-agent2.4.5xhighAll passed5/5