All evidence cases
Terminal-Bench 2.1terminalSPARQLTurtle

Query eligible EU university professors

Write a SPARQL query returning full professors who currently work in an EU university department with more than ten enrolled students.

sparql-university

Normalized profile

What this task asks for

Write a SPARQL query returning full professors who currently work in an EU university department with more than ten enrolled students. Use 2025-08-16 for current-state and EU membership logic. Require at least one qualifying EU department with over ten students enrolled in its classes. Select full professors only. Return professorName and distinct working countries joined with comma-space.

  • data transformation
  • knowledge graph
  • query aggregation
  • SPARQL
  • RDF
  • Turtle
  • ISO 3166-1
  • /app/solution.sparql
  • quantitative performance, accuracy, or resource constraints
  • cross-language or cross-format integration

Published evidence

Model × harness outcomes

Counts are tied to these exact configurations. Harnesses are not treated as equivalent across benchmarks.

Models
13
Configurations
20
Trials
100

Showing 20 of 20 configurations

ModelHarnessEffortResultPasses
claude-fable-5anthropic · 2026-06-07claude-code2.1.167xhighAll passed5/5
claude-fable-5anthropic · 2026-06-05terminus-22.0.0highAll passed5/5
claude-opus-4-7anthropic · 2026-05-01claude-code2.1.123maxAll passed5/5
claude-opus-4-7anthropic · 2026-05-01terminus-22.0.0maxAll passed5/5
claude-opus-4-8anthropic · 2026-07-09claude-code2.1.205highAll passed5/5
claude-sonnet-5anthropic · 2026-07-09claude-code2.1.205highMixed4/5
gemini-3-pro-previewgemini · 2026-05-01gemini-cli0.40.0highAll passed5/5
gemini-3-pro-previewgemini · 2026-05-01terminus-22.0.0highAll passed5/5
gemini-3.1-pro-previewgemini · 2026-05-05gemini-cli0.40.0highMixed3/5
gemini-3.1-pro-previewgemini · 2026-05-05terminus-22.0.0highAll passed5/5
glm-5.1zai · 2026-05-01claude-code2.1.123maxAll passed5/5
gpt-5.5openai · 2026-05-01codex0.125.0xhighAll passed5/5
gpt-5.5openai · 2026-05-01terminus-22.0.0xhighAll passed5/5
gpt-5.6-lunaopenai · 2026-07-10codex0.144.0maxMixed4/5
gpt-5.6-lunaopenai · 2026-07-11codex0.144.1maxAll passed5/5
gpt-5.6-solopenai · 2026-07-10codex0.144.0maxAll passed5/5
gpt-5.6-terraopenai · 2026-07-10codex0.144.0maxAll passed5/5
gpt-5.6-terraopenai · 2026-07-11codex0.144.1maxAll passed5/5
grok-4.5cursor · 2026-07-09cursor-cli2026.07.08-0c04a8adefaultAll passed5/5
muse-spark-1.1openai · 2026-07-09mini-swe-agent2.4.5xhighAll passed5/5