All evidence cases
DeepSWE v1.1repositoryGo

Add try/catch error recovery to expr

Add expression and block-level error recovery with try, catch, finally, throw, retry, and errtype.

expr-try-catch-errors

Normalized profile

What this task asks for

Add expression and block-level error recovery with try, catch, finally, throw, retry, and errtype. Add comprehensive error handling. `try(expression, fallback)` - returns expression result on success or the lazily-evaluated fallback on error; requires exactly two arguments. `try { expr } catch { handler }` - block form; optionally `catch <name> { ... }` to bind the error. `catch <name> is "substring" { ... }` - catches only errors whose message contains the substring. `finally { cleanup }` - optional clause that always executes after try/catch; if the finally body throws, that error propagates (overriding any prior result). `throw(value)` - throws a custom error from any value (the error message is its string conversion); requires exactly one argument.

  • feature implementation
  • configuration tuning
  • runtime
  • Expr
  • repository patch
  • reverse engineering from incomplete or indirect evidence
  • strict behavioral compatibility or exact-output validation

Published evidence

Model × harness outcomes

Counts are tied to these exact configurations. Harnesses are not treated as equivalent across benchmarks.

Models
13
Configurations
41
Trials
164

Showing 41 of 41 configurations

ModelHarnessEffortResultPasses
claude-fable-5vertex_aimini-swe-agentpublished configurationlowMixed3/4
claude-fable-5vertex_aimini-swe-agentpublished configurationmediumMixed3/4
claude-fable-5vertex_aimini-swe-agentpublished configurationhighMixed3/4
claude-fable-5vertex_aimini-swe-agentpublished configurationxhighMixed2/4
claude-fable-5vertex_aimini-swe-agentpublished configurationmaxMixed2/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationlowNo passes0/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationmediumMixed2/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationhighNo passes0/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationxhighMixed1/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationmaxNo passes0/4
claude-sonnet-4-6anthropicmini-swe-agentpublished configurationhighNo passes0/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationlowNo passes0/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationmediumNo passes0/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationhighNo passes0/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationxhighNo passes0/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationmaxNo passes0/4
gemini-3-1-pro-previewvertex_aimini-swe-agentpublished configurationhighNo passes0/4
gemini-3-5-flashvertex_aimini-swe-agentpublished configurationmediumMixed1/4
glm-5-2zaimini-swe-agentpublished configurationhighMixed2/4
glm-5-2zaimini-swe-agentpublished configurationmaxNo passes0/4
gpt-5-4openaimini-swe-agentpublished configurationxhighNo passes0/4
gpt-5-5openaimini-swe-agentpublished configurationlowNo passes0/4
gpt-5-5openaimini-swe-agentpublished configurationmediumMixed1/4
gpt-5-5openaimini-swe-agentpublished configurationhighMixed2/4
gpt-5-5openaimini-swe-agentpublished configurationxhighMixed1/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationlowNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationmediumNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationhighMixed1/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationxhighNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationmaxMixed3/4
gpt-5-6-solopenaimini-swe-agentpublished configurationlowMixed1/4
gpt-5-6-solopenaimini-swe-agentpublished configurationmediumMixed2/4
gpt-5-6-solopenaimini-swe-agentpublished configurationhighAll passed4/4
gpt-5-6-solopenaimini-swe-agentpublished configurationxhighAll passed4/4
gpt-5-6-solopenaimini-swe-agentpublished configurationmaxMixed2/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationlowNo passes0/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationmediumNo passes0/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationhighNo passes0/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationxhighNo passes0/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationmaxMixed2/4
kimi-k2-7-codeopenroutermini-swe-agentpublished configurationdefaultNo passes0/4