All evidence cases
DeepSWE v1.1repositoryTypeScript

Add duration-aware sharding to Vitest

Add duration-aware sharding strategies and duration history handling for Vitest.

vitest-duration-sharding

Normalized profile

What this task asks for

Add duration-aware sharding strategies and duration history handling for Vitest. Add and validate the 12 duration-aware sequence fields and serialize them to worker configuration. Read, migrate, expire, smooth, and cap duration history observations using project-relative normalized paths. Implement time, round-robin, affinity, and fallback sharding with deterministic tie-breaking. Apply slow-file isolation, affinity load accounting, and rebalance warnings with fixed ratio formatting. Sort by recorded duration when requested and record rounded final durations while preserving unrelated history entries. Resolve `balanceShardsByTime` to the time strategy only when compatible and otherwise force it off.

  • feature implementation
  • data transformation
  • bug repair
  • test and validation
  • serialization
  • configuration
  • Vitest
  • repository patch
  • strict behavioral compatibility or exact-output validation

Published evidence

Model × harness outcomes

Counts are tied to these exact configurations. Harnesses are not treated as equivalent across benchmarks.

Models
13
Configurations
41
Trials
164

Showing 41 of 41 configurations

ModelHarnessEffortResultPasses
claude-fable-5vertex_aimini-swe-agentpublished configurationlowAll passed4/4
claude-fable-5vertex_aimini-swe-agentpublished configurationmediumAll passed4/4
claude-fable-5vertex_aimini-swe-agentpublished configurationhighAll passed4/4
claude-fable-5vertex_aimini-swe-agentpublished configurationxhighAll passed4/4
claude-fable-5vertex_aimini-swe-agentpublished configurationmaxAll passed4/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationlowMixed3/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationmediumAll passed4/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationhighAll passed4/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationxhighMixed3/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationmaxMixed3/4
claude-sonnet-4-6anthropicmini-swe-agentpublished configurationhighMixed3/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationlowNo passes0/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationmediumMixed2/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationhighMixed3/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationxhighAll passed4/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationmaxMixed3/4
gemini-3-1-pro-previewvertex_aimini-swe-agentpublished configurationhighNo passes0/4
gemini-3-5-flashvertex_aimini-swe-agentpublished configurationmediumMixed3/4
glm-5-2zaimini-swe-agentpublished configurationhighAll passed4/4
glm-5-2zaimini-swe-agentpublished configurationmaxMixed3/4
gpt-5-4openaimini-swe-agentpublished configurationxhighAll passed4/4
gpt-5-5openaimini-swe-agentpublished configurationlowMixed1/4
gpt-5-5openaimini-swe-agentpublished configurationmediumAll passed4/4
gpt-5-5openaimini-swe-agentpublished configurationhighAll passed4/4
gpt-5-5openaimini-swe-agentpublished configurationxhighAll passed4/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationlowNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationmediumNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationhighMixed2/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationxhighMixed2/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationmaxMixed2/4
gpt-5-6-solopenaimini-swe-agentpublished configurationlowAll passed4/4
gpt-5-6-solopenaimini-swe-agentpublished configurationmediumAll passed4/4
gpt-5-6-solopenaimini-swe-agentpublished configurationhighAll passed4/4
gpt-5-6-solopenaimini-swe-agentpublished configurationxhighAll passed4/4
gpt-5-6-solopenaimini-swe-agentpublished configurationmaxAll passed4/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationlowMixed2/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationmediumNo passes0/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationhighMixed3/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationxhighAll passed4/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationmaxAll passed4/4
kimi-k2-7-codeopenroutermini-swe-agentpublished configurationdefaultMixed2/4