All evidence cases
DeepSWE v1.1repositoryGo

Add configurable array merge strategies to Helm value coalescing

Add chart-scoped append and key-based merge strategies for coalescing arrays during Helm value merging.

helm-array-merge-strategies

Normalized profile

What this task asks for

Add chart-scoped append and key-based merge strategies for coalescing arrays during Helm value merging. Strategy-aware global values: when a subchart declares a strategy for a path prefixed with `global.`, that strategy applies when global values are merged into the subchart's scope. Merge strategy annotation warnings must be emitted by the same lint rule that validates other Chart.yaml fields (name, version, type, dependencies). Strategies must be applied to user values and chart default values at the per-chart coalescing level, so that annotated arrays are pre-merged before individual keys are processed by the existing coalescing logic. Chart arrays must be deep-copied before strategy application to avoid mutating chart defaults. The chart accessor interface must expose annotations from chart metadata. Strategy extraction must return only actionable strategies: entries with `"merge"` that lack a companion merge-key are returned as `"append"`, and annotations with empty or invalid paths are excluded.

  • feature implementation
  • performance optimization
  • configuration tuning
  • data transformation
  • CLI
  • database schema
  • serialization
  • configuration
  • Helm
  • repository patch
  • changes span multiple components or interfaces

Published evidence

Model × harness outcomes

Counts are tied to these exact configurations. Harnesses are not treated as equivalent across benchmarks.

Models
13
Configurations
41
Trials
164

Showing 41 of 41 configurations

ModelHarnessEffortResultPasses
claude-fable-5vertex_aimini-swe-agentpublished configurationlowNo passes0/4
claude-fable-5vertex_aimini-swe-agentpublished configurationmediumNo passes0/4
claude-fable-5vertex_aimini-swe-agentpublished configurationhighMixed1/4
claude-fable-5vertex_aimini-swe-agentpublished configurationxhighNo passes0/4
claude-fable-5vertex_aimini-swe-agentpublished configurationmaxNo passes0/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationlowMixed2/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationmediumMixed2/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationhighMixed3/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationxhighMixed2/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationmaxMixed3/4
claude-sonnet-4-6anthropicmini-swe-agentpublished configurationhighMixed3/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationlowNo passes0/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationmediumNo passes0/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationhighNo passes0/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationxhighMixed1/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationmaxMixed2/4
gemini-3-1-pro-previewvertex_aimini-swe-agentpublished configurationhighNo passes0/4
gemini-3-5-flashvertex_aimini-swe-agentpublished configurationmediumMixed2/4
glm-5-2zaimini-swe-agentpublished configurationhighNo passes0/4
glm-5-2zaimini-swe-agentpublished configurationmaxMixed1/4
gpt-5-4openaimini-swe-agentpublished configurationxhighNo passes0/4
gpt-5-5openaimini-swe-agentpublished configurationlowNo passes0/4
gpt-5-5openaimini-swe-agentpublished configurationmediumNo passes0/4
gpt-5-5openaimini-swe-agentpublished configurationhighNo passes0/4
gpt-5-5openaimini-swe-agentpublished configurationxhighNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationlowNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationmediumNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationhighMixed1/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationxhighNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationmaxNo passes0/4
gpt-5-6-solopenaimini-swe-agentpublished configurationlowNo passes0/4
gpt-5-6-solopenaimini-swe-agentpublished configurationmediumNo passes0/4
gpt-5-6-solopenaimini-swe-agentpublished configurationhighNo passes0/4
gpt-5-6-solopenaimini-swe-agentpublished configurationxhighMixed2/4
gpt-5-6-solopenaimini-swe-agentpublished configurationmaxNo passes0/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationlowNo passes0/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationmediumNo passes0/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationhighNo passes0/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationxhighNo passes0/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationmaxNo passes0/4
kimi-k2-7-codeopenroutermini-swe-agentpublished configurationdefaultMixed1/4