All evidence cases
DeepSWE v1.1repositoryGo

Add XML diff, patch, and merge operations to etree

Add recursive XML diffing, patch generation and application, reverse patching, three-way merge, and diff summaries.

etree-xml-diff-patch

Normalized profile

What this task asks for

Add recursive XML diffing, patch generation and application, reverse patching, three-way merge, and diff summaries. Add nil-safe recursive element equality and document diff operations for elements, text, and attributes. Generate and apply XML patch documents using positional XPath selectors and the XML patch namespace. Reverse patches in reverse operation order while handling element, attribute, text, and replacement operations. Merge three document versions with configurable identity, conflict classification, and optional automatic resolution. Expose diff summaries, document convenience methods, and merge provenance in document metadata. Preserve documented operation value types, string forms, default diff options, and default merge options.

  • feature implementation
  • configuration tuning
  • data transformation
  • serialization
  • etree
  • XML
  • repository patch
  • strict behavioral compatibility or exact-output validation

Published evidence

Model × harness outcomes

Counts are tied to these exact configurations. Harnesses are not treated as equivalent across benchmarks.

Models
13
Configurations
41
Trials
164

Showing 41 of 41 configurations

ModelHarnessEffortResultPasses
claude-fable-5vertex_aimini-swe-agentpublished configurationlowMixed3/4
claude-fable-5vertex_aimini-swe-agentpublished configurationmediumMixed3/4
claude-fable-5vertex_aimini-swe-agentpublished configurationhighAll passed4/4
claude-fable-5vertex_aimini-swe-agentpublished configurationxhighMixed3/4
claude-fable-5vertex_aimini-swe-agentpublished configurationmaxAll passed4/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationlowAll passed4/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationmediumAll passed4/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationhighAll passed4/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationxhighAll passed4/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationmaxMixed3/4
claude-sonnet-4-6anthropicmini-swe-agentpublished configurationhighMixed1/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationlowMixed2/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationmediumMixed2/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationhighMixed3/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationxhighMixed3/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationmaxNo passes0/4
gemini-3-1-pro-previewvertex_aimini-swe-agentpublished configurationhighNo passes0/4
gemini-3-5-flashvertex_aimini-swe-agentpublished configurationmediumMixed3/4
glm-5-2zaimini-swe-agentpublished configurationhighMixed1/4
glm-5-2zaimini-swe-agentpublished configurationmaxMixed2/4
gpt-5-4openaimini-swe-agentpublished configurationxhighMixed1/4
gpt-5-5openaimini-swe-agentpublished configurationlowMixed2/4
gpt-5-5openaimini-swe-agentpublished configurationmediumMixed2/4
gpt-5-5openaimini-swe-agentpublished configurationhighAll passed4/4
gpt-5-5openaimini-swe-agentpublished configurationxhighMixed2/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationlowNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationmediumNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationhighMixed1/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationxhighMixed1/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationmaxMixed1/4
gpt-5-6-solopenaimini-swe-agentpublished configurationlowMixed1/4
gpt-5-6-solopenaimini-swe-agentpublished configurationmediumNo passes0/4
gpt-5-6-solopenaimini-swe-agentpublished configurationhighAll passed4/4
gpt-5-6-solopenaimini-swe-agentpublished configurationxhighAll passed4/4
gpt-5-6-solopenaimini-swe-agentpublished configurationmaxAll passed4/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationlowNo passes0/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationmediumNo passes0/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationhighMixed2/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationxhighAll passed4/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationmaxAll passed4/4
kimi-k2-7-codeopenroutermini-swe-agentpublished configurationdefaultMixed3/4