All evidence cases
DeepSWE v1.1repositoryJavaScript

Add deterministic map conflict detection to Y.Map writes

Add strict, deterministic conflict detection for Y.Map key writes with collect and error policies.

yjs-map-conflict-detection

Normalized profile

What this task asks for

Add strict, deterministic conflict detection for Y.Map key writes with collect and error policies. Add strict, deterministic conflict detection for Y.Map-style key writes so ambiguous or overlapping operations are detected early, reported clearly, and optionally block updates before they partially apply. Conflicts must be detected for set-set and delete-set on the same key within the same transaction or merged update when mapConflictPolicy is collect or error. Conflicts involving Yjs types or subdocs must be marked as ambiguous, either by setting conflict.type to ambiguous or by exposing an ambiguous boolean flag. The policy is configured via the Y.Doc constructor options as new Y.Doc({ mapConflictPolicy: 'allow'|'collect'|'error' }). The thrown error must expose an err.conflicts array. The summary must also include an overall count as count or total.

  • feature implementation
  • configuration tuning
  • test and validation
  • library API
  • Yjs
  • repository patch
  • reverse engineering from incomplete or indirect evidence
  • strict behavioral compatibility or exact-output validation
  • quantitative performance, accuracy, or resource constraints
  • stateful behavior and data-integrity constraints

Published evidence

Model × harness outcomes

Counts are tied to these exact configurations. Harnesses are not treated as equivalent across benchmarks.

Models
13
Configurations
41
Trials
164

Showing 41 of 41 configurations

ModelHarnessEffortResultPasses
claude-fable-5vertex_aimini-swe-agentpublished configurationlowMixed2/4
claude-fable-5vertex_aimini-swe-agentpublished configurationmediumMixed3/4
claude-fable-5vertex_aimini-swe-agentpublished configurationhighMixed3/4
claude-fable-5vertex_aimini-swe-agentpublished configurationxhighMixed3/4
claude-fable-5vertex_aimini-swe-agentpublished configurationmaxAll passed4/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationlowMixed3/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationmediumMixed3/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationhighAll passed4/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationxhighMixed3/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationmaxMixed3/4
claude-sonnet-4-6anthropicmini-swe-agentpublished configurationhighMixed3/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationlowMixed1/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationmediumAll passed4/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationhighAll passed4/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationxhighMixed3/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationmaxMixed3/4
gemini-3-1-pro-previewvertex_aimini-swe-agentpublished configurationhighNo passes0/4
gemini-3-5-flashvertex_aimini-swe-agentpublished configurationmediumMixed3/4
glm-5-2zaimini-swe-agentpublished configurationhighMixed3/4
glm-5-2zaimini-swe-agentpublished configurationmaxMixed3/4
gpt-5-4openaimini-swe-agentpublished configurationxhighMixed1/4
gpt-5-5openaimini-swe-agentpublished configurationlowMixed2/4
gpt-5-5openaimini-swe-agentpublished configurationmediumMixed3/4
gpt-5-5openaimini-swe-agentpublished configurationhighAll passed4/4
gpt-5-5openaimini-swe-agentpublished configurationxhighMixed3/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationlowNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationmediumNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationhighMixed3/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationxhighAll passed4/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationmaxAll passed4/4
gpt-5-6-solopenaimini-swe-agentpublished configurationlowAll passed4/4
gpt-5-6-solopenaimini-swe-agentpublished configurationmediumAll passed4/4
gpt-5-6-solopenaimini-swe-agentpublished configurationhighAll passed4/4
gpt-5-6-solopenaimini-swe-agentpublished configurationxhighMixed3/4
gpt-5-6-solopenaimini-swe-agentpublished configurationmaxAll passed4/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationlowMixed2/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationmediumMixed3/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationhighMixed3/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationxhighMixed3/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationmaxAll passed4/4
kimi-k2-7-codeopenroutermini-swe-agentpublished configurationdefaultAll passed4/4