All evidence cases
DeepSWE v1.1repositoryPython

Add request coalescing to `Runnable`

Add `Runnable.with_coalesce()` so concurrent identical inputs share one execution across sync, async, streaming, and batch APIs.

langchain-request-coalescing

Normalized profile

What this task asks for

Add `Runnable.with_coalesce()` so concurrent identical inputs share one execution across sync, async, streaming, and batch APIs. Add `Runnable.with_coalesce()` so concurrent calls with the same input share one execution. Apply coalescing across synchronous and asynchronous invoke, stream, batch, and batch-as-completed methods. Build keys from input values alone, independent of configuration, keyword arguments, or dictionary key ordering. Replay complete streams to joiners, preserve batch ordering, and fire callbacks for joined callers. Provide synchronous and asynchronous backend registration, joining, completion, activity, and statistics operations. Keep the in-memory backend thread-safe and let clear cancel waiters and reset statistics.

  • feature implementation
  • performance optimization
  • configuration tuning
  • data transformation
  • configuration
  • network service
  • task scheduler
  • library API
  • LangChain
  • asyncio
  • repository patch
  • concurrency, cancellation, or distributed-state coordination
  • strict behavioral compatibility or exact-output validation
  • changes span multiple components or interfaces

Published evidence

Model × harness outcomes

Counts are tied to these exact configurations. Harnesses are not treated as equivalent across benchmarks.

Models
13
Configurations
41
Trials
164

Showing 41 of 41 configurations

ModelHarnessEffortResultPasses
claude-fable-5vertex_aimini-swe-agentpublished configurationlowAll passed4/4
claude-fable-5vertex_aimini-swe-agentpublished configurationmediumMixed1/4
claude-fable-5vertex_aimini-swe-agentpublished configurationhighMixed2/4
claude-fable-5vertex_aimini-swe-agentpublished configurationxhighMixed3/4
claude-fable-5vertex_aimini-swe-agentpublished configurationmaxMixed2/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationlowNo passes0/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationmediumNo passes0/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationhighMixed2/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationxhighMixed2/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationmaxMixed1/4
claude-sonnet-4-6anthropicmini-swe-agentpublished configurationhighMixed1/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationlowNo passes0/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationmediumNo passes0/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationhighMixed2/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationxhighNo passes0/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationmaxNo passes0/4
gemini-3-1-pro-previewvertex_aimini-swe-agentpublished configurationhighMixed1/4
gemini-3-5-flashvertex_aimini-swe-agentpublished configurationmediumMixed2/4
glm-5-2zaimini-swe-agentpublished configurationhighMixed2/4
glm-5-2zaimini-swe-agentpublished configurationmaxMixed2/4
gpt-5-4openaimini-swe-agentpublished configurationxhighNo passes0/4
gpt-5-5openaimini-swe-agentpublished configurationlowNo passes0/4
gpt-5-5openaimini-swe-agentpublished configurationmediumNo passes0/4
gpt-5-5openaimini-swe-agentpublished configurationhighMixed1/4
gpt-5-5openaimini-swe-agentpublished configurationxhighMixed2/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationlowNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationmediumNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationhighMixed1/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationxhighMixed2/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationmaxAll passed4/4
gpt-5-6-solopenaimini-swe-agentpublished configurationlowNo passes0/4
gpt-5-6-solopenaimini-swe-agentpublished configurationmediumMixed3/4
gpt-5-6-solopenaimini-swe-agentpublished configurationhighMixed1/4
gpt-5-6-solopenaimini-swe-agentpublished configurationxhighMixed3/4
gpt-5-6-solopenaimini-swe-agentpublished configurationmaxMixed3/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationlowMixed1/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationmediumNo passes0/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationhighMixed2/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationxhighMixed3/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationmaxMixed3/4
kimi-k2-7-codeopenroutermini-swe-agentpublished configurationdefaultMixed2/4