All evidence cases
DeepSWE v1.1repositoryPython

Add rolling min, max, median, and quantile methods

Add the remaining rolling window methods to Expr and Series with consistent validation and backend delegation.

narwhals-rolling-window-suite

Normalized profile

What this task asks for

Add the remaining rolling window methods to Expr and Series with consistent validation and backend delegation. When `min_samples` is `None`, it defaults to `window_size`. For lazy backends, this operation requires `.over(order_by=...)`. `quantile: float` -- The quantile to compute, must be in [0, 1]. Out-of-range values raise `ValueError` with message starting with `"Quantile must be between 0.0 and 1.0"`. `interpolation: str` -- Interpolation method when the quantile lies between two data points. One of: `'linear'`, `'lower'`, `'higher'`, `'nearest'`, `'midpoint'`. Invalid values raise `ValueError` with message starting with `"Interpolation must be one of"`. DuckDB does not support `percentile_cont` as a windowed aggregate function; rolling_quantile with `.over()` is not available on DuckDB. For lazy backends (Polars, DuckDB, Dask), rolling operations must be followed by `.over()` with `order_by` specified.

  • feature implementation
  • test and validation
  • validation layer
  • library API
  • Narwhals
  • repository patch
  • specialized algorithmic or domain reasoning

Published evidence

Model × harness outcomes

Counts are tied to these exact configurations. Harnesses are not treated as equivalent across benchmarks.

Models
13
Configurations
41
Trials
164

Showing 41 of 41 configurations

ModelHarnessEffortResultPasses
claude-fable-5vertex_aimini-swe-agentpublished configurationlowAll passed4/4
claude-fable-5vertex_aimini-swe-agentpublished configurationmediumAll passed4/4
claude-fable-5vertex_aimini-swe-agentpublished configurationhighAll passed4/4
claude-fable-5vertex_aimini-swe-agentpublished configurationxhighAll passed4/4
claude-fable-5vertex_aimini-swe-agentpublished configurationmaxAll passed4/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationlowAll passed4/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationmediumAll passed4/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationhighAll passed4/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationxhighAll passed4/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationmaxAll passed4/4
claude-sonnet-4-6anthropicmini-swe-agentpublished configurationhighAll passed4/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationlowAll passed4/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationmediumAll passed4/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationhighAll passed4/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationxhighAll passed4/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationmaxAll passed4/4
gemini-3-1-pro-previewvertex_aimini-swe-agentpublished configurationhighNo passes0/4
gemini-3-5-flashvertex_aimini-swe-agentpublished configurationmediumMixed2/4
glm-5-2zaimini-swe-agentpublished configurationhighAll passed4/4
glm-5-2zaimini-swe-agentpublished configurationmaxAll passed4/4
gpt-5-4openaimini-swe-agentpublished configurationxhighAll passed4/4
gpt-5-5openaimini-swe-agentpublished configurationlowAll passed4/4
gpt-5-5openaimini-swe-agentpublished configurationmediumAll passed4/4
gpt-5-5openaimini-swe-agentpublished configurationhighAll passed4/4
gpt-5-5openaimini-swe-agentpublished configurationxhighAll passed4/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationlowNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationmediumNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationhighMixed3/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationxhighAll passed4/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationmaxMixed3/4
gpt-5-6-solopenaimini-swe-agentpublished configurationlowMixed2/4
gpt-5-6-solopenaimini-swe-agentpublished configurationmediumAll passed4/4
gpt-5-6-solopenaimini-swe-agentpublished configurationhighAll passed4/4
gpt-5-6-solopenaimini-swe-agentpublished configurationxhighAll passed4/4
gpt-5-6-solopenaimini-swe-agentpublished configurationmaxAll passed4/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationlowAll passed4/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationmediumMixed2/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationhighAll passed4/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationxhighAll passed4/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationmaxAll passed4/4
kimi-k2-7-codeopenroutermini-swe-agentpublished configurationdefaultMixed3/4