All evidence cases
DeepSWE v1.1repositoryPython

Complete Kitty keyboard phases and stable fallback key metadata

Add full Kitty keyboard phase handling and stable fallback key metadata for keys and shortcuts.

textual-kitty-key-phases

Normalized profile

What this task asks for

Add full Kitty keyboard phase handling and stable fallback key metadata for keys and shortcuts. Extend Keys public API with exact stored fields phase, modifiers, base_key, shifted_key, and base_layout_key. Phase is "press", "repeat", or "release" defaulting to "press", and modifiers is a sorted tuple. Also expose convenience properties is_press, is_repeat, is_release, shift, alt, ctrl, super, hyper, and meta. Preserve printable semantics: shift-only printable Kitty events must preserve the shifted character and metadata, so character stays "A", modifiers reports ("shift",), and base_key stays "a". Non-shift modified printable shortcuts must keep names like "alt+shift+a" with character=None, associated-text-only key-code 0 uses its text as both key and character, and alternate metadata uses Textual names like shifted_key="plus" and alias ctrl+plus. Add examples/kitty_keyboard_protocol.py with KittyKeyboardProtocolApp, RichLog id events, guarded entrypoint, and log lines containing literal phase=<phase> and character=<repr(character)>.

  • feature implementation
  • bug repair
  • library API
  • build system
  • Textual
  • repository patch
  • strict behavioral compatibility or exact-output validation
  • specialized algorithmic or domain reasoning

Published evidence

Model × harness outcomes

Counts are tied to these exact configurations. Harnesses are not treated as equivalent across benchmarks.

Models
13
Configurations
41
Trials
164

Showing 41 of 41 configurations

ModelHarnessEffortResultPasses
claude-fable-5vertex_aimini-swe-agentpublished configurationlowMixed2/4
claude-fable-5vertex_aimini-swe-agentpublished configurationmediumMixed3/4
claude-fable-5vertex_aimini-swe-agentpublished configurationhighMixed3/4
claude-fable-5vertex_aimini-swe-agentpublished configurationxhighMixed3/4
claude-fable-5vertex_aimini-swe-agentpublished configurationmaxMixed3/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationlowNo passes0/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationmediumMixed2/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationhighMixed3/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationxhighMixed2/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationmaxMixed2/4
claude-sonnet-4-6anthropicmini-swe-agentpublished configurationhighNo passes0/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationlowMixed1/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationmediumNo passes0/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationhighMixed1/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationxhighMixed1/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationmaxNo passes0/4
gemini-3-1-pro-previewvertex_aimini-swe-agentpublished configurationhighNo passes0/4
gemini-3-5-flashvertex_aimini-swe-agentpublished configurationmediumNo passes0/4
glm-5-2zaimini-swe-agentpublished configurationhighNo passes0/4
glm-5-2zaimini-swe-agentpublished configurationmaxNo passes0/4
gpt-5-4openaimini-swe-agentpublished configurationxhighMixed2/4
gpt-5-5openaimini-swe-agentpublished configurationlowNo passes0/4
gpt-5-5openaimini-swe-agentpublished configurationmediumMixed1/4
gpt-5-5openaimini-swe-agentpublished configurationhighMixed2/4
gpt-5-5openaimini-swe-agentpublished configurationxhighMixed3/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationlowNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationmediumNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationhighNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationxhighNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationmaxNo passes0/4
gpt-5-6-solopenaimini-swe-agentpublished configurationlowMixed1/4
gpt-5-6-solopenaimini-swe-agentpublished configurationmediumMixed1/4
gpt-5-6-solopenaimini-swe-agentpublished configurationhighMixed3/4
gpt-5-6-solopenaimini-swe-agentpublished configurationxhighMixed2/4
gpt-5-6-solopenaimini-swe-agentpublished configurationmaxAll passed4/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationlowNo passes0/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationmediumNo passes0/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationhighNo passes0/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationxhighNo passes0/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationmaxMixed1/4
kimi-k2-7-codeopenroutermini-swe-agentpublished configurationdefaultNo passes0/4