Add task snapshots, inspection, and diffing to aiomonitor
Add point-in-time task snapshots with interactive inspection, diffing, deletion, and web/CLI access.
aiomonitor-task-snapshots-diff
Normalized profile
What this task asks for
Add point-in-time task snapshots with interactive inspection, diffing, deletion, and web/CLI access. Add snapshots to Monitor freezing running and terminated task state. IDs auto-increment from 1 with optional name. Monitor/start_monitor accept max_snapshots (default 10), evicting oldest unnamed first, preserving named. Add snapshot CLI group using the existing command dispatch loop and completion signaling, with error feedback on invalid IDs: save(--name, echoed in output), list(ls), show, where, diff, delete, plus web endpoints and /snapshots nav page. Web API JSON at /api/snapshot/: save(POST, returns {id}), list(GET, returns {snapshots}), tasks(POST snapshot_id, returns {tasks}), trace(POST snapshot_id + task_id), diff(POST snapshot_id_1 + snapshot_id_2, returns {added, removed, common}). Delete: DELETE /api/snapshot (query snapshot_id), 404/400 when missing.
Intent
- feature implementation
- configuration tuning
- data transformation
- bug repair
Work surfaces
- CLI
- HTTP API
- query layer
- serialization
- library API
Technology
- aiomonitor
- JSON
Expected artifacts
- repository patch
What makes it difficult
- strict behavioral compatibility or exact-output validation
- changes span multiple components or interfaces
Published evidence
Model × harness outcomes
Counts are tied to these exact configurations. Harnesses are not treated as equivalent across benchmarks.
- Models
- 13
- Configurations
- 41
- Trials
- 163
Showing 41 of 41 configurations
| Model | Harness | Effort | Result | Passes |
|---|---|---|---|---|
| claude-fable-5vertex_ai | mini-swe-agentpublished configuration | low | Mixed | 2/4 |
| claude-fable-5vertex_ai | mini-swe-agentpublished configuration | medium | All passed | 4/4 |
| claude-fable-5vertex_ai | mini-swe-agentpublished configuration | high | All passed | 4/4 |
| claude-fable-5vertex_ai | mini-swe-agentpublished configuration | xhigh | All passed | 4/4 |
| claude-fable-5vertex_ai | mini-swe-agentpublished configuration | max | All passed | 4/4 |
| claude-opus-4-8anthropic | mini-swe-agentpublished configuration | low | All passed | 4/4 |
| claude-opus-4-8anthropic | mini-swe-agentpublished configuration | medium | All passed | 4/4 |
| claude-opus-4-8anthropic | mini-swe-agentpublished configuration | high | All passed | 4/4 |
| claude-opus-4-8anthropic | mini-swe-agentpublished configuration | xhigh | All passed | 4/4 |
| claude-opus-4-8anthropic | mini-swe-agentpublished configuration | max | Mixed | 3/4 |
| claude-sonnet-4-6anthropic | mini-swe-agentpublished configuration | high | No passes | 0/4 |
| claude-sonnet-5anthropic | mini-swe-agentpublished configuration | low | All passed | 4/4 |
| claude-sonnet-5anthropic | mini-swe-agentpublished configuration | medium | Mixed | 2/4 |
| claude-sonnet-5anthropic | mini-swe-agentpublished configuration | high | All passed | 4/4 |
| claude-sonnet-5anthropic | mini-swe-agentpublished configuration | xhigh | All passed | 4/4 |
| claude-sonnet-5anthropic | mini-swe-agentpublished configuration | max | All passed | 4/4 |
| gemini-3-1-pro-previewvertex_ai | mini-swe-agentpublished configuration | high | No passes | 0/4 |
| gemini-3-5-flashvertex_ai | mini-swe-agentpublished configuration | medium | Mixed | 3/4 |
| glm-5-2zai | mini-swe-agentpublished configuration | high | No passes | 0/4 |
| glm-5-2zai | mini-swe-agentpublished configuration | max | Mixed | 1/4 |
| gpt-5-4openai | mini-swe-agentpublished configuration | xhigh | Mixed | 3/4 |
| gpt-5-5openai | mini-swe-agentpublished configuration | low | No passes | 0/4 |
| gpt-5-5openai | mini-swe-agentpublished configuration | medium | Mixed | 2/4 |
| gpt-5-5openai | mini-swe-agentpublished configuration | high | All passed | 4/4 |
| gpt-5-5openai | mini-swe-agentpublished configuration | xhigh | All passed | 4/4 |
| gpt-5-6-lunaopenai | mini-swe-agentpublished configuration | low | No passes | 0/4 |
| gpt-5-6-lunaopenai | mini-swe-agentpublished configuration | medium | No passes | 0/4 |
| gpt-5-6-lunaopenai | mini-swe-agentpublished configuration | high | Mixed | 2/4 |
| gpt-5-6-lunaopenai | mini-swe-agentpublished configuration | xhigh | Mixed | 3/4 |
| gpt-5-6-lunaopenai | mini-swe-agentpublished configuration | max | Mixed | 3/4 |
| gpt-5-6-solopenai | mini-swe-agentpublished configuration | low | Mixed | 2/4 |
| gpt-5-6-solopenai | mini-swe-agentpublished configuration | medium | Mixed | 1/4 |
| gpt-5-6-solopenai | mini-swe-agentpublished configuration | high | All passed | 4/4 |
| gpt-5-6-solopenai | mini-swe-agentpublished configuration | xhigh | Mixed | 2/4 |
| gpt-5-6-solopenai | mini-swe-agentpublished configuration | max | All passed | 4/4 |
| gpt-5-6-terraopenai | mini-swe-agentpublished configuration | low | No passes | 0/4 |
| gpt-5-6-terraopenai | mini-swe-agentpublished configuration | medium | No passes | 0/3 |
| gpt-5-6-terraopenai | mini-swe-agentpublished configuration | high | Mixed | 1/4 |
| gpt-5-6-terraopenai | mini-swe-agentpublished configuration | xhigh | Mixed | 2/4 |
| gpt-5-6-terraopenai | mini-swe-agentpublished configuration | max | Mixed | 3/4 |
| kimi-k2-7-codeopenrouter | mini-swe-agentpublished configuration | default | All passed | 4/4 |