All evidence cases
DeepSWE v1.1repositoryGo

Add transparent encryption to dump uploads

Encrypt database dumps before upload and add keyed config, loading, and decryptable streaming support.

onedump-dump-encryption-pipeline

Normalized profile

What this task asks for

Encrypt database dumps before upload and add keyed config, loading, and decryptable streaming support. NewEncryptor(key []byte) (*Encryptor, error) rejects non-32-byte keys (error wraps ErrInvalidKey). Must return error containing "invalid header" for wrong magic, "unsupported version" for a version other than 0x01, "integrity" if HMAC fails. Truncated data must error. Validate() method on Config: rejects empty/unsupported key source when enabled. Each source requires its own specific fields and must reject fields belonging to other sources (error must contain "mutually exclusive"). Salt at least 16 bytes, empty passphrase rejected.

  • feature implementation
  • security remediation
  • configuration tuning
  • data transformation
  • configuration
  • network service
  • validation layer
  • library API
  • onedump
  • repository patch
  • security-sensitive or adversarial behavior
  • quantitative performance, accuracy, or resource constraints
  • changes span multiple components or interfaces

Published evidence

Model × harness outcomes

Counts are tied to these exact configurations. Harnesses are not treated as equivalent across benchmarks.

Models
13
Configurations
41
Trials
164

Showing 41 of 41 configurations

ModelHarnessEffortResultPasses
claude-fable-5vertex_aimini-swe-agentpublished configurationlowAll passed4/4
claude-fable-5vertex_aimini-swe-agentpublished configurationmediumMixed3/4
claude-fable-5vertex_aimini-swe-agentpublished configurationhighMixed1/4
claude-fable-5vertex_aimini-swe-agentpublished configurationxhighNo passes0/4
claude-fable-5vertex_aimini-swe-agentpublished configurationmaxNo passes0/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationlowMixed1/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationmediumMixed2/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationhighMixed3/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationxhighAll passed4/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationmaxMixed2/4
claude-sonnet-4-6anthropicmini-swe-agentpublished configurationhighMixed2/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationlowMixed1/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationmediumMixed2/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationhighMixed1/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationxhighMixed1/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationmaxMixed2/4
gemini-3-1-pro-previewvertex_aimini-swe-agentpublished configurationhighNo passes0/4
gemini-3-5-flashvertex_aimini-swe-agentpublished configurationmediumMixed2/4
glm-5-2zaimini-swe-agentpublished configurationhighMixed2/4
glm-5-2zaimini-swe-agentpublished configurationmaxMixed1/4
gpt-5-4openaimini-swe-agentpublished configurationxhighNo passes0/4
gpt-5-5openaimini-swe-agentpublished configurationlowMixed1/4
gpt-5-5openaimini-swe-agentpublished configurationmediumNo passes0/4
gpt-5-5openaimini-swe-agentpublished configurationhighMixed1/4
gpt-5-5openaimini-swe-agentpublished configurationxhighNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationlowNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationmediumNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationhighNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationxhighNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationmaxMixed2/4
gpt-5-6-solopenaimini-swe-agentpublished configurationlowNo passes0/4
gpt-5-6-solopenaimini-swe-agentpublished configurationmediumNo passes0/4
gpt-5-6-solopenaimini-swe-agentpublished configurationhighNo passes0/4
gpt-5-6-solopenaimini-swe-agentpublished configurationxhighNo passes0/4
gpt-5-6-solopenaimini-swe-agentpublished configurationmaxMixed2/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationlowNo passes0/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationmediumNo passes0/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationhighMixed1/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationxhighMixed1/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationmaxMixed1/4
kimi-k2-7-codeopenroutermini-swe-agentpublished configurationdefaultMixed1/4