All evidence cases
Terminal-Bench 2.1terminalPython

Implement row and column tensor-parallel linear layers

Implement distributed PyTorch linear layers with correct master-weight sharding, collective-style outputs, zero bias initialization, and gradient behavior.

torch-tensor-parallelism

Normalized profile

What this task asks for

Implement distributed PyTorch linear layers with correct master-weight sharding, collective-style outputs, zero bias initialization, and gradient behavior. Export ColumnParallelLinear and RowParallelLinear with the specified constructors. Shard column weights and bias by output dimension then concatenate outputs. Shard row weights by input dimension then sum partial outputs while keeping full bias. Split the initialized master weight by rank. Support world sizes one, two, and four with correct gradients.

  • feature implementation
  • performance optimization
  • test and validation
  • distributed linear layers
  • weight shards
  • gradient computation
  • PyTorch
  • torch.distributed
  • tensor parallelism
  • /app/parallel_linear.py
  • concurrency, cancellation, or distributed-state coordination
  • changes span multiple components or interfaces

Published evidence

Model × harness outcomes

Counts are tied to these exact configurations. Harnesses are not treated as equivalent across benchmarks.

Models
13
Configurations
20
Trials
100

Showing 20 of 20 configurations

ModelHarnessEffortResultPasses
claude-fable-5anthropic · 2026-06-07claude-code2.1.167xhighAll passed5/5
claude-fable-5anthropic · 2026-06-05terminus-22.0.0highAll passed5/5
claude-opus-4-7anthropic · 2026-05-01claude-code2.1.123maxMixed4/5
claude-opus-4-7anthropic · 2026-05-01terminus-22.0.0maxMixed1 errors3/5
claude-opus-4-8anthropic · 2026-07-09claude-code2.1.205highAll passed5/5
claude-sonnet-5anthropic · 2026-07-09claude-code2.1.205highMixed4/5
gemini-3-pro-previewgemini · 2026-05-01gemini-cli0.40.0highAll passed5/5
gemini-3-pro-previewgemini · 2026-05-01terminus-22.0.0highAll passed5/5
gemini-3.1-pro-previewgemini · 2026-05-05gemini-cli0.40.0highAll passed5/5
gemini-3.1-pro-previewgemini · 2026-05-05terminus-22.0.0highMixed1 errors4/5
glm-5.1zai · 2026-05-01claude-code2.1.123maxAll passed5/5
gpt-5.5openai · 2026-05-01codex0.125.0xhighMixed4/5
gpt-5.5openai · 2026-05-01terminus-22.0.0xhighAll passed5/5
gpt-5.6-lunaopenai · 2026-07-10codex0.144.0maxMixed2 disqualified1/5
gpt-5.6-lunaopenai · 2026-07-11codex0.144.1maxNo passes0/5
gpt-5.6-solopenai · 2026-07-10codex0.144.0maxMixed1 disqualified4/5
gpt-5.6-terraopenai · 2026-07-10codex0.144.0maxMixed2 disqualified2/5
gpt-5.6-terraopenai · 2026-07-11codex0.144.1maxMixed4/5
grok-4.5cursor · 2026-07-09cursor-cli2026.07.08-0c04a8adefaultMixed4/5
muse-spark-1.1openai · 2026-07-09mini-swe-agent2.4.5xhighMixed1/5