Terminal-Bench 2.1terminalPythonRStanCSVJSON
Port an RStan Gaussian process to PyStan
Translate the supplied RStan Gaussian-process analysis to PyStan 3.10.0 with equivalent model, data, hyperparameters, sampling, and posterior summaries.
rstan-to-pystan
Normalized profile
What this task asks for
Translate the supplied RStan Gaussian-process analysis to PyStan 3.10.0 with equivalent model, data, hyperparameters, sampling, and posterior summaries. Use PyStan 3.10.0 without R, RStan, cmdstanr, or cmdstanpy. Preserve the source model and sampling hyperparameters. Set random_seed=1 in stan.build. Write scalar alpha and sigma means and three-row rho and beta means as numeric CSV values.
Intent
- feature implementation
- systems setup
- data transformation
Work surfaces
- probabilistic model
- sampling pipeline
- posterior estimates
Technology
- PyStan 3.10.0
- Stan
- Gaussian processes
Expected artifacts
- /app/pystan_analysis.py
- /app/alpha_est.csv
- /app/sigma_est.csv
- /app/rho_est.csv
- /app/beta_est.csv
What makes it difficult
- strict behavioral compatibility or exact-output validation
- specialized algorithmic or domain reasoning
- cross-language or cross-format integration
- changes span multiple components or interfaces
Published evidence
Model × harness outcomes
Counts are tied to these exact configurations. Harnesses are not treated as equivalent across benchmarks.
- Models
- 13
- Configurations
- 20
- Trials
- 100
Showing 20 of 20 configurations
| Model | Harness | Effort | Result | Passes |
|---|---|---|---|---|
| claude-fable-5anthropic · 2026-06-07 | claude-code2.1.167 | xhigh | All passed | 5/5 |
| claude-fable-5anthropic · 2026-06-05 | terminus-22.0.0 | high | All passed | 5/5 |
| claude-opus-4-7anthropic · 2026-05-01 | claude-code2.1.123 | max | Mixed4 errors | 1/5 |
| claude-opus-4-7anthropic · 2026-05-01 | terminus-22.0.0 | max | Mixed1 errors | 4/5 |
| claude-opus-4-8anthropic · 2026-07-09 | claude-code2.1.205 | high | All passed | 5/5 |
| claude-sonnet-5anthropic · 2026-07-09 | claude-code2.1.205 | high | All passed | 5/5 |
| gemini-3-pro-previewgemini · 2026-05-01 | gemini-cli0.40.0 | high | All passed | 5/5 |
| gemini-3-pro-previewgemini · 2026-05-01 | terminus-22.0.0 | high | All passed | 5/5 |
| gemini-3.1-pro-previewgemini · 2026-05-05 | gemini-cli0.40.0 | high | Mixed1 errors | 4/5 |
| gemini-3.1-pro-previewgemini · 2026-05-05 | terminus-22.0.0 | high | Mixed2 errors | 3/5 |
| glm-5.1zai · 2026-05-01 | claude-code2.1.123 | max | All passed | 5/5 |
| gpt-5.5openai · 2026-05-01 | codex0.125.0 | xhigh | All passed | 5/5 |
| gpt-5.5openai · 2026-05-01 | terminus-22.0.0 | xhigh | All passed | 5/5 |
| gpt-5.6-lunaopenai · 2026-07-10 | codex0.144.0 | max | All passed | 5/5 |
| gpt-5.6-lunaopenai · 2026-07-11 | codex0.144.1 | max | All passed | 5/5 |
| gpt-5.6-solopenai · 2026-07-10 | codex0.144.0 | max | All passed | 5/5 |
| gpt-5.6-terraopenai · 2026-07-10 | codex0.144.0 | max | All passed | 5/5 |
| gpt-5.6-terraopenai · 2026-07-11 | codex0.144.1 | max | All passed | 5/5 |
| grok-4.5cursor · 2026-07-09 | cursor-cli2026.07.08-0c04a8a | default | All passed | 5/5 |
| muse-spark-1.1openai · 2026-07-09 | mini-swe-agent2.4.5 | xhigh | All passed | 5/5 |