Persist the fitted feature schema across evaluate, predict, serve, and export
Persist and reuse the fitted feature schema so evaluation, prediction, serving, and export all apply the same canonicalized inputs.
igel-persist-feature-schema
Normalized profile
What this task asks for
Persist and reuse the fitted feature schema so evaluation, prediction, serving, and export all apply the same canonicalized inputs. When fit runs with dataset.features configured, the selected raw feature schema is not persisted. After fit, write feature_schema.joblib in the results directory and record feature_schema_path, input_features, dropped_features, and duplicate_feature_aliases in description.json. These rules must hold for single-target, multi-target, and clustering models. Extra raw columns must be ignored. Missing required selected features must raise an error naming them. If multiple duplicate sources are supplied they must agree row-wise for every row or raise an error naming the conflicting columns.
Intent
- feature implementation
- configuration tuning
- test and validation
Work surfaces
- validation layer
Technology
- igel
- JSON
- HTTP
Expected artifacts
- repository patch
What makes it difficult
- consistent behavior across lifecycle stages or execution modes
Published evidence
Model × harness outcomes
Counts are tied to these exact configurations. Harnesses are not treated as equivalent across benchmarks.
- Models
- 13
- Configurations
- 41
- Trials
- 164
Showing 41 of 41 configurations
| Model | Harness | Effort | Result | Passes |
|---|---|---|---|---|
| claude-fable-5vertex_ai | mini-swe-agentpublished configuration | low | Mixed | 2/4 |
| claude-fable-5vertex_ai | mini-swe-agentpublished configuration | medium | Mixed | 3/4 |
| claude-fable-5vertex_ai | mini-swe-agentpublished configuration | high | Mixed | 3/4 |
| claude-fable-5vertex_ai | mini-swe-agentpublished configuration | xhigh | All passed | 4/4 |
| claude-fable-5vertex_ai | mini-swe-agentpublished configuration | max | Mixed | 3/4 |
| claude-opus-4-8anthropic | mini-swe-agentpublished configuration | low | Mixed | 1/4 |
| claude-opus-4-8anthropic | mini-swe-agentpublished configuration | medium | Mixed | 3/4 |
| claude-opus-4-8anthropic | mini-swe-agentpublished configuration | high | All passed | 4/4 |
| claude-opus-4-8anthropic | mini-swe-agentpublished configuration | xhigh | Mixed | 1/4 |
| claude-opus-4-8anthropic | mini-swe-agentpublished configuration | max | All passed | 4/4 |
| claude-sonnet-4-6anthropic | mini-swe-agentpublished configuration | high | No passes | 0/4 |
| claude-sonnet-5anthropic | mini-swe-agentpublished configuration | low | All passed | 4/4 |
| claude-sonnet-5anthropic | mini-swe-agentpublished configuration | medium | All passed | 4/4 |
| claude-sonnet-5anthropic | mini-swe-agentpublished configuration | high | All passed | 4/4 |
| claude-sonnet-5anthropic | mini-swe-agentpublished configuration | xhigh | Mixed | 3/4 |
| claude-sonnet-5anthropic | mini-swe-agentpublished configuration | max | All passed | 4/4 |
| gemini-3-1-pro-previewvertex_ai | mini-swe-agentpublished configuration | high | No passes | 0/4 |
| gemini-3-5-flashvertex_ai | mini-swe-agentpublished configuration | medium | Mixed | 3/4 |
| glm-5-2zai | mini-swe-agentpublished configuration | high | All passed | 4/4 |
| glm-5-2zai | mini-swe-agentpublished configuration | max | Mixed | 3/4 |
| gpt-5-4openai | mini-swe-agentpublished configuration | xhigh | Mixed | 2/4 |
| gpt-5-5openai | mini-swe-agentpublished configuration | low | Mixed | 1/4 |
| gpt-5-5openai | mini-swe-agentpublished configuration | medium | No passes | 0/4 |
| gpt-5-5openai | mini-swe-agentpublished configuration | high | Mixed | 2/4 |
| gpt-5-5openai | mini-swe-agentpublished configuration | xhigh | No passes | 0/4 |
| gpt-5-6-lunaopenai | mini-swe-agentpublished configuration | low | No passes | 0/4 |
| gpt-5-6-lunaopenai | mini-swe-agentpublished configuration | medium | Mixed | 1/4 |
| gpt-5-6-lunaopenai | mini-swe-agentpublished configuration | high | Mixed | 1/4 |
| gpt-5-6-lunaopenai | mini-swe-agentpublished configuration | xhigh | No passes | 0/4 |
| gpt-5-6-lunaopenai | mini-swe-agentpublished configuration | max | Mixed | 1/4 |
| gpt-5-6-solopenai | mini-swe-agentpublished configuration | low | Mixed | 1/4 |
| gpt-5-6-solopenai | mini-swe-agentpublished configuration | medium | Mixed | 3/4 |
| gpt-5-6-solopenai | mini-swe-agentpublished configuration | high | Mixed | 2/4 |
| gpt-5-6-solopenai | mini-swe-agentpublished configuration | xhigh | Mixed | 2/4 |
| gpt-5-6-solopenai | mini-swe-agentpublished configuration | max | No passes | 0/4 |
| gpt-5-6-terraopenai | mini-swe-agentpublished configuration | low | Mixed | 2/4 |
| gpt-5-6-terraopenai | mini-swe-agentpublished configuration | medium | Mixed | 2/4 |
| gpt-5-6-terraopenai | mini-swe-agentpublished configuration | high | Mixed | 3/4 |
| gpt-5-6-terraopenai | mini-swe-agentpublished configuration | xhigh | No passes | 0/4 |
| gpt-5-6-terraopenai | mini-swe-agentpublished configuration | max | No passes | 0/4 |
| kimi-k2-7-codeopenrouter | mini-swe-agentpublished configuration | default | No passes | 0/4 |