JustEnough.
All evidence cases
DeepSWE v1.1repositoryGo

Add a checker for broken doc comment links

Add a diagnostic checker that validates doc comment symbol links against package and type information.

go-critic-doc-link-checker

Normalized profile

What this task asks for

Add a diagnostic checker that validates doc comment symbol links against package and type information. Go doc comments support symbol links using bracket notation. When these references point to symbols that don't exist, readers get broken documentation with no tooling feedback. Add a new diagnostic checker named `brokenDocLink` that validates doc comment symbol references. Use Go's `go/doc/comment` package (`comment.Parser`) to parse doc comment text and extract bracket-notation symbol links, then validate each link against the package's type information. Extend the `astwalk` package with a `DocLinkVisitor` interface and corresponding walker, following the pattern of existing visitors like `DocCommentVisitor`. References to Go builtins must not be flagged.

Intent

  • feature implementation
  • data transformation
  • test and validation

Work surfaces

  • parser
  • serialization
  • library API

Technology

  • go-critic

Expected artifacts

  • repository patch

What makes it difficult

  • native compilation and dependency integration
  • specialized algorithmic or domain reasoning
  • changes span multiple components or interfaces

Published evidence

Model × harness outcomes

Counts are tied to these exact configurations. Harnesses are not treated as equivalent across benchmarks.

Models
13
Configurations
41
Trials
164

Showing 41 of 41 configurations

ModelHarnessEffortResultPasses
claude-fable-5vertex_aimini-swe-agentpublished configurationlowMixed3/4
claude-fable-5vertex_aimini-swe-agentpublished configurationmediumMixed3/4
claude-fable-5vertex_aimini-swe-agentpublished configurationhighMixed2/4
claude-fable-5vertex_aimini-swe-agentpublished configurationxhighMixed2/4
claude-fable-5vertex_aimini-swe-agentpublished configurationmaxMixed1/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationlowMixed3/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationmediumMixed1/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationhighMixed1/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationxhighMixed1/4
claude-opus-4-8anthropicmini-swe-agentpublished configurationmaxNo passes0/4
claude-sonnet-4-6anthropicmini-swe-agentpublished configurationhighMixed3/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationlowMixed1/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationmediumMixed1/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationhighNo passes0/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationxhighNo passes0/4
claude-sonnet-5anthropicmini-swe-agentpublished configurationmaxMixed1/4
gemini-3-1-pro-previewvertex_aimini-swe-agentpublished configurationhighMixed1/4
gemini-3-5-flashvertex_aimini-swe-agentpublished configurationmediumMixed2/4
glm-5-2zaimini-swe-agentpublished configurationhighNo passes0/4
glm-5-2zaimini-swe-agentpublished configurationmaxMixed3/4
gpt-5-4openaimini-swe-agentpublished configurationxhighNo passes0/4
gpt-5-5openaimini-swe-agentpublished configurationlowAll passed4/4
gpt-5-5openaimini-swe-agentpublished configurationmediumAll passed4/4
gpt-5-5openaimini-swe-agentpublished configurationhighAll passed4/4
gpt-5-5openaimini-swe-agentpublished configurationxhighAll passed4/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationlowNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationmediumNo passes0/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationhighMixed2/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationxhighMixed3/4
gpt-5-6-lunaopenaimini-swe-agentpublished configurationmaxAll passed4/4
gpt-5-6-solopenaimini-swe-agentpublished configurationlowMixed3/4
gpt-5-6-solopenaimini-swe-agentpublished configurationmediumAll passed4/4
gpt-5-6-solopenaimini-swe-agentpublished configurationhighMixed2/4
gpt-5-6-solopenaimini-swe-agentpublished configurationxhighMixed3/4
gpt-5-6-solopenaimini-swe-agentpublished configurationmaxMixed3/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationlowNo passes0/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationmediumMixed1/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationhighAll passed4/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationxhighMixed3/4
gpt-5-6-terraopenaimini-swe-agentpublished configurationmaxAll passed4/4
kimi-k2-7-codeopenroutermini-swe-agentpublished configurationdefaultMixed1/4