Tighten work-checkpoint evidence guidance and allow one eval correction #232

Merged
weichen merged 1 commits from feature/fast-slow-o2-a01-evidence-guidance into main 2026-10-20 16:32:58 +00:00
Owner

Summary

  • Tighten publish_work_checkpoint tool Description and schema field descriptions so evidence modes have clear required/forbidden fields; material_record defaults to no evidence.
  • Adjust the material task prompt: 原样记载 uses material_record without evidence; assumptions wording scoped to analysis.
  • Evaluation allows one checkpoint correction (stop only after two rejected checkpoints; reason repeated rejected work checkpoint); add label approved-o2-a01-evidence.

Why

O2 P1 proved the route contract, but A01 stopped on the first structurally invalid evidence payload. Approved design (Dev #662) is zero-paid guidance + one eval correction.

Test plan

  • go test ./internal/runtime/ ./internal/runmgr/ ./internal/server/ -count=1
  • go test -tags live -run '^TestFollowupA01KeepsItsOwnOneShotResult$' ./eval/live/ -count=1 + go vet -tags live ./eval/live/
  • go test ./... -count=1 + go vet ./... (host, HEAD 837480d)
  • Independent code-reviewer PASS (fresh session)

Refs

  • Design: Agent-System-Dev docs/superpowers/specs/2026-10-20-fast-slow-o2-a01-evidence-design.md (#662)
  • Plan unit: o2a01e-i1-backend-evidence-guidance
## Summary - Tighten `publish_work_checkpoint` tool Description and schema field descriptions so evidence modes have clear required/forbidden fields; material_record defaults to no evidence. - Adjust the material task prompt: 原样记载 uses material_record without evidence; assumptions wording scoped to analysis. - Evaluation allows one checkpoint correction (stop only after two rejected checkpoints; reason `repeated rejected work checkpoint`); add label `approved-o2-a01-evidence`. ## Why O2 P1 proved the route contract, but A01 stopped on the first structurally invalid evidence payload. Approved design (Dev #662) is zero-paid guidance + one eval correction. ## Test plan - [x] `go test ./internal/runtime/ ./internal/runmgr/ ./internal/server/ -count=1` - [x] `go test -tags live -run '^TestFollowupA01KeepsItsOwnOneShotResult$' ./eval/live/ -count=1` + `go vet -tags live ./eval/live/` - [x] `go test ./... -count=1` + `go vet ./...` (host, HEAD 837480d) - [x] Independent code-reviewer PASS (fresh session) ## Refs - Design: Agent-System-Dev `docs/superpowers/specs/2026-10-20-fast-slow-o2-a01-evidence-design.md` (#662) - Plan unit: `o2a01e-i1-backend-evidence-guidance`
weichen added 1 commit 2026-10-20 16:30:59 +00:00
agent-exec transport fe547395130f262af6f15a09d8a4aa2d/1f4b762f53be
governance / governance (pull_request) Successful in 23s
ci / vet-and-test (pull_request) Successful in 1m26s
837480d4c1
weichen merged commit dfb31da20a into main 2026-10-20 16:32:58 +00:00
Sign in to join this conversation.
No Reviewers
No labels
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: weichen/Agent-System-Backend#232