Quality phase01: gate repairs, live eval baseline, policy clause (Backend #111, Documents #51) #277

Merged
weichen merged 11 commits from feature/agent-quality-phase01 into main 2026-10-09 14:13:07 +00:00
11 Commits
Author SHA1 Message Date
weichen 80b76e0c68 Record the after-phase01 live eval and the before/after verdict
ci / test (pull_request) Successful in 3m36s
Why: Ruling 6 requires real-model before/after evidence. The after run (fixed
build b68833f, same golden tasks) proves the repairs landed: lint now actually
executes (real layout/lead findings appear vs silent empties before), the
pm-tool readability dead-loop is gone (4/0 -> 0), plan-followup reads original
materials 0 -> 49 times. Remaining failures are the documented P5/P2 scope
(rename-revision loops via scorer semantics, unverified numbers, verifier
parse hiccups), not regressions.

Evidence: SELF - report .task/phase01-eval/after-phase01-b68833f.json +
evidence row (1749s run); comparison table in the card.

Impact: PR #277 now carries the complete before/after pair for review.
2026-10-09 14:04:05 +00:00
weichen e0fc10d829 Fill the phase01 result summary and remaining items
ci / test (pull_request) Successful in 3m51s
2026-10-09 13:29:55 +00:00
weichen 3cbe5dcd3c Record the live-eval evidence row for the before baseline 2026-10-09 13:29:18 +00:00
weichen 61ec1c3b81 Import the make-test evidence receipt for phase01 2026-10-09 13:08:04 +00:00
weichen f6da1d67e5 Record the sync checkpoint
Why: bind the task validation checkpoint to the latest integration baseline.

Evidence: SELF recursive component checks; sync_base=1ebd46edc5239d0d87418e9a8dd9aa225955e1dd; candidate=3d9285c1f332d01f48329549359c5c7d231679d8.

Impact: task metadata only.

Refs: .task/feature-agent-quality-phase01.md
2026-10-09 13:05:05 +00:00
weichen 3d9285c1f3 Pin the phase01 heads and record the before-baseline report
Why: The backend branch gained the user-scope model capture fix, and the
live eval produced the before-baseline report on remote main (1ebd46e) that
the task card and the improvement-plan record reference as evidence.

Evidence: SELF - report .task/phase01-eval/before-main-1ebd46e.json (model
MiniMax-M2.7-highspeed, 4 golden tasks, 17 min run): reproduces the diagnosed
failure chain on the pre-fix build - readability dead-loop x4 on two tasks,
9 full regens with 0 original-material reads in plan-followup, 8 unverified
percentages, forged-marker false positive, internal check text leaked to the
user.

Impact: Report committed for the after-comparison once this PR merges; gitlink
points at the harness-inclusive backend head.
2026-10-09 13:04:38 +00:00
weichen bfe77d3505 Repoint the backend gitlink at the lint-wiring fix head
Why: The lint skills-root injection moved from the app root to the runner,
keeping the architecture ratchet green; the Dev combination must test that head.

Evidence: SELF - gitlink equals backend feature/agent-quality-phase01 head;
make test rerun recorded on the task card.

Impact: Pointer only.
2026-10-09 12:55:58 +00:00
weichen 7e6d1695af Repoint the backend gitlink at the harness-inclusive head
Why: The previous pointer predated the eval/live package commit; the
combination must test the full phase01 backend branch.

Evidence: SELF - gitlink equals backend feature/agent-quality-phase01 head.

Impact: Pointer only.
2026-10-09 12:49:49 +00:00
weichen fa3221b46a Point backend and documents at the phase01 heads
Why: Backend carries the seven quality-gate repairs with the eval/live
harness; documents carries the improvement-plan main record with the six user
rulings. The Dev combination must test these heads together.

Evidence: SELF - gitlink pointers match the pushed branch heads; make test
recorded on the task card after this commit.

Impact: Combined test surface now includes the phase01 backend and documents
content; no behavior change from the pointers alone.

Refs: feature/agent-quality-phase01 (backend), feature/agent-quality-plan (documents).
2026-10-09 12:44:58 +00:00
weichen 7d4d3352b5 Require real-model eval evidence for agent behavior changes
Why: The 2026-10-09 diagnosis showed behavior-surface regressions (gate
deadlocks, silently broken lint, wrong artifact verdicts) passing every unit
test because no task-level check ran the real model. User ruling 6 approved
making before/after live-eval evidence a delivery requirement for prompt,
skill, tool-description, context-assembly and gate changes.

Evidence: SELF - clause drafted to reference modules/backend/eval/live and the
GATE/REPLAY/SELF sourcing already defined in AGENTS.md; task card for
feature/agent-quality-phase01 filled with the P0+P1 scope and requirements.

Impact: policy/delivery.md gains the 智能体行为面的真实验证 subsection;
NOT_RUN stays legal but must be explicit. Phase01 task card records scope,
requirements R1-R4 and the before/after eval protocol.

Refs: modules/documents proposal 2026-10-09-agent-quality-improvement-plan.md (ruling 6).
2026-10-09 12:44:58 +00:00
weichen 9f2188bf37 Record the task card for feature-agent-quality-phase01
Why: establish the authorized task workspace and its initial baseline.

Evidence: preserved precheck receipt in .task/feature-agent-quality-phase01.md; R0=1ebd46edc5239d0d87418e9a8dd9aa225955e1dd.

Impact: task metadata only; the feature workspace starts at 1ebd46edc5.

Refs: .task/feature-agent-quality-phase01.md
2026-10-09 12:21:16 +00:00