Record the agent quality improvement plan and six user rulings #51

Merged
weichen merged 1 commits from feature/agent-quality-plan into main 2026-10-09 14:12:57 +00:00
Owner

摘要

智能体工作流质量改进的主记录(长期方向锚点,policy/delivery.md「长期方向与任务衔接」要求):
诊断结论、用户 2026-10-09 六项裁定、P0–P5 分期与验收口径、模型 A/B 计划。
首个增量 feature/agent-quality-phase01(P0 评测基线 + P1 缺陷修复)已在 Backend #111。

要点:

  • §1 失败链(五条,均经真实转录复核);§2 根因归纳(上下文保真 > 修改模型 > 检查可靠性 > 行为指引 > 评测缺失)
  • §3 六项裁定原文(开放工具 / 内核会话记录为权威 / MD 源码化但保留全类型生成 / 门禁降级 / 模型评测无上限 / 行为面 PR 须附真实评测)
  • §3 裁定 1 推翻 2026-09-30 预览案「fs 工具默认关闭」,以本文为准
  • INDEX 增加一行导航

Evidence

SELF — 主记录引用诊断会话、转录来源(pg1 + 旧 SQLite,62 条助手消息)与基线报告位置;
本 PR 不改代码与指针。

Impact

后续各阶段任务卡引用本主记录,不再复述规划。

## 摘要 智能体工作流质量改进的主记录(长期方向锚点,policy/delivery.md「长期方向与任务衔接」要求): 诊断结论、用户 2026-10-09 六项裁定、P0–P5 分期与验收口径、模型 A/B 计划。 首个增量 feature/agent-quality-phase01(P0 评测基线 + P1 缺陷修复)已在 Backend #111。 要点: - §1 失败链(五条,均经真实转录复核);§2 根因归纳(上下文保真 > 修改模型 > 检查可靠性 > 行为指引 > 评测缺失) - §3 六项裁定原文(开放工具 / 内核会话记录为权威 / MD 源码化但保留全类型生成 / 门禁降级 / 模型评测无上限 / 行为面 PR 须附真实评测) - §3 裁定 1 推翻 2026-09-30 预览案「fs 工具默认关闭」,以本文为准 - INDEX 增加一行导航 ## Evidence SELF — 主记录引用诊断会话、转录来源(pg1 + 旧 SQLite,62 条助手消息)与基线报告位置; 本 PR 不改代码与指针。 ## Impact 后续各阶段任务卡引用本主记录,不再复述规划。
weichen added 1 commit 2026-10-09 13:09:33 +00:00
Why: The 2026-10-09 diagnosis on real run transcripts identified the direct
conversation path's failure chain and a phased plan was approved with six
explicit user rulings (open up tools, kernel-transcript-authoritative context,
markdown-source deliverables with all file types retained, gate demotions,
uncapped stronger-model evals, real-model eval required for behavior changes).
The plan needs a durable main record per the long-term-direction policy, and
the 2026-09-30 preview proposal's "fs tools hidden by default" ruling is
superseded by ruling 1, which must be discoverable from the index.

Evidence: SELF - the record cites the diagnosis session, the transcript
sources (pg1 + legacy SQLite, 62 assistant turns) and the before-baseline
report location on the task card; no code or pointers changed in this repo.

Impact: New proposal 2026-10-09-agent-quality-improvement-plan.md plus one
index row. Subsequent phase tasks reference this record instead of restating
the plan.

Refs: Dev task feature/agent-quality-phase01; supersedes the fs-tool default
in 2026-09-30-file-preview-and-reserved-capabilities.md §2.3.
weichen merged commit 9206e0d77c into main 2026-10-09 14:12:57 +00:00
Sign in to join this conversation.
No Reviewers
No labels
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: weichen/Agent-System-Documents#51