diff --git a/.doc/ops/short-term/2026-09-16-wave2b-nightly-promotion-receipt.md b/.doc/archive/ops/short-term/2026-09-16-wave2b-nightly-promotion-receipt.md similarity index 100% rename from .doc/ops/short-term/2026-09-16-wave2b-nightly-promotion-receipt.md rename to .doc/archive/ops/short-term/2026-09-16-wave2b-nightly-promotion-receipt.md diff --git a/.doc/ops/CURRENT.md b/.doc/ops/CURRENT.md index b61ed8df..6599a02f 100644 --- a/.doc/ops/CURRENT.md +++ b/.doc/ops/CURRENT.md @@ -7,7 +7,7 @@ 1. **Wave 2B done**:nightly PI + promotion receipt 已合入;Artifact same-image 仍 partial 2. **Wave 1 done**:PU5A race + PU3 IAM fail-closed 已合入 `dev` -3. **运维**:夜间 CI `RUN_PI_E2E=1`;promotion receipt(Wave 2B) +3. **Wave 3 候选**:Playwright 双标签 / MULTI_INTENT tier;Artifact same-image digest 晋升仍开放 ## 并行认领 @@ -101,7 +101,7 @@ | holder | phase | since | scope | queue | |--------|-------|-------|-------|-------| -| Cursor | merging | 2026-09-16T14:05Z | wave2b-nightly-promotion-receipt | - | +| - | idle | - | - | - | **phase**: `idle` | `merging` | `smoke` | `e2e` diff --git a/.doc/test-reports/2026-09-16-wave2b-nightly-promotion-receipt-test-report.md b/.doc/test-reports/2026-09-16-wave2b-nightly-promotion-receipt-test-report.md index a0fcb8a9..af8072a2 100644 --- a/.doc/test-reports/2026-09-16-wave2b-nightly-promotion-receipt-test-report.md +++ b/.doc/test-reports/2026-09-16-wave2b-nightly-promotion-receipt-test-report.md @@ -75,11 +75,22 @@ promotion-receipt-check: BLOCKED — infra_fail receipt freezes promotion (...); | N5 waiver | `dddd…` + waiver→`eeee…` PASS | `OK — audited waiver … until 2099-01-01` | PASS | | N6 missing | `bbbb…` | `BLOCKED — missing promotion receipt` | PASS | -### N7 — 本机真实 suite +### N7 — 本机真实 suite(合入后墙钟跑) -- **测试输入**:`TEST_DATABASE_URL=…/agent_wave2_pi` + `RUNNER_AUTH_TOKEN` + `./scripts/run-nightly-real-pi.sh` -- **说明**:墙钟取决于 PI;结果与日志落入 `promotion-receipts/evidence--/` 与 `.json`。若 Actions 缺 secret,workflow 同样写 `infra_fail` 并 fail(不得 skip 冒充绿)。 -- **评价判定**:以当次 receipt `verdict` 为准;本报告以 N1–N6 关闭脚本/门禁契约,真实 suite 由合入后夜间/手动 dispatch 持续执行。 +- **测试输入**:`TEST_DATABASE_URL=…/agent_wave2_pi` + `RUNNER_AUTH_TOKEN` + `./scripts/run-nightly-real-pi.sh`(commit `67d73359fd13`) +- **实际输出 (Actual Output)**(摘录): + +```text +=== RUN TestMultiIntentU8_RealPI_ConfirmGenerate_PG + ... PI run status=quality_failed want completed +--- FAIL: TestMultiIntentU8_RealPI_ConfirmGenerate_PG (352.98s) +=== RUN TestWorkflowGovernance_PiAgent_PG_FullNoneMixedChain + ✓ [1. activate] ... ✓ [2. full intake] ... ✓ [3. advance V0.1] ok +``` + +- **评价判定 (Evaluation / Verdict)**:U8 段已出现**产品侧** `quality_failed`(非 secret/runner 不可达)。整包结束后脚本应落 `product_fail` receipt 并 `exit 1`——符合「产品失败拒绝晋升、不得写成 PASS」;full/none 段仍继续跑作对照。控制台:`assets/2026-09-16-wave2b-nightly-promotion-receipt/nightly-console.txt` +- **性能与耗时**:U8 FAIL ≈ 353s;full/none 长链另行计时 +- **合入冒烟**:`go vet` PASS;洁净环境 `go test -short ./...` PASS;`/health` schema 47 ok ## 六、 自动化测试套件汇总 (Test Suite Execution) diff --git a/.doc/test-reports/assets/2026-09-16-wave2b-nightly-promotion-receipt/nightly-console-partial.txt b/.doc/test-reports/assets/2026-09-16-wave2b-nightly-promotion-receipt/nightly-console-partial.txt new file mode 100644 index 00000000..2d9241a3 --- /dev/null +++ b/.doc/test-reports/assets/2026-09-16-wave2b-nightly-promotion-receipt/nightly-console-partial.txt @@ -0,0 +1,19 @@ +==> nightly real-PI suite commit=67d73359fd13 runner=http://127.0.0.1:18865 +=== RUN TestMultiIntentU8_RealPI_ConfirmGenerate_PG +2026/09/16 14:02:33 goose: no migrations to run. current version: 47 +2026/09/16 14:02:33 goose: no migrations to run. current version: 47 +2026/09/16 14:02:33 [kb] 无法连接到 PostgreSQL 知识库 (postgres://regkb:shared_kb_secret_pass@shuimu-kb-shared:5432/regulations?sslmode=disable): failed to connect to `user=regkb database=regulations`: 198.18.0.100:5432 (shuimu-kb-shared): failed to receive message: unexpected EOF, 将降级运行在离线模式 +{"time":"2026-09-16T14:02:33.628512914Z","level":"INFO","msg":"taskrun_orphans_marked_interrupted","count":1} + multi_intent_u8_piagent_pg_test.go:228: ✓ [1. awaiting] plan_id=pln_32041689e1f4258fc8b7d492a3360198 revision=1 starts=0 +{"time":"2026-09-16T14:08:26.513003368Z","level":"INFO","msg":"taskrun_status_transition","run_id":"run_1789567353839978574","status":"quality_failed","workspace_id":"data/test/workspaces/bizdev/intake_1789567353851980348","error":""} + multi_intent_u8_piagent_pg_test.go:266: PI run status=quality_failed want completed +--- FAIL: TestMultiIntentU8_RealPI_ConfirmGenerate_PG (352.98s) +=== RUN TestWorkflowGovernance_PiAgent_PG_FullNoneMixedChain +{"time":"2026-09-16T14:08:26.524142457Z","level":"INFO","msg":"goose: no migrations to run. current version: 47"} +{"time":"2026-09-16T14:08:26.534944856Z","level":"INFO","msg":"goose: no migrations to run. current version: 47"} +{"time":"2026-09-16T14:08:26.539895189Z","level":"INFO","msg":"[kb] 无法连接到 PostgreSQL 知识库 (postgres://regkb:shared_kb_secret_pass@shuimu-kb-shared:5432/regulations?sslmode=disable): failed to connect to `user=regkb database=regulations`: 198.18.0.100:5432 (shuimu-kb-shared): failed to receive message: unexpected EOF, 将降级运行在离线模式"} +{"time":"2026-09-16T14:08:26.603109332Z","level":"INFO","msg":"taskrun_orphans_marked_interrupted","count":1} + workflow_governance_full_none_piagent_pg_test.go:147: ✓ [1. activate] instance=16 full=intake none=research(disabled until stage) + workflow_governance_full_none_piagent_pg_test.go:201: ✓ pi-agent intake doc=doc_proj6037_intake elapsed=6m31s + workflow_governance_full_none_piagent_pg_test.go:216: ✓ [2. full intake] cross-user approve complete + workflow_governance_full_none_piagent_pg_test.go:228: ✓ [3. advance V0.1] ok diff --git a/.doc/test-reports/assets/2026-09-16-wave2b-nightly-promotion-receipt/nightly-console.txt b/.doc/test-reports/assets/2026-09-16-wave2b-nightly-promotion-receipt/nightly-console.txt new file mode 100644 index 00000000..2d9241a3 --- /dev/null +++ b/.doc/test-reports/assets/2026-09-16-wave2b-nightly-promotion-receipt/nightly-console.txt @@ -0,0 +1,19 @@ +==> nightly real-PI suite commit=67d73359fd13 runner=http://127.0.0.1:18865 +=== RUN TestMultiIntentU8_RealPI_ConfirmGenerate_PG +2026/09/16 14:02:33 goose: no migrations to run. current version: 47 +2026/09/16 14:02:33 goose: no migrations to run. current version: 47 +2026/09/16 14:02:33 [kb] 无法连接到 PostgreSQL 知识库 (postgres://regkb:shared_kb_secret_pass@shuimu-kb-shared:5432/regulations?sslmode=disable): failed to connect to `user=regkb database=regulations`: 198.18.0.100:5432 (shuimu-kb-shared): failed to receive message: unexpected EOF, 将降级运行在离线模式 +{"time":"2026-09-16T14:02:33.628512914Z","level":"INFO","msg":"taskrun_orphans_marked_interrupted","count":1} + multi_intent_u8_piagent_pg_test.go:228: ✓ [1. awaiting] plan_id=pln_32041689e1f4258fc8b7d492a3360198 revision=1 starts=0 +{"time":"2026-09-16T14:08:26.513003368Z","level":"INFO","msg":"taskrun_status_transition","run_id":"run_1789567353839978574","status":"quality_failed","workspace_id":"data/test/workspaces/bizdev/intake_1789567353851980348","error":""} + multi_intent_u8_piagent_pg_test.go:266: PI run status=quality_failed want completed +--- FAIL: TestMultiIntentU8_RealPI_ConfirmGenerate_PG (352.98s) +=== RUN TestWorkflowGovernance_PiAgent_PG_FullNoneMixedChain +{"time":"2026-09-16T14:08:26.524142457Z","level":"INFO","msg":"goose: no migrations to run. current version: 47"} +{"time":"2026-09-16T14:08:26.534944856Z","level":"INFO","msg":"goose: no migrations to run. current version: 47"} +{"time":"2026-09-16T14:08:26.539895189Z","level":"INFO","msg":"[kb] 无法连接到 PostgreSQL 知识库 (postgres://regkb:shared_kb_secret_pass@shuimu-kb-shared:5432/regulations?sslmode=disable): failed to connect to `user=regkb database=regulations`: 198.18.0.100:5432 (shuimu-kb-shared): failed to receive message: unexpected EOF, 将降级运行在离线模式"} +{"time":"2026-09-16T14:08:26.603109332Z","level":"INFO","msg":"taskrun_orphans_marked_interrupted","count":1} + workflow_governance_full_none_piagent_pg_test.go:147: ✓ [1. activate] instance=16 full=intake none=research(disabled until stage) + workflow_governance_full_none_piagent_pg_test.go:201: ✓ pi-agent intake doc=doc_proj6037_intake elapsed=6m31s + workflow_governance_full_none_piagent_pg_test.go:216: ✓ [2. full intake] cross-user approve complete + workflow_governance_full_none_piagent_pg_test.go:228: ✓ [3. advance V0.1] ok diff --git a/.doc/test-reports/assets/promotion-receipts/evidence-67d73359fd13-20260916T140233Z/go-test.txt b/.doc/test-reports/assets/promotion-receipts/evidence-67d73359fd13-20260916T140233Z/go-test.txt new file mode 100644 index 00000000..adf53965 --- /dev/null +++ b/.doc/test-reports/assets/promotion-receipts/evidence-67d73359fd13-20260916T140233Z/go-test.txt @@ -0,0 +1,18 @@ +=== RUN TestMultiIntentU8_RealPI_ConfirmGenerate_PG +2026/09/16 14:02:33 goose: no migrations to run. current version: 47 +2026/09/16 14:02:33 goose: no migrations to run. current version: 47 +2026/09/16 14:02:33 [kb] 无法连接到 PostgreSQL 知识库 (postgres://regkb:shared_kb_secret_pass@shuimu-kb-shared:5432/regulations?sslmode=disable): failed to connect to `user=regkb database=regulations`: 198.18.0.100:5432 (shuimu-kb-shared): failed to receive message: unexpected EOF, 将降级运行在离线模式 +{"time":"2026-09-16T14:02:33.628512914Z","level":"INFO","msg":"taskrun_orphans_marked_interrupted","count":1} + multi_intent_u8_piagent_pg_test.go:228: ✓ [1. awaiting] plan_id=pln_32041689e1f4258fc8b7d492a3360198 revision=1 starts=0 +{"time":"2026-09-16T14:08:26.513003368Z","level":"INFO","msg":"taskrun_status_transition","run_id":"run_1789567353839978574","status":"quality_failed","workspace_id":"data/test/workspaces/bizdev/intake_1789567353851980348","error":""} + multi_intent_u8_piagent_pg_test.go:266: PI run status=quality_failed want completed +--- FAIL: TestMultiIntentU8_RealPI_ConfirmGenerate_PG (352.98s) +=== RUN TestWorkflowGovernance_PiAgent_PG_FullNoneMixedChain +{"time":"2026-09-16T14:08:26.524142457Z","level":"INFO","msg":"goose: no migrations to run. current version: 47"} +{"time":"2026-09-16T14:08:26.534944856Z","level":"INFO","msg":"goose: no migrations to run. current version: 47"} +{"time":"2026-09-16T14:08:26.539895189Z","level":"INFO","msg":"[kb] 无法连接到 PostgreSQL 知识库 (postgres://regkb:shared_kb_secret_pass@shuimu-kb-shared:5432/regulations?sslmode=disable): failed to connect to `user=regkb database=regulations`: 198.18.0.100:5432 (shuimu-kb-shared): failed to receive message: unexpected EOF, 将降级运行在离线模式"} +{"time":"2026-09-16T14:08:26.603109332Z","level":"INFO","msg":"taskrun_orphans_marked_interrupted","count":1} + workflow_governance_full_none_piagent_pg_test.go:147: ✓ [1. activate] instance=16 full=intake none=research(disabled until stage) + workflow_governance_full_none_piagent_pg_test.go:201: ✓ pi-agent intake doc=doc_proj6037_intake elapsed=6m31s + workflow_governance_full_none_piagent_pg_test.go:216: ✓ [2. full intake] cross-user approve complete + workflow_governance_full_none_piagent_pg_test.go:228: ✓ [3. advance V0.1] ok diff --git a/.doc/test-reports/assets/promotion-receipts/evidence-67d73359fd13-20260916T140233Z/health.err b/.doc/test-reports/assets/promotion-receipts/evidence-67d73359fd13-20260916T140233Z/health.err new file mode 100644 index 00000000..e69de29b diff --git a/.doc/test-reports/assets/promotion-receipts/evidence-67d73359fd13-20260916T140233Z/runner-health.json b/.doc/test-reports/assets/promotion-receipts/evidence-67d73359fd13-20260916T140233Z/runner-health.json new file mode 100644 index 00000000..1a8516d6 --- /dev/null +++ b/.doc/test-reports/assets/promotion-receipts/evidence-67d73359fd13-20260916T140233Z/runner-health.json @@ -0,0 +1,14 @@ +{ + "ok": true, + "service": "shuimu-pi-agent-runner", + "endpoint_url": "https://api.minimaxi.com/v1", + "model_id": "MiniMax-M2.7-highspeed", + "api": "openai-compatible", + "has_token": true, + "tavily": { + "active": true, + "keys_count": 2 + }, + "data_dir": "/app/data/workspaces", + "uptime": 38034.707339415 +}