Retry model streams only before the first delta #11

Merged

weichen merged 1 commits from feature/llm-robustness into main

2026-10-03 15:56:15 +00:00

Author	SHA1	Message	Date
weichenandCursor	9f5751c205	Retry model streams only before the first delta ci / vet-and-test (pull_request) Successful in 47s Details ci / docker-checkout-hostgateway (pull_request) Successful in 1s Details Why: Buffering a whole attempt hid live output, overflow detection missed common provider errors, and a cut-off tool call could still run. Evidence: GOWORK=off go test -race -count=1 ./runtime/llm/ ./runtime/ passed. Impact: WithRetry forwards events immediately and retries only when nothing has been forwarded. Length or an unclean end drops unfinished tool calls. Loop usage keeps a billing sum and the last request separately. Refs: feature/llm-robustness Co-authored-by: Cursor <cursoragent@cursor.com>	2026-10-03 15:52:08 +00:00

Author

SHA1

Message

Date

weichenandCursor

9f5751c205

Retry model streams only before the first delta

ci / vet-and-test (pull_request) Successful in 47s

Details

ci / docker-checkout-hostgateway (pull_request) Successful in 1s

Details

Why: Buffering a whole attempt hid live output, overflow detection missed common provider errors, and a cut-off tool call could still run.
Evidence: GOWORK=off go test -race -count=1 ./runtime/llm/ ./runtime/ passed.
Impact: WithRetry forwards events immediately and retries only when nothing has been forwarded. Length or an unclean end drops unfinished tool calls. Loop usage keeps a billing sum and the last request separately.
Refs: feature/llm-robustness
Co-authored-by: Cursor <cursoragent@cursor.com>

2026-10-03 15:52:08 +00:00