Send current-turn images and keep vision fallbacks capable #203

Merged
weichen merged 3 commits from feature/four-model-vision into main 2026-10-15 06:38:06 +00:00
Owner

Summary

Send the current turn's images to the gateway and keep vision fallbacks on models that are declared capable.

The branch also contains the backend main pin 80bb123 so the parent sync can point at one commit.

Test plan

  • vision, runtime, ingest, ctxasm, and profile tests are in the parent make test SELF on the same product tree
  • backend CI vet-and-test on this head
## Summary Send the current turn's images to the gateway and keep vision fallbacks on models that are declared capable. The branch also contains the backend main pin 80bb123 so the parent sync can point at one commit. ## Test plan - [x] vision, runtime, ingest, ctxasm, and profile tests are in the parent `make test` SELF on the same product tree - [ ] backend CI `vet-and-test` on this head
weichen added 2 commits 2026-10-15 06:22:05 +00:00
Why: Uploaded images never reached the model, so a text-only chat model could be asked to read a picture it cannot see.

Evidence: go test ./internal/... passed locally before this commit. Image-link rejection is covered by vision package tests.

Impact: Current-turn attachments and fetched image links become image input. History keeps a text placeholder. Image turns swap to the configured vision model when the chat model is not in the capable list, and fallbacks are filtered the same way.

Refs: Agent-System-Dev feature/four-model-vision
Co-authored-by: Cursor <cursoragent@cursor.com>
Merge backend main into the vision branch
ci / vet-and-test (pull_request) Successful in 1m24s
6532fad4d5
Why: the parent sync needs a backend commit that contains both vision routing and the current main pin.
Evidence: incoming pin 80bb123 is an ancestor of origin/main; merge keeps cfde38d.
Impact: backend gitlink can record one resolved commit.
Refs: feature/four-model-vision
weichen added 1 commit 2026-10-15 06:35:45 +00:00
Merge backend main into the vision branch
ci / vet-and-test (pull_request) Successful in 1m0s
629c2502ad
Why: the backend pull request cannot merge while its head is behind main.
Evidence: origin/main 9fd0793 is one commit ahead of the pin already contained in 6532fad.
Impact: the parent gitlink stays on 6532fad, which remains reachable.
Refs: #203
weichen merged commit 021295a188 into main 2026-10-15 06:38:06 +00:00
Sign in to join this conversation.
No Reviewers
No labels
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: weichen/Agent-System-Backend#203