feat(models): switch default get() model from Gemini 2.5 to Gemini 3.5 Flash - #316
Merged
Merged
Conversation
…5 Flash Gemini 2.5 (Flash, Flash-Lite, Pro) is being deprecated from the AskUI API. - Default `AskUiGeminiGetModel`, `AskUIImageQAProvider` and `GoogleImageQAProvider` to `gemini-3.5-flash` - Add `ModelName.GEMINI__3_5__FLASH` / `ASKUI__GEMINI__3_5__FLASH`; keep the 2.5 constants with a deprecation note for backwards compatibility - Update docstrings, docs and examples; drop `gemini-2.5-pro` since no 3.5 Pro is served by the proxy - Update e2e/unit tests to use 3.5 Flash and remove the gemini_pro params Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
philipph-askui
marked this pull request as ready for review
September 21, 2026 09:50
programminx-askui
approved these changes
Sep 21, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Gemini 2.5 (Flash, Flash-Lite, Pro) is being deprecated from the AskUI API. This PR swaps every 2.5 reference over to
gemini-3.5-flash.AskUiGeminiGetModel,AskUIImageQAProviderandGoogleImageQAProvidertogemini-3.5-flash. The first two are whatComputerAgent().get()uses over the AskUI API.ModelName.GEMINI__3_5__FLASHandASKUI__GEMINI__3_5__FLASH. The four 2.5 constants stay with a deprecation docstring so existing imports keep working.docs/04_using_models.md,docs/05_bring_your_own_model_provider.mdandexamples/model_providers.py.gemini-2.5-prois dropped from the docs since the proxy does not serve a 3.5 Pro (returns 404).gemini_proparametrizations are removed. VLM routing unit tests use 3.5 Flash as their Gemini id.Verification
pdm run qa:fixclean (mypy, ruff format, ruff lint).tests/unit/model_providers: 81 passed.tests/e2e/agent/test_get.pyagainst the live AskUI proxy: 26 of 28 selected tests pass, including PDF, XLSX, DOCX and response-schema cases on 3.5 Flash.test_get_with_pdf_too_large_with_default_model,test_get_with_recursive_response_schema[askui]) are pre-existing and reproduce identically onmain. They do not depend on the model id.Known issue: latency (out of scope for this PR)
Schema-constrained
get()calls ongemini-3.5-flashare bimodal upstream at Google: roughly half complete in ~3s, the rest stall for 20–50s. This reproduces through both the Vertex and OpenAI-compatible AskUI proxies, is not caused by retries or thinking, and is independent of schema shape. Plain JSON mode (noresponse_schema) is a consistent 2–4s. Measured latencies on a trivial prompt, 4 runs each:E2E get tests now take 14–32s each against a 60s per-test timeout, so they may flake in CI until this is addressed (e.g. by switching the get model to plain JSON mode with client-side Pydantic validation).
🤖 Generated with Claude Code