Skip to content

Add Databricks as a provider#1706

Merged
rekram1-node merged 5 commits into
anomalyco:devfrom
rohita5l:rohit/addDatabricks
May 12, 2026
Merged

Add Databricks as a provider#1706
rekram1-node merged 5 commits into
anomalyco:devfrom
rohita5l:rohit/addDatabricks

Conversation

@rohita5l
Copy link
Copy Markdown
Contributor

@rohita5l rohita5l commented May 4, 2026

Adds Databricks as a provider, exposing their Foundation Model API pay-per-token endpoints.

What's included:

  • providers/databricks/provider.toml — provider config using the @ai-sdk/openai-compatible adapter against the AI Gateway endpoint
  • 25 model TOMLs under providers/databricks/models/, each extending the canonical upstream entry (Anthropic, OpenAI, Google, OpenRouter) rather than duplicating metadata
  • providers/databricks/scripts/generate-databricks.ts — script to regenerate model TOMLs from a live Databricks workspace by querying serving-endpoints:foundation-models and filtering for
    ai_gateway_v2_supported endpoints

Models covered: Claude (Haiku, Sonnet, Opus), GPT-5 variants, Gemini 2.5/3.x, GPT-OSS 20B/120B

To regenerate:
DATABRICKS_HOST= DATABRICKS_TOKEN= bun run providers/databricks/scripts/generate-databricks.ts

Comment thread package.json Outdated
Comment thread package.json Outdated
@rekram1-node
Copy link
Copy Markdown
Collaborator

hm i see adding deps for smoke tests

@rekram1-node
Copy link
Copy Markdown
Collaborator

I'd prefer not adding deps, does databricks return models that dont work from their models endpoints? I dont think any other providers do that...

@rohita5l rohita5l requested a review from rekram1-node May 7, 2026 02:09
@rohita5l
Copy link
Copy Markdown
Contributor Author

rohita5l commented May 8, 2026

@rekram1-node Ive simplified the PR

@rekram1-node
Copy link
Copy Markdown
Collaborator

it looks like lockfile got corrupted?

rohita5l and others added 5 commits May 11, 2026 17:53
openrouter models in subdirectories can't use extends (schema requires
provider/model format); resolve() now inlines the source TOML content directly.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
…atible models

Generate script now smoke-tests each model with streamText after writing TOMLs
and removes any that return empty responses (incompatible with @ai-sdk/openai-compatible).
Removes databricks-gemini-3-pro and databricks-gemini-3-1-pro which return content
as array with thoughtSignature that the AI SDK cannot parse.

Also adds test-databricks.ts for standalone smoke testing.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
…repo conventions

Addresses review feedback by removing AI SDK dependencies from package.json
and aligning with the Vercel/Helicone/Wandb pattern.

- Move generate-databricks.ts to packages/core/script/
- Add databricks:generate to root scripts
- Remove smoke test and runtime filtering (catalog should reflect what the
  upstream API exposes; AI SDK compatibility is a downstream concern)
- Add --dry-run and --new-only flags
- Merge with existing TOMLs instead of nuking them; warn about orphans
- Restore databricks-gemini-3-pro and databricks-gemini-3-1-pro
- Drop @ai-sdk/openai-compatible, ai, zod from root dependencies

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
…pm proxy

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@rohita5l rohita5l force-pushed the rohit/addDatabricks branch from 14c3fc3 to 914a3d9 Compare May 11, 2026 21:54
@rekram1-node rekram1-node merged commit bb08fc2 into anomalyco:dev May 12, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants