Databricks Unity AI Gateway: Complete 2026 Guide

Datapao
Datapao
14 Aug 2026 · 19 min read


Databricks Unity AI Gateway is the governance layer that lets enterprises control cost, security, and model choice across the AI models, agents, MCP services, and skills they govern through Unity Catalog, from a single control plane. It became generally available on August 4, 2026, after being announced in expanded form at Data + AI Summit 2026.

At DATAPAO, we help enterprises turn the Databricks platform into a governed, production-grade foundation for data and AI.
This guide reflects the generally available Unity AI Gateway announced August 4, including the latest cost controls, agent governance, service policies and Smart Routing capabilities.

TL;DR – Quick answers for busy readers

  • What is it? A unified governance and routing layer for enterprise AI, built on Unity Catalog. It governs the runtime interactions between models, agents, MCP services, skills, and tools, not just who can access them.
  • Why now? AI spend is consumption-based and grows unpredictably, agents touch sensitive data and take real actions, and teams want freedom to use the newest models. Unity AI Gateway addresses all three pressures: cost, control, and choice.
  • What can it do? Track and attribute AI spend, set budgets and block usage at spend thresholds, apply rate limits, route requests intelligently across models, enforce runtime guardrails (PII, prompt injection, jailbreaks), and capture requests and responses in governed inference tables for audit.
  • How do you use it to control spend? Databricks frames it as See it → Show it → Act on it: make AI spend visible, put it in front of the people creating it, then act with budgets, Smart Routing, and contextual policies.
  • Who is it for? Any organization running AI across multiple providers, coding agents, or custom agents that needs consistent governance without vendor lock-in.
  • How mature is it? Unity AI Gateway is generally available as of August 4, 2026, though some capabilities (including Smart Routing, service policies (Contextual Service Policies), and agent services) remain in Beta, and certain managed MCP integrations are still rolling out. Databricks reports over a quadrillion tokens passed through the gateway in the year before GA, with customers including Rivian, Asana, and Edmunds.

What Is Databricks Unity AI Gateway and What Does It Do?

Unity AI Gateway is Databricks’ governance solution for enterprise AI. Built on Unity Catalog, it extends governance beyond your data and static AI assets to the runtime interactions between models, agents, MCP (Model Context Protocol) servers, skills, and tools (Databricks, June 2026).

The distinction matters. Traditional governance answers the question “who can access this model or tool?” Unity AI Gateway also answers “what is this agent allowed to do in this specific interaction?”, because as agents become more autonomous, action-level control becomes the real risk surface. Databricks has described agents as some of the most privileged actors in an enterprise, which is why governance increasingly has to operate at the action level.

The product originally shipped as “AI Gateway” and was folded into Unity Catalog as Unity AI Gateway, extending Unity Catalog’s permissions, lineage, and audit model to agentic AI (Databricks).

The 3 Enterprise AI Problems Unity AI Gateway Solves: Cost, Control, and Choice

Databricks frames the enterprise AI challenge around three tensions, and Unity AI Gateway is built to resolve all three:

  1. Cost – unsustainable, unpredictable spend. Consumption-based (per-token) pricing means costs scale with usage, not seats, and most AI tools lack native cost controls or a single view of the bill.
  2. Control – security and IP risk. Effective agents need access to sensitive data. That creates exposure through prompt injection, data exfiltration, and ungoverned copies of data in memory and retention systems.
  3. Choice – vendor lock-in. A new frontier model or agent harness appears almost every month. Organizations want developer freedom without rebuilding governance each time.
Databricks Unity AI Gateway GA

Source: Databricks

See It, Show It, Act on It: The Databricks Framework for Governing AI Spend

When Databricks explains how to actually get AI spend under control, it uses a simple three-step arc: See it → Show it → Act on it. It is the narrative spine that ties the gateway’s capabilities together, and it doubles as a practical maturity model — you cannot skip steps. Databricks applies the same arc to its own internal usage (“Databricks on Databricks”), which is the clearest way to see what each step means in practice.

1. See it: get visibility you didn’t have before. You cannot govern what you cannot see. The first step is simply making AI activity and spend visible across every model, provider, team, and tool, through Unity AI Gateway’s usage tracking, cost attribution, and end-to-end tracing. In Databricks’ own rollout, this visibility surfaced two surprises: many engineers weren’t using coding agents at all (and nudging them helped), and once adoption climbed, spend exploded. Neither fact was knowable before the gateway aggregated the data into one system of record. This is the “unified enterprise AI registry”, measure and monitor first.

2. Show it: put the numbers in front of the people who create them. Visibility at the admin level isn’t enough; the people generating the spend need to see it too. Databricks pushed each engineer’s cost directly into their terminal (a simple line like “This session cost us $15.50”) so the cost of an agent session became immediate and personal rather than an abstract number on a finance dashboard a month later. At the organizational level, the same idea shows up as real-time budgets and cost dashboards (with Genie-powered natural-language analysis) that surface consumption metrics directly to teams. The goal is behavioral: costs that are visible at the moment of use get managed; costs buried in a quarterly report do not.

3. Act on it: turn the data into automated control. Once you can see and show the spend, you act on it. In Databricks’ internal case this meant benchmarking agent/harness configurations against real pull requests, changing default configs, adopting a meta-harness (Omnigent) to route work intelligently, and giving engineers self-service tools to set their own budgets. At the product level, “Act on it” is where the runtime controls live: budgets and rate limits, Smart Routing that automatically sends each request to the most cost-appropriate model, and (through Unity AI Gateway together with Omnigent) contextual policies that transform live session data into real-time allow/deny decisions (for example, allowing an agent to publish public information to a website while denying the same action for customer data).

A concrete illustration of “Act on it” in motion: Smart Routing inspects each request and picks the model to match. A casual “tell me a joke” is classed as a simple task and routed to the cheapest capable model (in Databricks’ demo, system.ai.glm-5-2); a request to build a transpiler (multi-file architecture, AST manipulation, type inference) is classed as complex and routed to the most capable model (gpt-5-6-sol). Same governance, very different cost per task, no developer having to choose.

Datapao’s take: The order is the point. Teams often want to jump straight to “Act on it” – hard budgets and blocking policies, but controls imposed without visibility breed resentment and workarounds. Start with See it (turn on observability), earn trust with Show it (make spend transparent to the people creating it), and only then move to Act on it (automated budgets, routing, and policies). We sequence every Databricks AI-governance engagement this way.

Source: Databricks webinar – Govern AI spend at scale

Unity AI Gateway vs. Unity Catalog: How They Differ and Why Both Exist

This is the most common point of confusion, so it deserves a direct answer: Unity Catalog and Unity AI Gateway are two layers of the same governance system, not competitors or duplicates. Unity AI Gateway is built on Unity Catalog and depends on it.

Here is the cleanest way to hold the distinction:

  • Unity Catalog governs the nouns – the assets. It is the system of record for identity, permissions, lineage, and audit across data (tables, volumes) and now AI assets (models, agents, MCP services, skills). It answers “what exists, who owns it, and who is allowed to access it?” Its permissions are not merely declared once and forgotten; they are enforced every time a securable is actually accessed. Unity Catalog is the governance foundation.
  • Unity AI Gateway governs the verbs – the interactions. It sits in the live request path and enforces AI-specific controls while a request is being served: routing, rate limits, spend caps, content guardrails, and action-level approvals. It answers “what is actually happening in this request right now, and should it be allowed to proceed?” Unity AI Gateway is the AI traffic and control plane on top of that foundation. (Note: service policies themselves are built on Unity Catalog’s policy framework; the two layers are deeply intertwined, not separate systems.)
DimensionUnity CatalogUnity AI Gateway
Primary roleCatalog + permission model for assetsRuntime enforcement + routing for interactions
GovernsData and AI assets (the nouns)AI interactions (the verbs)
Core question“Who can access this?”“What can happen in this request?”
When it actsWhenever a securable is accessed (privileges enforced at access time)In the live request path, per AI request
What it doesDefines and enforces identity, privileges, lineage, and governance for securable assetsControls and observes model/MCP traffic and applies AI-specific runtime policies
ExamplesGrant a group access to a model; track lineage of a tableBlock a response containing PII; cap a team’s monthly spend; require approval before a code push
RelationshipThe foundationBuilt on top of the foundation

Why do you need both? Because access control alone cannot stop a permitted actor from doing something harmful in a specific moment. Unity Catalog can grant a coding agent access to a GitHub MCP service; only Unity AI Gateway can then require human approval before that same agent pushes to a protected branch, or block a request whose content contains regulated data. As Databricks puts it, the two together provide a unified governance layer for both AI assets and AI interactions: the catalog supplies identity, permissions, lineage, and audit, while the gateway enforces runtime guardrails and contextual policies on top (Databricks).

A useful mental model: Unity Catalog is the org chart and key-card system; Unity AI Gateway is the live security operations center watching what everyone actually does with their access.

Why Business Leaders Should Care About Unity AI Gateway

If you are accountable for an AI budget, a compliance posture, or an engineering org’s productivity, Unity AI Gateway maps directly to outcomes you already own.

Predictable AI spend. The gateway provides end-to-end observability and granular cost attribution across models, providers, teams, and applications, with out-of-the-box dashboards and Genie-powered natural-language analysis. Teams can define budgets and block new usage when estimated spend reaches a threshold, providing much tighter control over runaway consumption. One important nuance for finance leaders: Databricks documents this enforcement as near real time rather than an absolute guarantee on final billed spend, a small amount of spend beyond a threshold can still occur, in-flight requests are not interrupted, and today’s budget tracking covers pay-per-token and batch (ai_query) inference but not provisioned throughput or external-model inference. It is a strong guardrail against overruns, not a hard billing ceiling.

One control plane instead of a dozen doors. Rivian’s tech lead described the shift well: every request runs through a single control plane with rate limits, PII guardrails, and per-user cost attribution, on infrastructure the company already owned. As agents get more autonomous, “watching one door, not a dozen” is the operational win.

Responsible scale in regulated industries. Financial-services and healthcare adopters (First American, OnePay, Flo Health) cite the same theme: broad AI access and consistent guardrails, so teams can move fast without compromising their duty of care over sensitive data.

Reduced provider lock-in. Unity AI Gateway provides native access to frontier models (including Anthropic, OpenAI, Google Gemini, Kimi, and GLM) through a single-query, OpenAI-compatible API, so swapping models is a configuration change rather than a re-architecture. It does not eliminate lock-in entirely (the governance layer itself is a Databricks platform capability) but it meaningfully reduces model-provider lock-in.

Datapao’s take: The biggest hidden cost of enterprise AI is not the tokens, it is the fragmentation. When every team wires up its own provider keys, logging, and budget tracking, governance becomes impossible and spend becomes invisible. Consolidating on a gateway is a governance decision first and a cost decision second; the savings follow from the visibility.

Source: Databricks webinar – Govern AI spend at scale – demo part

How Does Unity AI Gateway Work? Architecture and Core Components Explained

Unity AI Gateway is best understood as four control surfaces layered on Unity Catalog: access control, traffic management, guardrails/policies, and observability. Everything registers as a Unity Catalog securable, which is what makes governance consistent.

1. Access control – AI assets as Unity Catalog securables

You register AI assets as Unity Catalog securable objects, then grant and revoke access using the same privileges you already use for tables and volumes (Azure Databricks docs). Concretely:

  • Model APIs (model services): Foundation models are served natively as ready-to-use model services in the system.ai schema with no setup (pay-per-token access to models such as GPT, Claude, and Gemini). Each model service is a Unity Catalog securable object; callers invoke it by its fully qualified name, and Unity AI Gateway routes the request to a destination (a Databricks-served model or an external provider — a single service can mix both).
  • External model providers: Connect providers such as OpenAI and Anthropic with bring-your-own-key (BYOK) and govern them through one control point.
  • MCP tools: MCP servers are registered as Unity Catalog securables, with tool filtering and service policies. Databricks provides managed MCP services for applications including Google Drive, Jira, Confluence, Slack, GitHub, and SharePoint, plus registration of custom MCP services. Some of these managed integrations are still rolling out, so confirm current availability for your region and workspace.
  • Agents, functions, and connections: Agents can be governed through Unity Catalog, while the tools they call are governed as MCP services, Unity Catalog functions, and connections. Databricks’ newer Agent Services capability provides a governed registry for agents and is currently Beta, with runtime invocation and some Gateway controls still subject to Beta limitations.
  • Skills: Unity Catalog now provides a governed inventory of reusable, discoverable skills.

Because model access can be attribute-driven, admins can apply policies dynamically based on model provider, country of origin, approval status, or any governed tag — useful for data-sovereignty and vendor-approval requirements as model inventories grow. (These attribute-based access control, or ABAC, grant policies for AI securables such as model services, MCP services, agent services, and skills are currently Beta.)

2. Traffic management – routing, rate limits, and failover

Unity AI Gateway routes requests to model and MCP services from a central control plane, so capacity, availability, and spend are managed across providers:

  • Rate limits: Enforce consumption limits at the endpoint, user, or group level to prevent runaway costs and protect SLAs before problems start.
  • Traffic splitting and fallbacks: Distribute requests across multiple model destinations and add failover to increase availability.
  • Budgets: Monitor spend and set per-user thresholds and hard caps.
  • Smart Routing (Beta): Dynamically routes each request to the right model based on quality, cost, performance, availability, and budget, reserving the most capable, expensive models for tasks that need them and sending the rest to cheaper options. This is the “valuemaxxing” lever Databricks emphasizes: better value per AI dollar without forcing developers to compromise. 

3. Guardrails and contextual service policies

Service policies (also called guardrails) control how each request and response proceeds, based on its content and on who is making the call (docs). With Contextual Service Policies (Beta), you can allow, deny, or require approval for specific actions — modifying files, pushing code, accessing enterprise systems, or handling sensitive information.

Policies can be scoped by user, model, MCP service, the specific tool being invoked, or the content of the request/response. Built-in guardrails mitigate prompt injection, jailbreaks, and unsafe content. Real examples from Databricks: require approval before a coding agent pushes to GitHub; restrict writes to sensitive Google Drive folders; block any request or response containing regulated data.

Policies are implemented as service policy functions attached to an MCP service or model service – meaning guardrails are versioned, code-reviewable governance artifacts, not opaque toggles.

4. Observability – traces, cost, and audit

Everything flowing through the gateway lands in a governed telemetry layer:

  • Usage tracking: Requests, token usage, and latency exposed through Unity Catalog system tables (directly queryable).
  • Cost analysis: Attribute cost to services, target models, principals, and service tags / request tags – the mechanism behind per-user, per-team, and per-project chargeback.
  • Inference tables: Capture model requests and responses in Unity Catalog Delta tables for monitoring, debugging, and compliance. (Payload logging is subject to configuration and size/delivery limitations, so treat it as strong audit support rather than a guaranteed complete record of every payload.)
  • Unified agent tracing: Captures model interactions and MCP tool activity in one place; integrates with MLflow for evaluation and monitoring across dev and production.
  • Security investigation: Analyze Unity AI Gateway traces and activity with Lakewatch to detect suspicious activity and investigate policy violations.

How to Configure Unity AI Gateway: UI, APIs, and CLI

There are two related configuration surfaces, and it helps to know which one you’re using:

  • Unity AI Gateway model services (the current model-services architecture): Model services live in Unity Catalog and are created and managed through the Unity AI Gateway UI / Catalog Explorer and the Unity Catalog REST API. You query them by fully qualified name through the gateway’s OpenAI-compatible paths (for example, https://<workspace-url>/ai-gateway/mlflow/v1).
  • AI Gateway features on model serving endpoints: If you configure AI Gateway features (rate limits, inference tables, guardrails, usage tracking) directly on a model serving endpoint, Databricks documents the REST API PUT /api/2.0/serving-endpoints/{name}/ai-gateway for that. This is the serving-endpoint configuration experience rather than the Unity Catalog model-service experience.
  • CLI: The Databricks CLI can invoke Databricks REST APIs and manage certain serving-endpoint resources. For Unity AI Gateway model services, the current documented management paths are the Unity AI Gateway UI / Catalog Explorer and Unity Catalog APIs.

Databricks’ newer, ready-to-use foundation models are exposed as model services in the system.ai schema and invoked by their fully qualified Unity Catalog name. (You may still encounter the older serving-endpoint naming with the databricks- prefix, e.g. databricks-claude-sonnet-4-6, in the model-serving experience, a useful signal for which architecture you’re working in.) In both cases, model services are queried through an OpenAI-compatible API, so existing OpenAI SDK code and tooling generally works with minimal changes.

Unity AI Gateway Reference Architecture: How the Pieces Fit Together

At a high level, requests from developers, coding agents, custom agents, and business users flow through Unity AI Gateway, which applies its four control surfaces before routing to the underlying AI assets, all sitting on the Unity Catalog governance foundation. The diagram below shows how the layers stack:

Unity AI Gateway Architecture

Unity Catalog supplies the identity, permissions, lineage, and auditing; Unity AI Gateway enforces the runtime controls on top. Together they govern both AI assets and AI interactions in one layer.

How Unity AI Gateway Connects to Omnigent: Governing Multi-Agent Workflows

When used together on Databricks, Omnigent provides the meta-harness for running and composing agents, while Unity AI Gateway provides the governance layer underneath. Understanding the split is the fastest way to see where each fits.

What Omnigent is. Omnigent is an open-source meta-harness, an orchestration layer that sits above the agent frameworks and coding tools teams already use, such as Claude Code and Codex, letting you compose them into a single governed workflow rather than running each in isolation (Databricks). At Data + AI Summit 2026, Databricks also introduced Omnigent on Databricks, a managed version currently in Beta. Because it is the same Omnigent as the open-source project, teams bring their existing setup  (harnesses, workflows, and skills) and deploy it to run as managed workflows with shared history, remote access, collaboration, and isolated cloud execution.

How the two relate. The division of labor is clean: Omnigent orchestrates and executes; Unity AI Gateway governs. With Omnigent on Databricks, interactions run through Unity AI Gateway, which applies centrally defined contextual policies, cost controls, Smart Routing, and unified telemetry, with each session traced in MLflow and shareable via a single link. In other words, Omnigent is how multi-agent work gets composed and run, and Unity AI Gateway is what keeps it governed, the same four control surfaces (access, traffic, guardrails, observability) that govern any other request also govern agent activity flowing through Omnigent. This is why Databricks positions the managed version as extending open-source Omnigent “with Unity AI Gateway and Unity Catalog.”

Why this matters to the business. The problem Omnigent-plus-gateway solves is fragmentation. When several agent frameworks run independently (no shared governance, no unified cost view, no common audit trail) risk and spend compound quickly. Running agents through Omnigent on top of Unity AI Gateway means one policy set, one cost ledger, and one observability plane across every framework, without asking teams to abandon the tools they already use.

What technical leads should know before piloting. Omnigent on Databricks is Beta and carries real constraints worth planning around, per Databricks’ documentation:

  • It requires the Omnigent preview enabled for your workspace, and a workspace in a region that supports Unity AI Gateway.
  • Only the built-in contextual policies are supported as policy handlers. Custom policy functions that run arbitrary code (including the custom YAML policies available in the open-source version) are not yet supported on the managed version.
  • Databricks Sandbox integration (for secure, isolated agent execution) is AWS-only and available in select regions, and requires the relevant previews enabled.
  • Native Windows support is not available.

DATAPAO’s take: Treat Omnigent and Unity AI Gateway as one story, not two products. If you are evaluating agentic AI at scale, the gateway is the control plane you should stand up first; Omnigent is then the natural way to run multi-framework agent workflows through that control plane. Given the current Beta constraints (especially built-in-policies-only and the AWS-only Sandbox) we’d scope early Omnigent work as a governed pilot rather than a broad production rollout.

How to Implement Unity AI Gateway: A 7-Step Adoption Roadmap

Based on how the platform is designed and how DATAPAO approaches Databricks governance engagements, a pragmatic rollout looks like this:

  1. Consolidate access. Route existing foundation-model and provider traffic through the gateway using BYOK. Register your external providers and MCP services as Unity Catalog securables.
  2. Turn on observability first. Enable usage tracking and inference tables before you enforce anything. You cannot govern what you cannot see, establish the baseline of who is spending what, on which models.
  3. Attribute cost. Apply service tags and request tags so spend maps to users, teams, and use cases. This is the data a CFO needs.
  4. Set budgets and rate limits. Introduce per-user and per-group rate limits, then proactive budgets, then hard spend caps once the baseline is understood.
  5. Layer guardrails. Start with built-in PII and prompt-injection guardrails, then add contextual service policies for high-risk actions (code pushes, writes to sensitive systems).
  6. Pilot smart routing. Once quality baselines exist, evaluate Smart Routing (Beta) to reduce cost on lower-complexity tasks.
  7. Wire in security tooling. Stream traces to Lakewatch and integrate your existing identity and AI-security partners.

The Unity AI Gateway Partner Ecosystem: Security and Identity Integrations

Unity AI Gateway is built as an open governance platform. Databricks has announced integrations across AI security, identity governance, data protection, and threat detection, including CrowdStrike (Falcon AI Detection and Response), Palo Alto Networks (Prisma AIRS), Zscaler, Okta, Ping Identity, SailPoint, Saviynt, and others (Databricks). Some of these were described as upcoming at announcement, so confirm current availability for the specific partner you need. The strategic point holds either way: enterprises can extend the identity and security tools they already trust into governed AI workflows, rather than replacing them.

Databricks Unity AI Gateway FAQ:

What is Databricks Unity AI Gateway in one sentence? It is a Unity Catalog–based governance layer that centrally controls the cost, security, and model choice of the AI models, agents, MCP services, and skills an enterprise governs through it.

When did Unity AI Gateway become generally available? It reached general availability on August 4, 2026, following expanded capabilities announced at Data + AI Summit 2026 on June 16, 2026.

Is it just a proxy in front of the LLMs? How is it different from a generic LLM gateway? Not quite. A plain LLM proxy forwards requests and juggles API keys. Unity AI Gateway does route traffic, but routing is the least interesting part — its real job is to attach identity, policy, cost, and audit to every AI interaction. A request is not just forwarded; it is checked against who is asking, what they are allowed to do, what it will cost, and whether the content is safe, and then the whole exchange is logged. Think of it as a customs checkpoint, not a mail-forwarding service. Concretely, it adds Unity Catalog–native access control, runtime action-level guardrails, granular cost attribution through system tables, and unified tracing of both model calls and MCP tool invocations, all governed alongside your data.

What is the difference between Unity Catalog and Unity AI Gateway? Unity Catalog governs AI assets — it is the catalog and permission model that answers “who can access this model, agent, or tool?” Unity AI Gateway governs AI interactions — it is the runtime enforcement layer that answers “what can happen in this specific request?” Unity AI Gateway is built on Unity Catalog; the catalog provides identity, permissions, lineage, and audit, while the gateway enforces routing, spend caps, and content guardrails at runtime. You use both together, not one instead of the other.

How does Omnigent relate to Unity AI Gateway? Omnigent is an open-source meta-harness that composes and runs agents on top of frameworks like Claude Code and Codex; Unity AI Gateway is the governance layer beneath it. Omnigent orchestrates and executes agent workflows, while every interaction runs through Unity AI Gateway for contextual policies, cost controls, Smart Routing, and tracing. Omnigent on Databricks (the managed version) is currently in Beta and only supports built-in contextual policies, requires a region that supports Unity AI Gateway, and has AWS-only Sandbox integration.

Does it lock me into Databricks-hosted models? No. It provides native access to frontier models via a single OpenAI-compatible API and supports external providers through bring-your-own-key, so it is explicitly multi-provider. It reduces model-provider lock-in, though the governance layer itself is a Databricks platform capability.

How does it control AI cost? Through unified spend visibility, granular attribution by user/team/tool/use case, budgets, endpoint/user/group rate limits, usage blocking when estimated spend reaches a threshold, and Smart Routing (Beta) that sends work to the most cost-appropriate model. Note that Databricks documents budget enforcement as near real time, not an absolute cap on final billed spend, and current budget tracking covers pay-per-token and batch inference but not provisioned throughput or external-model inference.

What is the “See it, Show it, Act on it” framework? It is how Databricks describes the path to controlling AI spend with Unity AI Gateway. See it means turning on visibility — usage tracking, cost attribution, and tracing across every model and team. Show it means surfacing that spend directly to the people creating it (Databricks even puts per-session cost in each engineer’s terminal). Act on it means using the data to enforce budgets, rate limits, Smart Routing, and contextual policies. The sequence matters: visibility and transparency come before enforcement. Built-in guardrails for prompt injection, jailbreaks, and unsafe content, plus Contextual Service Policies (Beta) that allow, deny, or require approval for specific actions based on user, agent, model, tool, or request/response content.

How do I configure it? Model services are managed through the Unity AI Gateway UI / Catalog Explorer and the Unity Catalog REST API, and queried through an OpenAI-compatible API. If you configure AI Gateway features directly on a model serving endpoint, Databricks documents the PUT /api/2.0/serving-endpoints/{name}/ai-gateway REST API for that path. The Databricks CLI (v1.0.0+) can inspect and provision endpoints.

Which clouds support it? It is documented across AWS, Azure, and GCP Databricks, subject to regional and feature-specific availability (not every feature or model is available in every region, and it is not supported on AWS GovCloud or Azure Government).

What is MCP, and why does it keep coming up? MCP  (the Model Context Protocol) is the emerging standard for how agents connect to external tools and data (a GitHub server, a Google Drive server, and so on). It matters for governance because an agent’s power to act comes through these tool connections. Governing the model alone is not enough; you also have to govern the MCP services the model can reach, which is why they are first-class securables in the gateway.

What is “tokenmaxxing vs. valuemaxxing”? This is Databricks’ own shorthand. Tokenmaxxing is optimizing for raw token throughput or the cheapest model everywhere, a false economy that hurts quality. Valuemaxxing is spending each AI dollar where it produces value: reserving expensive frontier models for hard tasks and routing easy work to cheaper models, which is exactly what Smart Routing automates.

How Datapao Helps You Deploy Unity AI Gateway

Unity AI Gateway gives you the levers; getting them configured for your regulatory environment, cost model, and engineering culture is where implementation experience pays off. DATAPAO works with enterprises to design Unity Catalog governance foundations, roll out gateway observability and cost attribution, and operationalize guardrails without slowing developers down.

If you are scaling AI across teams and want cost, control, and choice under one roof, get in touch with DATAPAO.

Sources

Published by Datapao. This article is informational and based on publicly available Databricks and Microsoft documentation as of August 2026. Unity AI Gateway is generally available, but several capabilities referenced here (including Smart Routing, service policies, agent services, ABAC grant policies for AI securables, and Omnigent on Databricks) are in Beta, and some managed MCP integrations and partner integrations are still rolling out. Feature availability varies by cloud and region. Verify current status in the official documentation before making architectural decisions.

About Datapao

Datapao is a Databricks-focused data and AI consulting and training company operating in the UK and across Europe, with delivery hubs in the UK and Central Europe. The company helps organisations design, build, and operate modern data platforms while enabling internal teams through hands-on Databricks training. Our approach combines deep engineering expertise with structured knowledge transfer to ensure sustainable, long-term adoption of data and AI.

Get in touch to discuss where to start.