
Adapt or fall behind: a review of the Databricks executive survey on AI and its use
Understand how 600 tech leaders think about AI and find out how to future-proof your business before adopting the emerging tech.
Databricks Unity AI Gateway is the governance layer that lets enterprises control cost, security, and model choice across the AI models, agents, MCP services, and skills they govern through Unity Catalog, from a single control plane. It became generally available on August 4, 2026, after being announced in expanded form at Data + AI Summit 2026.
At DATAPAO, we help enterprises turn the Databricks platform into a governed, production-grade foundation for data and AI.
This guide reflects the generally available Unity AI Gateway announced August 4, including the latest cost controls, agent governance, service policies and Smart Routing capabilities.
Unity AI Gateway is Databricks’ governance solution for enterprise AI. Built on Unity Catalog, it extends governance beyond your data and static AI assets to the runtime interactions between models, agents, MCP (Model Context Protocol) servers, skills, and tools (Databricks, June 2026).
The distinction matters. Traditional governance answers the question “who can access this model or tool?” Unity AI Gateway also answers “what is this agent allowed to do in this specific interaction?”, because as agents become more autonomous, action-level control becomes the real risk surface. Databricks has described agents as some of the most privileged actors in an enterprise, which is why governance increasingly has to operate at the action level.
The product originally shipped as “AI Gateway” and was folded into Unity Catalog as Unity AI Gateway, extending Unity Catalog’s permissions, lineage, and audit model to agentic AI (Databricks).
Databricks frames the enterprise AI challenge around three tensions, and Unity AI Gateway is built to resolve all three:

Source: Databricks
When Databricks explains how to actually get AI spend under control, it uses a simple three-step arc: See it → Show it → Act on it. It is the narrative spine that ties the gateway’s capabilities together, and it doubles as a practical maturity model — you cannot skip steps. Databricks applies the same arc to its own internal usage (“Databricks on Databricks”), which is the clearest way to see what each step means in practice.
1. See it: get visibility you didn’t have before. You cannot govern what you cannot see. The first step is simply making AI activity and spend visible across every model, provider, team, and tool, through Unity AI Gateway’s usage tracking, cost attribution, and end-to-end tracing. In Databricks’ own rollout, this visibility surfaced two surprises: many engineers weren’t using coding agents at all (and nudging them helped), and once adoption climbed, spend exploded. Neither fact was knowable before the gateway aggregated the data into one system of record. This is the “unified enterprise AI registry”, measure and monitor first.
2. Show it: put the numbers in front of the people who create them. Visibility at the admin level isn’t enough; the people generating the spend need to see it too. Databricks pushed each engineer’s cost directly into their terminal (a simple line like “This session cost us $15.50”) so the cost of an agent session became immediate and personal rather than an abstract number on a finance dashboard a month later. At the organizational level, the same idea shows up as real-time budgets and cost dashboards (with Genie-powered natural-language analysis) that surface consumption metrics directly to teams. The goal is behavioral: costs that are visible at the moment of use get managed; costs buried in a quarterly report do not.
3. Act on it: turn the data into automated control. Once you can see and show the spend, you act on it. In Databricks’ internal case this meant benchmarking agent/harness configurations against real pull requests, changing default configs, adopting a meta-harness (Omnigent) to route work intelligently, and giving engineers self-service tools to set their own budgets. At the product level, “Act on it” is where the runtime controls live: budgets and rate limits, Smart Routing that automatically sends each request to the most cost-appropriate model, and (through Unity AI Gateway together with Omnigent) contextual policies that transform live session data into real-time allow/deny decisions (for example, allowing an agent to publish public information to a website while denying the same action for customer data).
A concrete illustration of “Act on it” in motion: Smart Routing inspects each request and picks the model to match. A casual “tell me a joke” is classed as a simple task and routed to the cheapest capable model (in Databricks’ demo, system.ai.glm-5-2); a request to build a transpiler (multi-file architecture, AST manipulation, type inference) is classed as complex and routed to the most capable model (gpt-5-6-sol). Same governance, very different cost per task, no developer having to choose.
Datapao’s take: The order is the point. Teams often want to jump straight to “Act on it” – hard budgets and blocking policies, but controls imposed without visibility breed resentment and workarounds. Start with See it (turn on observability), earn trust with Show it (make spend transparent to the people creating it), and only then move to Act on it (automated budgets, routing, and policies). We sequence every Databricks AI-governance engagement this way.

Source: Databricks webinar – Govern AI spend at scale
This is the most common point of confusion, so it deserves a direct answer: Unity Catalog and Unity AI Gateway are two layers of the same governance system, not competitors or duplicates. Unity AI Gateway is built on Unity Catalog and depends on it.
Here is the cleanest way to hold the distinction:
| Dimension | Unity Catalog | Unity AI Gateway |
| Primary role | Catalog + permission model for assets | Runtime enforcement + routing for interactions |
| Governs | Data and AI assets (the nouns) | AI interactions (the verbs) |
| Core question | “Who can access this?” | “What can happen in this request?” |
| When it acts | Whenever a securable is accessed (privileges enforced at access time) | In the live request path, per AI request |
| What it does | Defines and enforces identity, privileges, lineage, and governance for securable assets | Controls and observes model/MCP traffic and applies AI-specific runtime policies |
| Examples | Grant a group access to a model; track lineage of a table | Block a response containing PII; cap a team’s monthly spend; require approval before a code push |
| Relationship | The foundation | Built on top of the foundation |
Why do you need both? Because access control alone cannot stop a permitted actor from doing something harmful in a specific moment. Unity Catalog can grant a coding agent access to a GitHub MCP service; only Unity AI Gateway can then require human approval before that same agent pushes to a protected branch, or block a request whose content contains regulated data. As Databricks puts it, the two together provide a unified governance layer for both AI assets and AI interactions: the catalog supplies identity, permissions, lineage, and audit, while the gateway enforces runtime guardrails and contextual policies on top (Databricks).
A useful mental model: Unity Catalog is the org chart and key-card system; Unity AI Gateway is the live security operations center watching what everyone actually does with their access.
If you are accountable for an AI budget, a compliance posture, or an engineering org’s productivity, Unity AI Gateway maps directly to outcomes you already own.
Predictable AI spend. The gateway provides end-to-end observability and granular cost attribution across models, providers, teams, and applications, with out-of-the-box dashboards and Genie-powered natural-language analysis. Teams can define budgets and block new usage when estimated spend reaches a threshold, providing much tighter control over runaway consumption. One important nuance for finance leaders: Databricks documents this enforcement as near real time rather than an absolute guarantee on final billed spend, a small amount of spend beyond a threshold can still occur, in-flight requests are not interrupted, and today’s budget tracking covers pay-per-token and batch (ai_query) inference but not provisioned throughput or external-model inference. It is a strong guardrail against overruns, not a hard billing ceiling.
One control plane instead of a dozen doors. Rivian’s tech lead described the shift well: every request runs through a single control plane with rate limits, PII guardrails, and per-user cost attribution, on infrastructure the company already owned. As agents get more autonomous, “watching one door, not a dozen” is the operational win.
Responsible scale in regulated industries. Financial-services and healthcare adopters (First American, OnePay, Flo Health) cite the same theme: broad AI access and consistent guardrails, so teams can move fast without compromising their duty of care over sensitive data.
Reduced provider lock-in. Unity AI Gateway provides native access to frontier models (including Anthropic, OpenAI, Google Gemini, Kimi, and GLM) through a single-query, OpenAI-compatible API, so swapping models is a configuration change rather than a re-architecture. It does not eliminate lock-in entirely (the governance layer itself is a Databricks platform capability) but it meaningfully reduces model-provider lock-in.
Datapao’s take: The biggest hidden cost of enterprise AI is not the tokens, it is the fragmentation. When every team wires up its own provider keys, logging, and budget tracking, governance becomes impossible and spend becomes invisible. Consolidating on a gateway is a governance decision first and a cost decision second; the savings follow from the visibility.

Source: Databricks webinar – Govern AI spend at scale – demo part
Unity AI Gateway is best understood as four control surfaces layered on Unity Catalog: access control, traffic management, guardrails/policies, and observability. Everything registers as a Unity Catalog securable, which is what makes governance consistent.
You register AI assets as Unity Catalog securable objects, then grant and revoke access using the same privileges you already use for tables and volumes (Azure Databricks docs). Concretely:
Because model access can be attribute-driven, admins can apply policies dynamically based on model provider, country of origin, approval status, or any governed tag — useful for data-sovereignty and vendor-approval requirements as model inventories grow. (These attribute-based access control, or ABAC, grant policies for AI securables such as model services, MCP services, agent services, and skills are currently Beta.)
Unity AI Gateway routes requests to model and MCP services from a central control plane, so capacity, availability, and spend are managed across providers:
Service policies (also called guardrails) control how each request and response proceeds, based on its content and on who is making the call (docs). With Contextual Service Policies (Beta), you can allow, deny, or require approval for specific actions — modifying files, pushing code, accessing enterprise systems, or handling sensitive information.
Policies can be scoped by user, model, MCP service, the specific tool being invoked, or the content of the request/response. Built-in guardrails mitigate prompt injection, jailbreaks, and unsafe content. Real examples from Databricks: require approval before a coding agent pushes to GitHub; restrict writes to sensitive Google Drive folders; block any request or response containing regulated data.
Policies are implemented as service policy functions attached to an MCP service or model service – meaning guardrails are versioned, code-reviewable governance artifacts, not opaque toggles.
Everything flowing through the gateway lands in a governed telemetry layer:
There are two related configuration surfaces, and it helps to know which one you’re using:
Databricks’ newer, ready-to-use foundation models are exposed as model services in the system.ai schema and invoked by their fully qualified Unity Catalog name. (You may still encounter the older serving-endpoint naming with the databricks- prefix, e.g. databricks-claude-sonnet-4-6, in the model-serving experience, a useful signal for which architecture you’re working in.) In both cases, model services are queried through an OpenAI-compatible API, so existing OpenAI SDK code and tooling generally works with minimal changes.
At a high level, requests from developers, coding agents, custom agents, and business users flow through Unity AI Gateway, which applies its four control surfaces before routing to the underlying AI assets, all sitting on the Unity Catalog governance foundation. The diagram below shows how the layers stack:

Unity Catalog supplies the identity, permissions, lineage, and auditing; Unity AI Gateway enforces the runtime controls on top. Together they govern both AI assets and AI interactions in one layer.
When used together on Databricks, Omnigent provides the meta-harness for running and composing agents, while Unity AI Gateway provides the governance layer underneath. Understanding the split is the fastest way to see where each fits.
What Omnigent is. Omnigent is an open-source meta-harness, an orchestration layer that sits above the agent frameworks and coding tools teams already use, such as Claude Code and Codex, letting you compose them into a single governed workflow rather than running each in isolation (Databricks). At Data + AI Summit 2026, Databricks also introduced Omnigent on Databricks, a managed version currently in Beta. Because it is the same Omnigent as the open-source project, teams bring their existing setup (harnesses, workflows, and skills) and deploy it to run as managed workflows with shared history, remote access, collaboration, and isolated cloud execution.
How the two relate. The division of labor is clean: Omnigent orchestrates and executes; Unity AI Gateway governs. With Omnigent on Databricks, interactions run through Unity AI Gateway, which applies centrally defined contextual policies, cost controls, Smart Routing, and unified telemetry, with each session traced in MLflow and shareable via a single link. In other words, Omnigent is how multi-agent work gets composed and run, and Unity AI Gateway is what keeps it governed, the same four control surfaces (access, traffic, guardrails, observability) that govern any other request also govern agent activity flowing through Omnigent. This is why Databricks positions the managed version as extending open-source Omnigent “with Unity AI Gateway and Unity Catalog.”
Why this matters to the business. The problem Omnigent-plus-gateway solves is fragmentation. When several agent frameworks run independently (no shared governance, no unified cost view, no common audit trail) risk and spend compound quickly. Running agents through Omnigent on top of Unity AI Gateway means one policy set, one cost ledger, and one observability plane across every framework, without asking teams to abandon the tools they already use.
What technical leads should know before piloting. Omnigent on Databricks is Beta and carries real constraints worth planning around, per Databricks’ documentation:
DATAPAO’s take: Treat Omnigent and Unity AI Gateway as one story, not two products. If you are evaluating agentic AI at scale, the gateway is the control plane you should stand up first; Omnigent is then the natural way to run multi-framework agent workflows through that control plane. Given the current Beta constraints (especially built-in-policies-only and the AWS-only Sandbox) we’d scope early Omnigent work as a governed pilot rather than a broad production rollout.

Based on how the platform is designed and how DATAPAO approaches Databricks governance engagements, a pragmatic rollout looks like this:
Unity AI Gateway is built as an open governance platform. Databricks has announced integrations across AI security, identity governance, data protection, and threat detection, including CrowdStrike (Falcon AI Detection and Response), Palo Alto Networks (Prisma AIRS), Zscaler, Okta, Ping Identity, SailPoint, Saviynt, and others (Databricks). Some of these were described as upcoming at announcement, so confirm current availability for the specific partner you need. The strategic point holds either way: enterprises can extend the identity and security tools they already trust into governed AI workflows, rather than replacing them.
What is Databricks Unity AI Gateway in one sentence? It is a Unity Catalog–based governance layer that centrally controls the cost, security, and model choice of the AI models, agents, MCP services, and skills an enterprise governs through it.
When did Unity AI Gateway become generally available? It reached general availability on August 4, 2026, following expanded capabilities announced at Data + AI Summit 2026 on June 16, 2026.
Is it just a proxy in front of the LLMs? How is it different from a generic LLM gateway? Not quite. A plain LLM proxy forwards requests and juggles API keys. Unity AI Gateway does route traffic, but routing is the least interesting part — its real job is to attach identity, policy, cost, and audit to every AI interaction. A request is not just forwarded; it is checked against who is asking, what they are allowed to do, what it will cost, and whether the content is safe, and then the whole exchange is logged. Think of it as a customs checkpoint, not a mail-forwarding service. Concretely, it adds Unity Catalog–native access control, runtime action-level guardrails, granular cost attribution through system tables, and unified tracing of both model calls and MCP tool invocations, all governed alongside your data.
What is the difference between Unity Catalog and Unity AI Gateway? Unity Catalog governs AI assets — it is the catalog and permission model that answers “who can access this model, agent, or tool?” Unity AI Gateway governs AI interactions — it is the runtime enforcement layer that answers “what can happen in this specific request?” Unity AI Gateway is built on Unity Catalog; the catalog provides identity, permissions, lineage, and audit, while the gateway enforces routing, spend caps, and content guardrails at runtime. You use both together, not one instead of the other.
How does Omnigent relate to Unity AI Gateway? Omnigent is an open-source meta-harness that composes and runs agents on top of frameworks like Claude Code and Codex; Unity AI Gateway is the governance layer beneath it. Omnigent orchestrates and executes agent workflows, while every interaction runs through Unity AI Gateway for contextual policies, cost controls, Smart Routing, and tracing. Omnigent on Databricks (the managed version) is currently in Beta and only supports built-in contextual policies, requires a region that supports Unity AI Gateway, and has AWS-only Sandbox integration.
Does it lock me into Databricks-hosted models? No. It provides native access to frontier models via a single OpenAI-compatible API and supports external providers through bring-your-own-key, so it is explicitly multi-provider. It reduces model-provider lock-in, though the governance layer itself is a Databricks platform capability.
How does it control AI cost? Through unified spend visibility, granular attribution by user/team/tool/use case, budgets, endpoint/user/group rate limits, usage blocking when estimated spend reaches a threshold, and Smart Routing (Beta) that sends work to the most cost-appropriate model. Note that Databricks documents budget enforcement as near real time, not an absolute cap on final billed spend, and current budget tracking covers pay-per-token and batch inference but not provisioned throughput or external-model inference.
What is the “See it, Show it, Act on it” framework? It is how Databricks describes the path to controlling AI spend with Unity AI Gateway. See it means turning on visibility — usage tracking, cost attribution, and tracing across every model and team. Show it means surfacing that spend directly to the people creating it (Databricks even puts per-session cost in each engineer’s terminal). Act on it means using the data to enforce budgets, rate limits, Smart Routing, and contextual policies. The sequence matters: visibility and transparency come before enforcement. Built-in guardrails for prompt injection, jailbreaks, and unsafe content, plus Contextual Service Policies (Beta) that allow, deny, or require approval for specific actions based on user, agent, model, tool, or request/response content.
How do I configure it? Model services are managed through the Unity AI Gateway UI / Catalog Explorer and the Unity Catalog REST API, and queried through an OpenAI-compatible API. If you configure AI Gateway features directly on a model serving endpoint, Databricks documents the PUT /api/2.0/serving-endpoints/{name}/ai-gateway REST API for that path. The Databricks CLI (v1.0.0+) can inspect and provision endpoints.
Which clouds support it? It is documented across AWS, Azure, and GCP Databricks, subject to regional and feature-specific availability (not every feature or model is available in every region, and it is not supported on AWS GovCloud or Azure Government).
What is MCP, and why does it keep coming up? MCP (the Model Context Protocol) is the emerging standard for how agents connect to external tools and data (a GitHub server, a Google Drive server, and so on). It matters for governance because an agent’s power to act comes through these tool connections. Governing the model alone is not enough; you also have to govern the MCP services the model can reach, which is why they are first-class securables in the gateway.
What is “tokenmaxxing vs. valuemaxxing”? This is Databricks’ own shorthand. Tokenmaxxing is optimizing for raw token throughput or the cheapest model everywhere, a false economy that hurts quality. Valuemaxxing is spending each AI dollar where it produces value: reserving expensive frontier models for hard tasks and routing easy work to cheaper models, which is exactly what Smart Routing automates.
Unity AI Gateway gives you the levers; getting them configured for your regulatory environment, cost model, and engineering culture is where implementation experience pays off. DATAPAO works with enterprises to design Unity Catalog governance foundations, roll out gateway observability and cost attribution, and operationalize guardrails without slowing developers down.
If you are scaling AI across teams and want cost, control, and choice under one roof, get in touch with DATAPAO.
Published by Datapao. This article is informational and based on publicly available Databricks and Microsoft documentation as of August 2026. Unity AI Gateway is generally available, but several capabilities referenced here (including Smart Routing, service policies, agent services, ABAC grant policies for AI securables, and Omnigent on Databricks) are in Beta, and some managed MCP integrations and partner integrations are still rolling out. Feature availability varies by cloud and region. Verify current status in the official documentation before making architectural decisions.
Datapao is a Databricks-focused data and AI consulting and training company operating in the UK and across Europe, with delivery hubs in the UK and Central Europe. The company helps organisations design, build, and operate modern data platforms while enabling internal teams through hands-on Databricks training. Our approach combines deep engineering expertise with structured knowledge transfer to ensure sustainable, long-term adoption of data and AI.
Get in touch to discuss where to start.