SAP Unveils AI Governance Tools at TechEd, Led by Enterprise AI Gateway

Runtime control through the Enterprise AI Gateway

SAP says real AI governance is not about checking after the fact whether rules were followed, but about applying governance when it matters. The SAP Enterprise AI Gateway is built for that purpose. According to SAP, it consolidates authentication, policy enforcement and routing at runtime, while also allowing continuous monitoring, usage tracking and auditing.

The gateway controls traffic across MCPs, APIs, agent-to-agent connections and LLMs. It builds on SAP Integration Suite and is meant to give real-time oversight and control over AI in action.

As a complement, SAP announced customer access to curated SAP Sovereign Cloud LLMs directly through SAP AI Core. This lets customers use these models in critical processes while adhering to established governance standards. SAP adds that direct access on SAP Sovereign Cloud can reduce both cost and complexity in AI operations.

Architecture context and EU AI Act support

SAP also described new features in its SAP LeanIX portfolio that let enterprise architects control the architecture data Joule Agents use to make and execute decisions. The feature relies on a knowledge intake agent. It extracts relevant information from security and architecture decision documents, proposes connections to the SAP LeanIX knowledge graph, and submits all data for human approval before agents can use it.

To support EU AI Act assessments directly in SAP AI Agent Hub, SAP introduced the AI Governance Assistant. According to SAP, the assistant:

• audits and flags incomplete documentation in the agent inventory
• pre-fills fields from completed assessments
• identifies systems that appear high-risk but lack classification
• triggers reassessment when a fact sheet changes materially

All outputs from the assistant appear as drafts for legal and compliance review, so humans stay in the loop.

Governance tied to business value

Dominik Rose, chief product officer for SAP LeanIX, wrote that these announcements are part of a longer story. SAP says it has long played a role in governing core operational and financial functions, and that its AI governance approach extends this legacy. SAP AI Agent Hub, which grew out of AI governance capabilities in SAP LeanIX, lets companies create and maintain an inventory of agents, MCP servers and LLMs regardless of platform.

SAP also links governance to performance. It argues that the observability needed for governance can be used for performance management and evaluation. With SAP Signavio agent mining capabilities, companies can monitor agent behavior within the context of their business processes, ensuring compliance while capturing the business impact agents deliver.

What it means for enterprise customers

SAP states three principles behind its approach: build on proven business controls, adopt innovation with confidence, and stay in control as the business grows, including the ability to assess costs, risks and value as adoption increases.

Rose argues that because AI involves varying degrees of autonomy, governance must apply to the behavior of the technology itself, not just to the humans managing it, which is why SAP stresses runtime enforcement. He also says that no one has yet established clear industry benchmarks and standard practices for AI governance, and that there is a general lack of established platforms focused on it. SAP presents its own offering as such a platform. These are the company's own claims, and the source gives no pricing or availability details for the new tools.