From Model-Centric Hype to Context-Driven Enterprise AI
Enterprise AI governance is the set of policies, controls, and monitoring practices that ensure AI systems use the right data, follow internal rules, and behave reliably inside business processes so organizations can trust them with real work. At SAP’s Sapphire event, the company argued that enterprise AI is above all a context problem: success depends less on owning the "best" large language model and more on giving agents meaningful business context, safe data access, and clear guardrails. SAP’s Business AI Platform combines its Business Technology Platform, Business Data Cloud, Autonomous Suite, and Business AI services into what it presents as a context layer for mission-critical processes. This marks a shift away from model worship toward an emphasis on AI data context, governance frameworks, and process-aware agents that can operate across finance, supply chain, procurement, human capital management, and customer experience.
Inside SAP’s Business AI Platform: Context as the Differentiator
SAP’s Business AI Platform is positioned as a business AI platform that turns decades of ERP history into an AI-ready context layer. The Autonomous Suite will ship with more than 50 domain-specific Joule Assistants that coordinate over 200 specialized agents embedded in core enterprise workflows. These agents are designed to understand business entities, respect authorizations, and work inside existing compliance rules rather than around them. SAP CTO Philipp Herzig summed up the company’s stance by saying, “What’s not differentiating is the LLMs… Use OpenAI models, use Anthropic models, whatever you like.” The platform focuses on generating the scaffolding enterprises usually struggle with: product requirements, technical specifications, tests, data connections, security setups, observability, and governance. Joule Work then acts as the front door to these workflows, connecting SAP and non-SAP systems without locking developers into a single model or framework.
Data Foundations: Relational ‘Bread and Butter’ Meets New AI
Under SAP’s strategy, AI data context starts with the systems that already run the business. ERP and SAP S/4HANA landscapes, with their structured relational data, remain the “bread and butter of databases,” as SAP Labs U.S. managing director Yaad Oren put it. Rather than chasing every new frontier model, SAP is doubling down on tabular and relational intelligence via its relational pretrained transformer, SAP-RPT-1.5, and technology from its planned Prior Labs acquisition. The goal is to reduce the need for a swarm of narrow predictive models while keeping explainability over rows and columns. Planned acquisitions such as Dremio and Reltio are meant to make the SAP Business Data Cloud an Apache Iceberg-native lakehouse and a master data management backbone. Together, they aim to give agents consistent, high-quality business data and process knowledge, not just a raw data lake.
Governance Frameworks and Agent Mining: The New Control Plane
As AI agents spread across departments, SAP warns that uncontrolled experimentation can quickly become a compliance problem. Its answer is enterprise AI governance as a first-class capability, not an afterthought. The new AI Agent Hub inventories and governs SAP and non-SAP agents, LLMs, and MCP servers and is included for all Business AI Platform customers. It is designed to be a shared control plane where security, risk, and IT teams can see which agents exist, what they connect to, and how they behave. SAP is also introducing “agent mining,” an extension of process mining that tracks what agents did, which actions they took, where they stalled, and whether they followed expected paths. With agents “coming to life,” as Oren said, this level of observability and governance lets organizations treat AI agents with the same oversight they apply to human employees and critical workflows.
Openness, Partner Models, and the Maturing AI Strategy
SAP’s stance reflects a broader maturation in enterprise AI strategy: models are treated as interchangeable components, while context and governance frameworks become the lasting advantage. SAP’s chief AI strategy officer Sean Kask said the company will not build its own general-purpose LLM and instead partners with providers such as Anthropic, Mistral AI, and Cohere. SAP agents are built on open-source frameworks like AutoGen and LangChain, and can move to better options as they emerge. Developers can work in Joule Studio or bring their own tools, from no-code workflows and n8n for orchestration to Vercel for front ends. For SAP, that flexibility is acceptable because the company still owns the context layer: business processes, data models, authorizations, and extensions. In this model, enterprise AI differentiation comes from who controls the data and rules, not who ships the flashiest chatbot demo.