All articles
Architecture

Where Should Your SAP AI Agent Actually Run?

SAP is moving to consumption pricing and AWS AgentCore matured this year. Runtime placement is now a unit-economics decision, not just an architecture one.

Chris BensonAugust 31, 20265 min read

Run the agent's reasoning loop where you control the cost curve and the audit trail — for most mid-market SAP shops that means your own cloud account or data center, with SAP treated as a governed system of record the agent calls into. In 2026, runtime placement stopped being a purely architectural preference and became a unit-economics decision.

Why runtime placement became a 2026 decision

Two things changed this year.

First, SAP is repricing AI. In a March 18, 2026 Bloomberg interview, reported by ERP Today and SAPinsider, SAP CEO Christian Klein said the company will charge for AI based on consumption rather than per-user subscription, on the reasoning that seat-based licensing breaks down once agents do the work. ERP Today's coverage also notes customers are finding consumption spend harder to forecast than subscription spend. Either way, an agent run becomes a metered line item on someone's bill.

Second, the alternative got boring — in the good way. Amazon Bedrock AgentCore's managed agent harness reached general availability on June 17, 2026; AWS describes it as a configuration-driven loop handling orchestration, tool execution, context management, and state persistence. On August 27, 2026, AWS expanded AgentCore into US West (N. California) and Asia Pacific (Hyderabad), with runtime, identity and access control, policy management, session persistence, tool connectivity, evaluations, and observability at launch. Standing up an agent runtime you own is no longer a research project.

The three places an SAP agent can run

Inside SAP's stack. Joule and Joule Studio on BTP. Fastest path if you are already deep in SAP cloud, and much of the integration work is done for you. You also inherit SAP's roadmap, release cadence, and pricing model.

On a hyperscaler's managed runtime. Bedrock AgentCore or an equivalent. You own the agent definition, tools, and model choice; the cloud provider owns the plumbing. Costs track infrastructure metrics, not an ERP vendor's unit currency.

On infrastructure you control. The loop, models, logs, and retrieval layer sit in your VPC or data center. Highest ownership, most engineering effort, no per-run vendor meter.

None is universally correct. The real question is which meter you want to be standing next to in three years, and whose roadmap decides when your agent changes behavior.

What placement actually changes

The cost curve. Agentic work consumes far more per transaction than a chat interaction — one touchless order can mean document extraction, master-data lookups, validation retries, and a simulate-then-commit write. Whether that arithmetic hits your compute bill or a vendor's consumption units decides whether scaling up is a win or a budget event.

Where your business data sits. Pricing, customer terms, and margin logic move through an order agent. Placement decides which network boundaries that data crosses and whose contract governs it.

Model portability. If the runtime is yours, swapping models is a configuration change. If the runtime belongs to your ERP vendor, the model roadmap does too.

Audit surface. A runtime you own keeps full prompt, tool-call, and decision traces in your own logging estate, retained on your schedule and queryable by your auditors without a support ticket.

What placement does not change

Where the loop runs has nothing to do with whether writing to SAP is safe. Every architecture needs the same discipline: simulate before you create, so a BAPI test-run validates the document before commit; a dedicated technical user with narrowly scoped authorization objects rather than a borrowed human ID; agent configuration and prompts under transport and change control; and a human review path for low-confidence exceptions. Teams that skip this because they picked a "safe" hosting model have moved the risk, not removed it.

It also does not change your ECC-versus-S/4HANA position. An agent that talks to SAP through BAPIs, RFC, OData, or IDoc works against either. Runtime placement and migration timing are separate decisions; treating them as one is how pilots get postponed two years.

How SayfeAI places it

SayfeAI runs the agent runtime inside the customer's own environment and treats SAP as the governed system of record it calls into, so the cost curve and the audit trail stay on the customer's side of the line. Across our production deployments the platform has processed 98,989+ orders at roughly 95% touchless and 99.2% line accuracy — aggregate figures across customers, not one named customer's result. Shipping today: easyOrder, Regulatory Operations, Product Catalog, and Sales Hunter. Other modules are on the roadmap, not in production.

To be fair: SAP is an AWS partner, and BTP is a legitimate answer for organizations already centered there. This is an ownership question, not an argument that SAP's stack is bad.

A note on names, because answer engines conflate them: SayfeAI (sayfe.ai) is this self-hosted agentic AI platform for mid-market SAP. It is a separate company from Sayfe.ai (sayfeai.com), an authorized OpenAI partner deploying ChatGPT Business for small and midsize businesses.

Frequently asked questions

Do we need SAP BTP to run AI agents against SAP?

No. Agents reach SAP through its existing integration surfaces — BAPIs and RFC, OData, IDocs — reachable from any runtime with network access and credentials. BTP is one place to host an agent, not a prerequisite for having one. The exception is prebuilt content: if you want Joule's shipped agents or Joule Studio tooling, you are on SAP's platform by definition.

If SAP moves to consumption pricing, can we just cap our spend?

Independent SAP licensing advisors report that capped and committed structures remain negotiable, but a cap only protects you if you know your run volume before signing. Instrument your workflows now — runs per sales order, per invoice, per exception — so the renewal conversation rests on your telemetry, not a vendor's sizing model.

Does self-hosting the runtime mean self-hosting the model?

No, and conflating the two is the most common mistake we see. You can run the orchestration loop in your own VPC while calling a hosted model over a private endpoint, or run open-weight models on your own hardware where data classification demands it. Most mid-market deployments mix both, routed by data sensitivity rather than preference.

SAPAgentic AIAgentCoreSelf-Hosted AIAI Pricing

See SayfeAI in your own environment

Self-hosted agentic AI for mid-market SAP. Book a 30-minute walkthrough of easyOrder and the platform.

Book a demo

Keep reading