AWS has launched a new, stateful runtime environment for AI agents in Amazon Bedrock, developed in collaboration with OpenAI. This environment supports long-running, complex AI workflows that keep context and memory across multiple steps and sessions.
Key Features and Benefits
This new stateful runtime marks a major change from traditional stateless AI runtimes, which handle each request separately.
- Persistent context and memory: agents maintain a consistent context, including conversation history, tool state, and identity boundaries. Developers no longer need to build external state management systems.
- Long Running Tasks: The runtime manages complex, asynchronous workloads and multi-step processes for hours or days. Agents work independently on projects like customer support, IT automation, or data processing.
- Simplified production deployment: teams focus on business logic as orchestration and state are fully managed by the new architecture.
- Integration with the AWS Ecosystem: This environment operates within the customer’s AWS environment and integrates with AWS security tools and identity systems, such as Amazon Cognito, as well as governance tools.
- Powered by OpenAI Models: The Runtime Environment incorporates models from OpenAI that have been specifically optimized for AWS and are offered through Amazon Bedrock as part of the AWS OpenAI partnership. Microsoft Azure will still be the only provider of stateless OpenAI APIs.
Impact on Enterprise AI
This AWS OpenAI partnership indicates a shift toward agentic infrastructure as a platform for businesses. This means:
- Accelerated development: It reduces the time to production-ready AI agents from months to weeks.
- Improved capabilities: It allows for more advanced applications, such as customer support across multiple systems, sales operations workflows, and internal IT automation with approvals and audits
- Governance and control: The architecture provides a managed pipeline using an AI-driven lifecycle (AI-DLC) framework that assesses agents for performance, cost, and security before deployment.
The stateful runtime environment should be available through Amazon Bedrock in the next few months.
AI agents are great at reasoning, but the real challenge is making sure they can reliably handle multi-step tasks over time using real tools and systems with proper controls.
Today, we are making this easier by partnering with Amazon to launch a new stateful runtime environment that runs directly on Amazon Bedrock. AWS customers can use this environment, powered by OpenAI models and optimized for AWS, to support agent workflows with the state reliability and governance needed for production.
Making It Easier to Bring Agents Into Production
Many Agent prototypes based on stateless APIs tackle simple use cases:
- One prompt
- One answer
- Maybe one call to a tool.
Production work is different. Real workflows unfold across many steps. They require context based on previous actions. They depend on multiple tool outputs, approvals, and system state, and need trusted guardrails to secure environments.
With stateless APIs, development teams must build the orchestration layer themselves. They need to decide how to store state, call tools, handle errors, and safely resume long-running tasks.
The Stateful Runtime Environment is built to make this easier. It runs within your AWS environment and works well with AWS services. Instead of assembling separate requests, your agents can now automatically handle complex tasks with context-carrying forward memory, workflow state, environment, use, and permission boundaries.
What Can You Do With This
Now it’s easier to build solutions like:
- multi-system customer support
- sales operational workflows
- internal IT automation
- financial processes that include approvals and audits
Faster Time to Production for Multi-Step Workflows
When the runtime manages orchestration and state across steps, teams can focus on the workflow and business logic rather than building additional support systems.
Designed For Long-Running Tasks
Stateful tasks are built to run reliably over time, keeping the context and control boundaries needed for multi-step work.
AWS Native Deployment and Governance
To understand how this stateful runtime can benefit your organization, reach out to your OpenAI team or request a contact from us today.
Source: Introducing the Stateful Runtime Environment for Agents in Amazon Bedrock
