Before you begin
- Sign in with an approved account. See Quickstart.
- The console works in your tenant’s Default organization. There’s no organization or tenant switcher. See Organizations and roles.
The sidebar
Who sees what:
- Billing appears only for members with the billing, admin, owner, or primary owner tenant role.
- The other screens appear for anyone whose role includes Managed Agents access. Actions that change something need the developer or admin role.
Agents
Click Create agent to open the create form. Choose the Blank card to start from an empty definition, or a template card to start from a ready-made evaluator, then fill in the sections:
Saving an agent publishes a new immutable version. Sessions already running keep the version they started with. Open an agent and click Start session to launch it with that agent preselected. An agent’s Memory tab shows what it has learned.
Skills
Click Create skill to add a skill, or New group to create a group that attaches several skills at once. Search by name, description, or id. Archive a skill or group from its actions. See Skills.Sessions
The list shows the sessions in the organization. Filter by Status, Agent, agent tags, or your own metadata, or search by text.Launch a session
1
Open the launch form
Click Launch session on Sessions, or Start session on an agent’s page to preselect it.
2
Choose the agent and environment
Under Agent, choose the Agent and the Environment.
3
Grant only what the task needs
Under Credential access, choose the vaults or individual credentials this run receives.
4
Describe the task
Under Task, enter the Opening message. To grade the result, tick Grade this session against a rubric and write the Rubric.
5
Choose how the agent works
Under Team, choose whether the agent may work as a team. Under Files, add files from your library. Under Custom metadata, add up to 32 key and value pairs you can filter on later.
6
Start the work
Click Launch session. The session opens while its sandbox is prepared.
max_iterations, so the agent revises until the grader is satisfied. To cap grading passes, start the session with the API. See Outcomes.
Inspect a session
The center of a session is its Transcript: messages, tool calls, and results as they happen. Click Outcome above it to see the grader’s result for each pass and each criterion. The panel beside the transcript has these tabs:
The header shows the status, execution state, duration, and usage. From it you can:
- Click Model cost to see what the session and its whole tree cost.
- Click Ask to ask the session analyst questions about the run.
- Send a follow-up from the composer at the bottom, with Attach image or Attach from Files to include an image or document. A stopped session resumes.
- Interrupt the current turn from the live indicator while the agent works.
- Open the actions menu for Hard stop…, which cancels the work and tears down the sandbox, or Delete session….
Environments
Click Create environment, then set:- Name, and Runtime. Choose Agent runner for managed compute. The runtime can’t be changed later.
- Internet access: No access by default, or Enabled.
- Compute: CPU and memory, or Let the platform size it.
- Storage and lifecycle: Workspace disk (GiB) and Idle stop after (seconds).
- A setup script, optionally started from a template, with a Setup timeout (seconds).
Memory
The table lists each agent with its Memories count, Learning status, and Last updated time. Open an agent to search its Memories by text or Topic, read a memory and its History, see each update under Activity, and set the Memory model. See Memory.Files
Click Upload file to add files, with an optional Expires and Purpose. Filter by source to see Uploads or Session outputs, preview a file, download it, or open the session that produced it. See Files.Automations
Click New automation, choose the agent version and environment, write the Agent instructions, and add Schedule, Slack, GitHub, or Webhook triggers. New automations start paused: try one with Run now, then Resume it. Open an automation for its runs and Schedule status. See Automations.Event sources
Create a Slack Events API, GitHub webhook, or Custom webhook source, choose its verification credential, and copy the Callback URL to the provider. The list shows each source’s Status, Triggers, and Delivery health. Sources from connected Slack and GitHub accounts appear here too. See Receive events.Analytics
Choose Usage, Completions, Environments, or Quality, and a time range from Last 24 hours to Last year. Charts and the Agents, Tools, and Models tables cover every session in scope. See Analytics.Evaluations
Overview charts quality for one evaluator by agent version and criterion, Evaluators lists your evaluator agents, and Runs lists evaluation runs. To start one, select sessions on Sessions and click Evaluate selected. See Evaluations.Credential vaults
Click Create vault and name it. Open the vault and click Add credential to store an MCP token, an environment-variable secret, or a webhook signing secret, and to limit which hosts it may reach. Secret values are write-only: the console shows how each credential is stored, never the value. See Vaults.Integrations
The screen lists your organization’s connections under Integration connections, with each one’s state, what uses it, and the result of its last check. Click Add integration to connect GitHub, Slack, Jira, Confluence, Loom, or LaunchDarkly by signing in, or to pick an app from the catalog and choose the tools agents may use. A row’s menu has Check, Tools, Reconnect, and Disconnect. Then grant the app in an agent’s Integrations section. See Integrations.API keys
Click Create key, then set Name, Expires, and Scope. The key is shown once. Revoke a key from its row’s actions. The list shows only your own keys. See API keys.Billing
The top of the screen shows your Credit balance and Payment method. Click Buy credits to buy prepaid credits, Manage cards to change cards, and follow a purchase’s Receipt link under Purchases. See Billing.What can go wrong
Next steps
Quickstart
Run a graded task from start to finish.
Sessions
Look up every start field and how to follow a session.
Session operations
Continue, interrupt, stop, or delete a session.
Usage and cost
Read model cost for one session or a whole tree.