Environments
How each variant's sandbox is prepared.
environments defines the sandbox conditions around the agent, such as installed tools, fixtures, or external integrations. Use environments when you want to compare how agents perform under different surrounding conditions.
Accepted shapes:
# String form: one setup script with a generated environment name.
environments: "pip install -r requirements.txt"
# Object form: one named environment.
environments:
name: workspace
setup: "pip install -r requirements.txt"
# List form: multiple named environments.
environments:
- name: workspace
setup: "pip install -r requirements.txt"Environment object
An environment object names one sandbox setup condition. Its setup prepares the sandbox before the agent receives the prompt.
| Field | Required | Type / values | Notes |
|---|---|---|---|
name | Yes | Kebab-case string | Environment coordinate. Recorded for filtering in Results. |
setup | Yes | Setup | Prepares the sandbox before the agent runs. |
description | No | String | Human-readable notes. |
tags | No | String list | Free-form labels. |
commit | No | String | Source commit of the environment under test. |
Bare environment strings are shorthand for an environment whose setup is that string.