CLI: Repo Ablations

An environment runs one script in every approved task’s image and builds each task with the change. Run it with compare --environment ID, alone or with each saved harness picked by --saved-harness ID (Evaluate). R is --repo OWNER/NAME.

Command	Does
`environments R`	Each environment and how many of its tasks are ready
`environment create R --name N (--script TEXT \| --script-file F)`	Run the script in every approved task’s image and build each
`environment show\|build\|delete ID R`	Each task’s check; build tasks approved since or that failed; delete it

The script is Bash, run in /app as the image is built, before the agent starts. It stops at the first command that fails, and that task’s build fails with it.

self-bench environment create --repo acme/app --name "No AGENTS.md, Next.js 15.5" \
  --script 'rm -f AGENTS.md CLAUDE.md
pnpm add next@15.5.0'

CLI

API

Public Results

CLI: Repo Ablations