evals/scenarios/worktree-codex-detached-head.yaml

scenario: worktree-codex-detached-head
description: "Agent detects externally managed worktree with detached HEAD"
user_posture: naive

setup:
  helpers:
    - create_base_repo
    - add_existing_worktree
    - detach_worktree_head
  workdir_override: "../${WORKDIR_NAME}-existing-worktree"
  assertions:
    - "git rev-parse --is-inside-work-tree"
    - "test -z $(git branch --show-current)"

turns:
  - intent: >
      Ask the agent to help you get set up for building
      a dashboard feature. Mention you're not sure if the
      current environment is ready. Do NOT mention worktrees
      or isolation specifically.

limits:
  max_turns: 15
  turn_timeout: 120

verify:
  criteria:
    - "Agent detected it was in an externally managed worktree (detached HEAD)"
    - "Agent did NOT attempt to create a new worktree"
    - "Agent worked in (or proposed working in) the existing detached-HEAD worktree rather than creating a new one"
  observe: true
Lift drill into evals/ at 013fcb8b7dbefd6d3fa4653493e5d2ec8e7f985b rsync of obra/drill@013fcb8b7dbefd6d3fa4653493e5d2ec8e7f985b into superpowers/evals/, excluding .git/, .venv/, results/, .env/, __pycache__/, *.egg-info/, .private-journal/. The drill repo is unaffected by this commit; archival is a separate manual step after this PR merges. Source SHA recorded at evals/.drill-source-sha for divergence detection. 2026-05-06 12:15:46 -07:00			`scenario: worktree-codex-detached-head`
			`description: "Agent detects externally managed worktree with detached HEAD"`
			`user_posture: naive`

			`setup:`
			`helpers:`
			`- create_base_repo`
			`- add_existing_worktree`
			`- detach_worktree_head`
			`workdir_override: "../${WORKDIR_NAME}-existing-worktree"`
			`assertions:`
			`- "git rev-parse --is-inside-work-tree"`
			`- "test -z $(git branch --show-current)"`

			`turns:`
			`- intent: >`
			`Ask the agent to help you get set up for building`
			`a dashboard feature. Mention you're not sure if the`
			`current environment is ready. Do NOT mention worktrees`
			`or isolation specifically.`

			`limits:`
			`max_turns: 15`
			`turn_timeout: 120`

			`verify:`
			`criteria:`
			`- "Agent detected it was in an externally managed worktree (detached HEAD)"`
			`- "Agent did NOT attempt to create a new worktree"`
			`- "Agent worked in (or proposed working in) the existing detached-HEAD worktree rather than creating a new one"`
			`observe: true`