Skip to content
Flows

What Flows just did

Based on your request to build Stand Up an Adversarial Verification Agent, Flows created 4 implementation stages and 12 checks.

You asked for: Create a verification agent with read-only constraints, mandatory command evidence, adversarial probes, and a structured verdict that gates the implementer's completion claim.. Flows generated 4 stages because the application requires A verifier agent definition with edit/write tools removed from its pool; Every check backed by evidence: the command run and the output observed; At least one adversarial probe per verification (boundaries, concurrency, idempotency). Each stage tells your AI builder what to do, tests whether it actually worked, and gives a repair instruction when it fails. These checks are designed to catch: The verifier 'fixes' issues it finds, silently becoming a second implementer; Checks reported as passed with no command output - verification theater; Happy-path-only testing that is fooled by the first 80% looking right.

Example failure

The form reported success, but no database record was created.

What Flows does

Flows detects the failure, generates a repair instruction, reruns the test, and stores the passing evidence.

Stages — Plan → Build → Test → Fix → Prove → Ship

4 stages · 12 checks · progressive disclosure — open a stage for details

Copy to external builder

Copies a prompt for Claude/Cursor/etc. Records prompt_copied only — not execution, commits, or checks.

Execute through Oort

Requires Sign in with Oort + a provider connection (BYOK). Keys stay on Oort. A model name in the dropdown is not the same as a live connection.

Next

Check off: Edit/write tools absent from the pool (asserted …

Add a proof note on each check — a checkbox alone is weak proof.

Probes & advanced tools are under “More verification tools”. Experience level: Settings.

Stand Up an Adversarial Verification Agent
Agent QA & Security90-150 minutes

Project (saved with proof)

Project binding: Unbound — complete project binding before trusting this run · missing repositoryUrl, repositoryStartCommit, environment, stack

More verification tools (probes, timeline, adapters)Show

App persistence (create → read → assert token)

Body template: {"probe":"{{token}}","title":"flows-probe-{{token}}"}. Needs CORS-readable public create/list endpoints (or inconclusive). Badge only when create→read→refresh finds the token (detects false success).

Two-account authorization (User B cannot see/change User A)

Authorization evidence source: Cross-account ownership test (trust level 5/6). These are not equivalent. Unauthenticated probe alone is weaker (source: unauthenticated API probe). Tokens stay in this browser session only — not uploaded to Flows servers.

Generated edge-case tests (review / approve)

  • api_probe Submitting the form empty is rejected with a clear error
  • api_probe Each required field can be omitted and fails validation
  • api_probe Malformed email is rejected
  • api_probe Malformed phone is rejected when phone is collected
  • api_probe Duplicate submission does not create two records
  • api_probe Double-click submit creates only one record
  • false_success_probe Failed request does not show success
  • browser_automation Refresh during submission does not leave corrupt state
  • api_probe Oversized input is rejected
  • api_probe Unsafe strings do not execute or break storage
  • api_probe Create then refresh still shows the record
  • api_probe Edit then refresh keeps the edit
  • api_probe Delete then refresh removes the record
  • api_probe Nonexistent record ID fails cleanly
  • cross_account_probe Cross-user record identifier is rejected

Generated from this route’s signals — you approve; you do not invent security tests.

Content probe (GET body contains text)

In-product content probe reads response text when CORS allows — not full DOM/click automation. Playwright script is optional and external.

Proof strength

thin · 0/100

Heuristic from notes + probes + gates — not a production certification.

Verification adapters

  • Deploy URL probe · idle
  • API path probe · idle
  • Authz probe (unauth → 401/403) · idle
  • Browser persistence · idle
  • App persistence (create→read) · idle
  • Content / body text probe · idle
  • In-product Playwright DOM · not embedded (download external script)

Filled circles = available here. Empty = not shipped. Probes are not a production audit. Adapter docs

0/4 steps0%
Recording plan identity…

Step 1 of 4

Not started

Define the verifier with hard read-only constraints

Constraints in the tool pool, not just the prompt.

Flows keeps plan, checks, failures, and next steps connected

Your AI tool writes or changes the code

Repository grounds the plan only after inspect

Checks always carry a validation tier

Not checkedChecks not locked

How this plan was created

Plan from project details

Flows creates steps using the goal, requirements, stack, platform, and details you provide.

  • Project description
  • Selected template / route
  • User-entered stack
  • Constraints and notes
  • Stand Up an Adversarial Verification Agent

No repository inspection implied. Connect and inspect a codebase to ground steps in real files.

Codebase access

Checking GitHub…

Or paste a repository URL manually
Plan instructions

Use these instructions in Claude, ChatGPT, Cursor, Emergent, or another builder.

Create the verification agent definition. Tool pool: remove edit/write/file-creation tools entirely - the constraint must be structural, so a verifier that decides to 'just fix it' physically cannot; allow read, search, and command execution (it must run builds and tests). Prompt: state the role ('verify, never repair'), the evidence rule (every claim needs the command run and output observed), and the verdict format. Add a critical reminder mechanism that re-injects the read-only constraint every user turn - long verification sessions are exactly where agents forget their role. Permission mode: command execution should surface to the parent's approval flow rather than running silently. Verify the constraint by asking a test instance to fix a trivial bug: it must refuse and report instead.

The AI tool writes code — Flows only organizes the plan · Complete implementation prompt with explicit requirements

Project context

Copies the project goal, technical details, current step, previous progress, and checks so your AI tool understands what it is working on.

Expected after this step

A verifier agent whose tool pool enforces read-only and whose constraints self-refresh.

Should not happen

  • The verifier 'fixes' issues it finds, silently becoming a second implementer
  • Checks reported as passed with no command output - verification theater
  • Happy-path-only testing that is fooled by the first 80% looking right
  • The implementer summarizes the task for the verifier, laundering away the failed requirements

Verify gate — prove this step works before continuing

Do not move on until every check is true. Add proof notes — a checked box alone is weak proof. Checks are manual by default; deploy/API probes live under “More verification tools” and do not auto-check boxes.

Do not continue if…

  • !The verifier 'fixes' issues it finds, silently becoming a second implementer
  • !Checks reported as passed with no command output - verification theater
  • !Happy-path-only testing that is fooled by the first 80% looking right
  • !The implementer summarizes the task for the verifier, laundering away the failed requirements

Repair path — if this step fails

Use the Repair Prompt when a verify gate fails. Loop: Detected → Diagnosed → Repair issued → Changed → Retested → Resolved

Show repair prompt textShow

The verifier edited a file through a shell command. Command execution is a write path too: route its commands through your security pipeline with write-operations gated, or run verification in a disposable worktree so any mutation is contained and detectable.

Your notes for this step

Definition of Done

Final route-level requirements. Manual checks — separate from per-step verify gates. Completing step gates does not auto-check these. Route completion is not a production-ready claim.

0/4 · manual