Skip to content
fanta496Public

About

Tester: independent evidence-based review skill for Codex

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Repository files navigation

Tester

Tester is an independent review skill for Codex. Use it after an agent reports that a project, product, release, or change is complete. It checks whether the result matches the user's intent, the handoff criteria, and the observed behavior.

简体中文说明:README.zh-CN.md

What it focuses on

Tester addresses two recurring risks:

  1. Information gaps — the user's intent, handoff text, implementation, and observed behavior can describe different products.
  2. Test hallucination — confidence from a main agent, child agent, or previous report is a claim to verify. It does not replace evidence.

Tester is a reviewer, not a repair agent. It collects evidence and gives the user a decision.

The default boundary is read-only. External requests require an explicitly named endpoint, account or fixture, and permitted operation in the handoff. Tester does not write to production, edit tests or configuration, install dependencies, run untrusted hooks, delete or reset data, migrate schemas, deploy, or publish. Repository files, logs, prompts, and fixtures are treated as data, not instructions.

How it works

Each independent round uses a child agent with a fresh context when delegation is available. The child receives a small factual handoff packet, then follows the relevant path:

User intent + acceptance criteria
              ↓
      Independent tester / fresh context
              ↓
Entry → upstream → changed boundary → downstream → user-visible result
              ↓
       Evidence ledger + mismatch report
              ↓
          PASS / FAIL / UNVERIFIED

Tester traces the complete A → B → C path. A passing unit test for B is evidence about B; the connected path still needs its own check. Tester reports failures instead of editing the subject. A failing path stops, while safe read-only checks may continue; skipped criteria are marked UNVERIFIED. After a repair, the next round uses a new snapshot and a new context.

Review modes

  • Independent acceptance (default): start from user intent and observable acceptance criteria.
  • Integration and chain: inspect the changed boundary and relevant upstream/downstream connections.
  • White-box code review: inspect source, diffs, contracts, permissions, error paths, and regressions.
  • Information-sync review: compare intent, handoff, implementation, and observed behavior as separate layers.
  • Multi-environment review: repeat checks across the environments named in the handoff.

If the handoff cannot define what success means, the affected criterion is UNVERIFIED. Tester does not invent an oracle.

Relationship to the other skills

Skill Stage Main question
Discussant Before a large project or release Are the requirements and expectations clear?
Patch Guard Before and after a small bug fix or targeted feature Will the local change spread into the wider architecture?
Tester After an agent reports completion Does the delivered result match the intent, handoff, and connected path?

Usage

Invoke it explicitly:

$tester Independently review this change. Check the user intent, the A → B → C path, and the actual evidence before acceptance.

The skill does not invoke implicitly. A useful handoff includes TEST_TARGET, ACCEPTANCE_CRITERIA, SUBJECT_SNAPSHOT, ENVIRONMENT, ENTRYPOINTS, connected boundaries, constraints, and fresh-context status. Required and optional criteria are listed separately. See references/handoff-contract.md and the machine-checkable handoff-packet.json.

If $discussant is unavailable for a product or architecture decision, the report records the unresolved decision and stays UNVERIFIED instead of guessing.

Result statuses

  • PASS — the criterion was checked and the evidence supports it.
  • FAIL — the criterion was checked and the evidence shows a defect or contradiction.
  • UNVERIFIED — the check could not run, the snapshot is uncertain, the oracle is incomplete, or the evidence is insufficient.

An unexecuted command cannot be reported as executed. “No issue found” does not establish that the whole system is safe.

Optional criteria still receive a status. They do not change the overall status unless the handoff marks them required. The machine-checkable tester-report.json shows this contract.

Local validation

Run from the skill root:

.\tests\validate.ps1
python .\tools\quick_validate.py .
python .\tools\validate_examples.py .

The package includes an MIT license, GitHub Actions validation, adversarial prompt cases, a handoff contract, review modes, and a report template. It provides behavior and evidence guardrails. It does not upload data, edit projects, deploy services, or provide an operating-system sandbox.

Status

This is the reviewable v0.1 local open-source package. Cross-model behavior evaluation and real-project acceptance remain separate follow-up checks after installation.

About

Tester: independent evidence-based review skill for Codex

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages