revision-detector-experiment
An Agent Skill for running a sequential text-revision experiment in which the Pangram AI-text detector is an observed outcome, never a target.
The agent revises one text step by step, each step for an editorial objective fixed in advance. After every step Pangram evaluates the new version. The skill keeps the plan frozen, takes one revision per step, checks that facts survive, and produces a chart and a report that separate what the detector said from any claim about authorship.
It is a measuring procedure. It is not for making a text pass a detector, and it tells the agent to decline that.
Contents
SKILL.md — the rules and the procedure.
references/method.md — why each rule exists, the files of an experiment, the assessment, the measures, the stop rule.
references/pangram-api.md — what was verified about the Pangram API on 2026-11-10 and what was not.
references/report-format.md — the five report files and how to present results.
references/default-plan.md — the default ten-step editorial plan.
scripts/experiment.mjs — the command-line tool (Node.js 20 or later, no dependencies).
scripts/lib/ — the engine, identical to the one in @spboucher/pangram-experiment-mcp.
Requirements and cost
Node.js 20 or later and a Pangram API key in PANGRAM_API_KEY. Each evaluation sends the text to Pangram, a third-party service, and is billed to the key. Do not submit confidential text. A default experiment makes 11 evaluations.
Install
skills install @spboucher/revision-detector-experiment --client claude-code
Quick look
node scripts/experiment.mjs doctor
node scripts/experiment.mjs init --file original.txt --max 3 --fact "The vote was 5 to 2."
node scripts/experiment.mjs baseline
node scripts/experiment.mjs next
node scripts/experiment.mjs submit --file step01.txt --assessment step01.json
node scripts/experiment.mjs status
node scripts/experiment.mjs report
Limits
One text, one run: no general or causal claim. A detector score is not evidence of who wrote a text. Preservation figures are word-overlap proxies; quality scores are the agent's own. The tool guarantees one submission per step; it cannot see how the revision was written. Pangram's error formats, rate limits and billing were not verified. Tested on macOS with Node 26.
Licence
MIT.