One feature, from the prompt to the merged pull request.
Every step Great_cto took on one real task: who did it, what it cost, and where you were asked to decide. The files it produced are public, so you can check each one.
From the prompt to the merge.
Model tokens, estimated per step.
The plan and the ship. About 30 seconds each.
Shipped, plus the test setup.
What is measured and what is not.
- Real: the files, the commits, the merged pull request and the test result. Run the test yourself to get the same numbers.
- Rebuilt: the times come from commit times and planning notes, not from a recording. The order is right; some steps overlapped.
- Estimated: the cost of each step, from typical token use for prompts of that size. It can be off by about 30%.
- Old: this is an early version of Great_cto (2.8.0). It is a record of one run, not a benchmark of the current app.
Twelve steps. You were asked twice.
The task: ship a domain pack for voice-AI products, so their consent and caller-ID checks start on their own when such a project is found.
Describe the task: a voice-AI pack covering call consent, recording consent by state and caller ID.
Reads two existing packs, sets what a pack must contain, and lists five threats specific to voice.
Approve four checks for the pack. Move a phone-menu add-on to a later version.
Splits the work into four tasks that do not depend on each other.
The pack description (65 lines), its reviewer role (200 lines), four test scenarios, and the detection rule in the app with its tests.
Checks that each scenario covers a different threat and can actually fail.
Finds that nothing limits which tools the voice agent may use, and sends it back.
Adds the rule to the reviewer role and hands it over again.
47 of 47 checks for this pack, 456 across all ten packs.
See the files, the gap and its fix, and the test result. Approve the merge.
Merges pull request #22 at 17:17:48.
Saves the pattern every pack follows, so the next one starts from it.
Everything above links to the source.
The test
Run it in a clone of the repository:
node tests/run-packs-e2e.mjs