Every prompt, replayable.
For each prompt inside a git repository: the tree before and after the agent stops, the transcript of that turn, the model name and a timestamp.
Your traces become RL environments in real time. You get a share of every sale.
curl -fsSL https://benchturn.com/install.sh | sh
Keys and .env files are never recorded. Any repo with a .gen-ignore file is skipped.
macOS or Linux. Takes about a minute. Read the script.
Records the coding agents you already use
AI labs train and test coding agents on environments: a real repository at a real commit, a task someone actually asked for, and a way to check the result. The best source of those is work that already happened.
For each prompt inside a git repository: the tree before and after the agent stops, the transcript of that turn, the model name and a timestamp.
A secret scan runs on your machine before upload and again at ingest. A capture that trips it is dropped.
Run benchturn past and your own agent finds sessions already on disk. Nothing uploads until you say yes to each.
We email you when a state changes. A session that is not a fit is deleted.
Payouts cover everything owed by the 25th of the month before. PayPal, Wise, or a GitHub sponsorship.
There are no tasks to pick up and nothing to annotate.
One self-contained binary. benchturn init signs you in with GitHub and connects every coding agent it finds.
Uploads run in the background on a timer. Nothing waits on them, and your agent never slows down.
Good sessions on public repositories become environments. When a lab licenses one, your share is added to your pending payout.
Work outside a git repository is not recorded. A lab receives the public repository, the prompts and the transcript, with no account information attached.
.env files.gen-ignore file skips one entirelybenchturn initSet up this machine. Safe to re-run.benchturn statusWhat was captured, queued or failed.benchturn pastHave your agent find and offer past sessions.benchturn accountOpen your portal: sessions and earnings.benchturn ignoreNever record this repository.benchturn pause / resumeStop recording for a while.benchturn delete <id>Delete one capture and tell us to forget it.benchturn uninstallRemove the hooks from every agent.Real work on a public repository: a bug fixed, a feature added, or a refactor carried through on a project other people use, with tests or another way to check the change. Sessions where you steered the agent are the best of all.
When a session is licensed, you get a share of the sale. Payouts go out on the 1st of each month through PayPal or Wise, or we can sponsor a GitHub account instead, such as your own project. Invited contributors also get a $20 welcome payment once their first three sessions are in.
No. Uploads run in the background on a timer and nothing waits on them.
Captures live on your machine under ~/.claude/gen until uploaded, and a copy stays there afterwards. benchturn delete <id> removes one from both places, and benchturn account shows every session.
Run benchturn past. Your agent follows public instructions to find qualifying sessions, checks each for private material, and shows you the list first.
curl -fsSL https://benchturn.com/install.sh | sh
macOS or Linux, with git. Read the docs.