Privacy

What we store

When you check a skill, we store the skill file or link, the security review result, and the analysis output.

When you run a measured test, we store the original and improved versions, the tasks used, the run transcripts, and the results. We also store which model and effort level were used, so the same test can be rerun with the same settings.

If you sign in, we store the account ID your sign-in provider gives us, your name, picture and, for GitHub, your username, and the list of checks and tests you've run.

How long we keep it

Nothing is deleted automatically. We keep results by content hash, so checking the same skill twice reuses the earlier analysis and test instead of running again.

When you remove a check from your account, it stops appearing in your history and in public view. The stored result is kept, so if the same skill is checked again by anyone, we reuse that result instead of analyzing it again.

What a test actually does

A measured test runs your skill in an isolated container with no network access. The sandbox has a temporary workspace. Two versions run several times each on the same tasks: the original and the lighter version. Results are graded blind, without knowing which version produced each answer.

Every version runs on Anthropic's Claude models, so your skill and the test tasks are sent to Anthropic. A check also sends your skill to our security review service.

Signing in with GitHub or Google

When you sign in with GitHub or Google, we use it to identify you. We store the account ID it gives us, with your name and picture, and for GitHub your username, to connect your checks and test history to your account. We don't keep the access tokens they give us.

Both providers also tell us your verified email address. We store a one-way fingerprint of it, so that if you sign in with the other provider and it has verified the same address, you land in the same account instead of a new one. You can connect or disconnect a provider from your account page; connecting an account that already has its own history here moves that history into the account you're signed in to.

We also store the verified email address your sign-in gives us, only to email you about your tests. You can turn email off on your account page or with the link in any email we send.

Your choices

You can check a skill without signing in. Measured tests require sign-in and count against your daily free allowance.

You can remove any check or test from your account in your history. Public sharing of a check or test result is optional; the URL is unlisted by default.