Methodology
How we score
One hundred points. Seven criteria. The same test for a coding agent and a meeting notepad, asked in the language of that job. The number is a form line, not a prize.
| Criterion | Points | Plain test |
|---|---|---|
| Works as claimed | 25 | Did the standard task actually succeed? |
| Good for its stated job | 25 | Would a builder or a professional keep using it for this job? |
| Better than the default option | 15 | Is it better than ChatGPT, Claude, Cursor, or whatever people already use? |
| Time to value | 10 | Minutes from signup to the first useful result. |
| Price and value | 10 | Free tier, price clarity, and cost per real use. |
| Trust | 10 | Privacy policy, data handling, who's behind it, and security basics. |
| Momentum | 5 | Shipping pace and community traction. |
| Total | 100 | Published on the tool page. |
- 1
Two labels, and only two
Every entry is marked Tested hands-on or Reviewed from docs. Issue 00 is entirely Reviewed from docs. The scores are preliminary until a tool goes through the standard task for its category.
- 2
Payment is not a criterion
Featured listings, launch packs, sponsorships, and affiliate tags are stored beside a tool. The score function never reads them. A sponsored tool can sit below an unpaid one, and it often will.
- 3
Scratchings are about the job
A scratching means skip this tool for today's job. It is not a claim the product is bad. A strong image model can be scratched from an app-building card and still carry a high score in its own race.
- 4
Odds-on and roughie
Odds-on is the safe pick for the stated job. A roughie is an underrated pick, not a hidden advertisement. Both are editorial selections on top of the published score.
- 5
Dummy data only
Hands-on tests, when they start, use a brand test inbox and dummy data. We do not test with a reader's accounts or documents.
- 6
Corrections
If a price, link, or claim is wrong, send a correction through the submit form. We would rather fix a line than defend it.
See a score broken down on any tool, starting with Claude or Cursor. Makers can submit a tool. Sponsors can buy a labelled slot.