Annual Software Awards · Methodology

How we judge the awards.

One published standard, applied to every edition of the series. It exists so a reader can check our reasoning, and so a vendor can see exactly why an award cannot be bought.

4 editions31 awards issued
The process
  1. 01We start from the full TTML review database and shortlist only products that already hold a published, dated review with a recorded evidence classification.
  2. 02Each shortlisted product is re-read against the current judging criteria during the awards cycle, and any score that no longer reflects the product is sent back for a review refresh before it can be considered.
  3. 03Award decisions are made by the editorial team against the criteria above. Where two products are close, the tie is broken by value for money and by which product we would deploy on our own work.
  4. 04Every award records how the judgement was formed — hands-on testing, documentation review or editorial analysis — and that label is derived automatically from the underlying review, not chosen by the writer.
  5. 05We do not run synthetic benchmarks, publish speed-test tables we did not produce, or reproduce vendor-supplied performance claims as if they were our own measurements.
  6. 06Affiliate relationships are disclosed and have no bearing on any award. Winners are chosen before commercial availability is checked.
Weighted criteria

Software editions are judged on general-purpose buying criteria. Privacy and security editions swap in a stricter set, because architecture and independent verification matter more than convenience when the product holds your secrets.

Software editions
  • Real-world capability25%

    Does the product do the job it claims, on real work, without constant supervision or workarounds?

  • Value for money20%

    Published pricing measured against what a typical buyer actually gets on the plan they will realistically choose.

  • Ease of adoption20%

    Time from signup to first useful output, quality of onboarding, and how much the product assumes you already know.

  • Reliability and support20%

    Stability across a review cycle, transparency about limits and outages, and the quality of documentation and support channels.

  • Trajectory15%

    Shipping cadence, roadmap credibility and whether the product is compounding or coasting.

Privacy and security editions
  • Security architecture30%

    Encryption model, zero-knowledge design, key handling and whether the vendor can technically read user data.

  • Independent verification25%

    Published third-party audits, open-source clients, transparency reports and jurisdiction.

  • Everyday usability20%

    Apps, browser extensions and sharing flows — a secure product people abandon protects nobody.

  • Value for money15%

    Cost of the plan a real household, team or business will actually buy, including family and business tiers.

  • Trajectory10%

    Feature velocity, passkey and post-quantum readiness, and the vendor's track record on disclosure.

Evidence labelling

Every award carries one of three labels. The label is derived from the underlying review's evidence classification rather than chosen when the award is written, so an award can never claim testing the review does not claim.

  • Hands-on testing

    Judged from first-hand use of a paid or trial account by the TTML editorial team.

  • Documentation review

    Judged from vendor documentation, published pricing and verifiable public specifications rather than first-hand use.

  • Editorial analysis

    Judged from structured editorial analysis of the market, public evidence and our own review archive.

Badge policy

Winners may download their badge in SVG or PNG, in a light or dark variant, from the edition page. Use is free and needs no permission, on three conditions: the badge is not altered, it links back to the edition that issued it, and it is not presented as certification, accreditation or an endorsement of a product version we did not review.

Badges are generated from the awards dataset at request time rather than stored as files, so a corrected award cannot leave a stale badge in circulation on our side. Badges name the year they were issued precisely so an old award cannot be presented as a current one.

Commercial independence

The Tool Money Lab earns money from affiliate links. Awards are decided before commercial availability is checked, and several winners in every edition have no affiliate programme at all — on those pages the outbound link earns us nothing and says so.

Where an affiliate relationship exists, the link is marked and disclosed at the point of use. No vendor has editorial input, pre-publication review or influence over award order.

Methodology FAQs

Can a vendor pay for an award?

No. No award has ever been sponsored, sold or discussed with a vendor before publication. Commercial availability is checked only after decisions are made, so a product with no affiliate programme can and does win.

Do you run your own benchmarks for the awards?

No. The awards summarise judgements already published in our reviews. We do not publish speed tests, latency tables or throughput figures we did not produce ourselves, and we never reproduce a vendor's performance claim as if it were our measurement.

What does the evidence label on each award mean?

Each award states whether the judgement was formed from hands-on testing, documentation review or editorial analysis. That label is derived automatically from the underlying review's evidence classification, so a writer cannot upgrade it.

Can a winner use the badge in its own marketing?

Yes, unaltered and linking back to the edition that issued it. The badge states the award and the year. It is not a certification, an endorsement of future versions, or a paid placement.

What happens if you get an award wrong?

We correct the edition in place and change its update date. If the underlying review changes materially, the award is re-examined in the next cycle rather than quietly edited.

Published editions
Awards hub →
Intelligence Brief

Stay Ahead of AI

Receive our weekly Intelligence Brief. Independent AI reviews, comparisons, new tools and practical recommendations delivered every Friday.

  • New AI tools
  • Honest reviews
  • Best AI deals
  • New comparisons
  • Industry trends
  • No spam.