1. Define the question
Every ranking begins with a narrow, useful question. We identify the category, intended reader, geography, product format, price context, and eligibility window. “Best coffee” is too broad; a comparison must say which coffees, for whom, and under what conditions.
2. Publish the rubric first
Criteria and weights are set before final scoring. A category rubric explains what each criterion means, how it is observed, and whether it is objective, measured, or subjective. Material changes are dated and explained.
3. Build a defensible set
Items may enter through editorial research and community suggestions. Inclusion is not an award. We document why products were selected and acknowledge where availability, budget, or access limits the set.
4. Observe consistently
- Record model, variety, size, lot or version when relevant.
- Use repeat trials when consistency is part of the claim.
- Log preparation, serving, location, date, and price context.
- Keep contemporaneous notes rather than reconstructing impressions later.
5. Separate evidence from judgment
Facts such as listed ingredients, package size, or measured price are distinguished from sensory opinions. A score summarizes the rubric; the written rationale carries the real value.
6. Disclose incentives
We disclose free samples, travel or event access, affiliate links, sponsorships, and other relevant relationships. Paid placement cannot purchase a ranking position. Sponsored material, if introduced, will be visibly labeled and separated from editorial scoring.
7. Handle community input honestly
Community ratings are labeled, moderated, and reported separately from editorial ratings. We may use minimum-count rules, anti-abuse controls, and distributions rather than a misleading simple average. Submissions are not automatically published.
8. Correct and revisit
Products change. Prices move. Errors happen. Material corrections should state what changed and when. Rankings may be re-tested or retired when their evidence no longer supports the claim.
Score interpretation
Category pages will define their scales. Scores from different categories should not be treated as directly comparable. Ties and uncertainty are acceptable outcomes; false precision is not.
Questions we expect readers to ask
Can a brand pay for first place?
No. Advertising or sponsorship cannot determine eligibility, score, rank, or wording of an editorial conclusion.
Are all products purchased?
Not necessarily. Acquisition method will be disclosed. A provided sample does not receive favorable treatment, and we may decline samples that create conditions we cannot manage transparently.
Is taste objective?
No. Sensory judgment has subjective elements. A clear rubric, repeated observations, multiple perspectives where practical, and detailed notes make that judgment more useful without pretending it is universal.
Corrections: send a specific claim, source, and requested change through the contact page.