Skip to content

docs: add design note on merging ranks into importance - #855

Merged
brawer merged 1 commit into
mainfrom
importance-note
Oct 27, 2026
Merged

brawer merged 1 commit into
mainfrom
importance-note

Conversation

@brawer

@brawer brawer commented Oct 27, 2026

Copy link
Copy Markdown
Owner

Adds docs/notes/2026-10-27-merging-ranks.md, a short design note on how the importance column (#713, #853) merges its three signals:

  • why OSMViews, QRank and the category score are each turned into quantiles first;
  • the reference populations, and why brand IDs without pageviews count as no brand;
  • how a missing brand drops out of the weighted mean;
  • why the category scores are hand-made (from MatchMask) and not derived from QRank medians;
  • how the 0.4/0.3/0.3 weights were picked with pair tests;
  • why the final score is a quantile again, what was left out, Swiss results, and how to evaluate changes.

TECHNICAL_DESIGN.md links to it from the conflate step.


Generated by Claude Code

Explains how the importance column combines OSMViews, QRank and the
MatchMask category score: why each is turned into a quantile, how a
missing brand drops out, why category scores are hand-made, how the
weights were chosen, and how to evaluate changes. Linked from the
conflate step in TECHNICAL_DESIGN.md.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_015Nw5ZNMD34EwRUnASRv4jy
@brawer brawer self-assigned this Oct 27, 2026
@github-actions github-actions Bot added the documentation Improvements or additions to documentation label Oct 27, 2026
@brawer
brawer merged commit 0706845 into main Oct 27, 2026
6 checks passed
@brawer
brawer deleted the importance-note branch October 27, 2026 05:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants