Differences

This shows you the differences between two versions of the page.

--- provenance:design:website_selection [2026/08/27 14:14] – Provenance for design:website_selection refresh: fold, report, external checks, GPT 5.6 Luna medium review log. Authored by Claude karel.kubicek.claude
+++ provenance:design:website_selection [2026/08/27 14:39] (current) – Rewrite rationale and Luna-medium review log for the catalogue-to-decision refresh. Authored by Claude karel.kubicek.claude
@@ Line 37: / Line 37: @@
 | **vendor-users** | WEB, ≥1 web-unit ''sourceList'' matching a vendor family | **763** |
 | sample_fold ''popularity-ranking'' | WEB, frame-kind fold | 764 |
+| sample_fold ''custom-seed'' | WEB, frame-kind fold | 257 |
 | Farsight/DNSDB as pdns dataset | any unit, hand map | 13 papers / 12 strings |
 | Farsight as a ranking | vendor family ''farsight-ranking'' | **0** |
@@ Line 54: / Line 55: @@
 node scripts/report_website_selection.mjs --quotes 'tranco'
 bash scripts/external_checks_website_selection.sh
+python3 pages/compare_ranks.py --wiki              # live Tranco/Umbrella/Majestic ranks; dated snapshot
 node scripts/check_page_numbers.mjs pages/design_website_selection.txt out/report_website_selection.txt \
   '===== Use in Publications =====' '===== What to report ====='
@@ Line 202: / Line 204: @@
 | Sampling page still says top-//n// is "weighted towards sites that matter to users" | **Rejected for this sitting.** True about a neighbour; out of scope. Recorded so the next sampling refresh sees it. |
 | Provenance §10 empty while promising findings | **Accepted** by writing this table. |
+===== 11. Same-day rewrite: catalogue → decision page =====
+After item 184 published, Karel asked to question the page against later LLM-written pages (the model was [[design:ip_classification]]) and decide what of the human-era catalogue to keep. Not a new drain item.
+**Kept from the human page:** the vendor catalogue (CrUX / Tranco / Radar / Umbrella / Majestic / Alexa / Farsight / SecRank / SimilarWeb / Quantcast), the DNS-list caveats, the Le Pochat manipulation figure, the Scheitle and Xie survey figures as //dated history//, Farsight default-list-only, the Alexa 1 May 2022 vs Tranco 1 August 2023 distinction, Best Practices folded into What to report, the split with [[design:sampling]].
+**Dropped or rewritten:** numbered 1–6 Advantages/Limitations that restated the table; "the provider's own example file begins ''1,com'' / ''2,net''" (the 2026-08-27 top-1m.csv does not; that is ''top-1m-TLD.csv.zip''); ''ec2.internal'' as a live Umbrella example (absent from that day's top-1m); drain-internal voice about the work item that commissioned the corpus section; treating CrUX-first catalogue order as if it were current practice rather than Ruth's 2022 accuracy ranking.
+**Added, matching IP classification:** a decision table (claim → list); a live rank-disagreement table and published ''compare_ranks.py'' (the analogue of ''classify_ips.py''); blockquotes from Ruth, Scheitle, Galloway; a 2026 status table with paper counts; Papers to read first; Open questions; custom-seed 257 vs ranking 764 pointed at sampling rather than re-derived as a vendor ranking; ''gstatic.com'' at Tranco rank 3 as the page's "not one of them is the BBC" moment.
+''compare_ranks.py'' run 2026-08-27T14:26:07Z against Tranco ''46W9X'', Umbrella top-1m (1,000,000 hostnames) and Majestic Million. Umbrella TLD file: 10,905 rows, ''com''=1, ''net''=2, ''org''=6.
+===== 12. Rewrite review log =====
+Focused freeze: ''out/freeze_ws_rewrite/'' (page MD5 ''b45a6832…''). Content page not edited while the three focused passes ran. Generic freeze: ''out/freeze_ws_generic/'' after the currency wording fix. Model for all four: GPT 5.6 Luna medium.
+=== Pass 1 — figures vs script ===
+No findings. Report, fold, windowed-equivalent whole-page ''check_page_numbers'', tables, wrap: passed. Embedded ''180'' / ''1.05'' / ''1,000'' present in Z.
+=== Pass 2 — citations and quotes ===
+^ Finding ^ Verdict ^
+| Le Pochat "single HTTP request" unverifiable (NDSS 2019 full text absent) | **Noted, no change.** Same gap as the first sitting. |
+| Citekeys, Ruth/Scheitle/Galloway quotes, Galloway not given today's Radar bucket vocabulary, Xie labelled PAM | Confirmed, no change. |
+=== Pass 3 — external currency ===
+^ Finding ^ Verdict ^
+| Page said "Tranco's **methodology** still says CC BY-SA 4.0". Live methodology HTML has no CC BY/CC BY-SA string. | **Accepted.** The licence line is on Tranco's **homepage**, not the methodology page. Content, [[programming:tranco]] and [[design:website_classification]] now say homepage vs methodology vs Google CC BY 4.0. |
+| Tranco 46W9X, Farsight paragraph, Alexa Wayback, Umbrella hostnames + TLD file 10,905, Majestic, CrUX CC BY 4.0, Radar 403, Quantcast redirect, SecRank, Farsight not in providers enum, ''gstatic.com'' rank 3, ''compare_ranks.py --wiki'' | Confirmed 2026-08-27. |
+=== Pass 4 — generic, no checklist ===
+^ Finding ^ Verdict ^
+| **Blocking.** Decision table "Pages people actually load → CrUX (or Tranco)" | **Accepted.** CrUX is the direct choice; Tranco is named as not a substitute. |
+| **Blocking.** "A ranking is a proxy for popularity" while Majestic is backlinks | **Accepted.** Now "each list ranks an observable". |
+| 2022 Ruth finding reads as a 2026 recommendation | **Accepted.** Lede is "pick the list that matches the claim"; Ruth labelled 2022 evidence. |
+| "Prefer a month of ranks" underspecified | **Accepted.** Pin one dated frame; Tranco id already is a 30-day Dowdall; CrUX is a month snapshot. |
+| "today's Tranco" vs list dated 2026-08-26, fetched 2026-08-27 | **Accepted.** Prose now uses those two dates. Script function names unchanged. |
+| SimilarWeb "paywalled" does not say whether you can pin an export | **Accepted.** Status row now requires a keepable contract export; no public id. |
+| Repeated sampling cross-references | **Rejected.** The opening split and one What-to-report pointer are the boundary with [[design:sampling]]; cutting them would bury it. |