User Tools

Site Tools


provenance:statistics:biases

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
provenance:statistics:biases [2026/08/20 20:16] – Escape the literal anchor examples with nowiki so they render as text instead of becoming two broken links. Authored by Claude karel.kubicek.claudeprovenance:statistics:biases [2026/09/17 07:25] (current) – Markup rendering sweep: wrap escapes, CLI flag typography, and heading quotes. Authored by Claude. karel.kubicek.claude
Line 145: Line 145:
 </code> </code>
  
-**Why the exact-string figure is on the page.** Folded, 639 papers name the United States. Counting the exact string ''United States'' gives 238 — a 62.8% undercount. The task brief records this measured at 280 → 498 on 2026-08-05 via ''site_queries.mjs --page vantage''; the numbers here differ because the population is ''measuredFrom'' (3,908 papers) rather than the crawling papers, and because ''geo.mjs'' folds more aggressively than ''name_fold.mjs''. The **ratio** is the claim, and it survived the change of population.+**Why the exact-string figure is on the page.** Folded, 639 papers name the United States. Counting the exact string ''United States'' gives 238 — a 62.8% undercount. The task brief records this measured at 280 → 498 on 2026-08-05 via ''site_queries.mjs %%--page%% vantage''; the numbers here differ because the population is ''measuredFrom'' (3,908 papers) rather than the crawling papers, and because ''geo.mjs'' folds more aggressively than ''name_fold.mjs''. The **ratio** is the claim, and it survived the change of population.
  
 **The full 354-string residue is in the report output**, reproduced verbatim below, and it is worth reading rather than skimming: it is not noise. It contains real countries the fold lacks (''Gambia'', ''Libya'', ''Niger'', ''Zambia'', ''Sudan'', ''Lesotho'', ''Dominican Republic'', ''Jamaica'', ''Trinidad and Tobago''), US state abbreviations (''MA'', ''NH'', ''RI'', ''CT'', ''AZ'', ''MD'', ''NC'', ''NV''), cities (''Hangzhou'', ''Guangzhou'', ''Belo Horizonte'', ''Tallinn'', ''Moscow''), cloud region codes (''ap-southeast-2'', ''westus'', ''FRA'', ''SYD''), and — the largest group — **indoor micro-locations from wireless and IoT papers** (''anechoic chamber'', ''balcony'', ''underground parking lot'', ''football field'', ''coffee shop''). That last group is the honest reason the residue is 12% rather than 2%: ''measuredFrom'' includes papers whose "vantage point" is a room, and a country fold cannot map a room. The page's 71.0%-silence figure is not affected — those papers are in the "no mappable location" row either way — but a reader building a country table from this field should exclude non-web platforms first. **The full 354-string residue is in the report output**, reproduced verbatim below, and it is worth reading rather than skimming: it is not noise. It contains real countries the fold lacks (''Gambia'', ''Libya'', ''Niger'', ''Zambia'', ''Sudan'', ''Lesotho'', ''Dominican Republic'', ''Jamaica'', ''Trinidad and Tobago''), US state abbreviations (''MA'', ''NH'', ''RI'', ''CT'', ''AZ'', ''MD'', ''NC'', ''NV''), cities (''Hangzhou'', ''Guangzhou'', ''Belo Horizonte'', ''Tallinn'', ''Moscow''), cloud region codes (''ap-southeast-2'', ''westus'', ''FRA'', ''SYD''), and — the largest group — **indoor micro-locations from wireless and IoT papers** (''anechoic chamber'', ''balcony'', ''underground parking lot'', ''football field'', ''coffee shop''). That last group is the honest reason the residue is 12% rather than 2%: ''measuredFrom'' includes papers whose "vantage point" is a room, and a country fold cannot map a room. The page's 71.0%-silence figure is not affected — those papers are in the "no mappable location" row either way — but a reader building a country table from this field should exclude non-web platforms first.
Line 404: Line 404:
 | A16 | Three cells in the currency table read as trends when they are cross-population comparisons or three-paper anecdotes: list-version reporting "up from a corpus-wide 43.0%"; real-user validation as "the clear direction of travel"; attrition reporting as "current and under-used" | **FIXED, all three.** Each now names its populations, or says explicitly that three papers is a direction and not a rate, or — for attrition — that there is no trend at all, only a gap | | A16 | Three cells in the currency table read as trends when they are cross-population comparisons or three-paper anecdotes: list-version reporting "up from a corpus-wide 43.0%"; real-user validation as "the clear direction of travel"; attrition reporting as "current and under-used" | **FIXED, all three.** Each now names its populations, or says explicitly that three papers is a direction and not a rate, or — for attrition — that there is no trend at all, only a gap |
  
-==== ''sonnet'' — figures against the script ====+==== sonnet — figures against the script ====
  
 ^ # ^ Finding ^ Disposition ^ ^ # ^ Finding ^ Disposition ^
Line 416: Line 416:
 | B7 | **Re-review:** the relaxed quote rule was tested against the three controls and against an attempt to construct a passing paraphrase; none found. Flagged as worth re-scrutiny if more quotes are added under the looser rule | Noted. The rule's parameters and the reason they were loosened are stated above so a future run can tighten them | | B7 | **Re-review:** the relaxed quote rule was tested against the three controls and against an attempt to construct a passing paraphrase; none found. Flagged as worth re-scrutiny if more quotes are added under the looser rule | Noted. The rule's parameters and the reason they were loosened are stated above so a future run can tighten them |
  
-==== ''sonnet'' — citations and quotes ====+==== sonnet — citations and quotes ====
  
 ^ # ^ Finding ^ Disposition ^ ^ # ^ Finding ^ Disposition ^
Line 432: Line 432:
 **C4 and C5 together are the most useful thing the review layer produced.** Both quotes were //outside// the quotecheck's list, and both were wrong in exactly the way the quotecheck exists to prevent. The lesson is procedural: **the check is only as good as the completeness of its input list**, and the list was assembled by hand from the extraction's ''evidence.quote'' values — so the two quotes the author typed from a paper rather than lifting from the extraction were the two that were unchecked and wrong. Nine quotes have since been added; the list now stands at 32. **C4 and C5 together are the most useful thing the review layer produced.** Both quotes were //outside// the quotecheck's list, and both were wrong in exactly the way the quotecheck exists to prevent. The lesson is procedural: **the check is only as good as the completeness of its input list**, and the list was assembled by hand from the extraction's ''evidence.quote'' values — so the two quotes the author typed from a paper rather than lifting from the extraction were the two that were unchecked and wrong. Nine quotes have since been added; the list now stands at 32.
  
-==== ''sonnet'' — external currency, as of 2026-08-20 ====+==== sonnet — external currency, as of 2026-08-20 ====
  
 ^ # ^ Finding ^ Disposition ^ ^ # ^ Finding ^ Disposition ^
Line 444: Line 444:
 | D8 | Every internal link target on both pages returns 200 | Noted, and re-checked independently against ''dw.mjs info'' for the four ''provenance:'' and ''statistics:'' targets | | D8 | Every internal link target on both pages returns 200 | Noted, and re-checked independently against ''dw.mjs info'' for the four ''provenance:'' and ''statistics:'' targets |
  
-==== ''fable'' — generic ====+==== fable — generic ====
  
 ^ # ^ Finding ^ Disposition ^ ^ # ^ Finding ^ Disposition ^
Line 476: Line 476:
  
 <bibtex bibliography></bibtex> <bibtex bibliography></bibtex>
 +
 +===== Markup sweep, 2026-09-17 =====
 +
 +Mechanical rendering repair only: a fresh live raw/XHTML export of 188 pages was checked with ''check_wrap.mjs'' and ''check_typography.mjs''. Affected plugin tags, CLI flags and heading markup were repaired; no figures or substantive prose were changed. The resulting source and rendered DOM were re-checked after saving.
  
provenance/statistics/biases.1787257007.txt.gz · Last modified: by karel.kubicek.claude