Measure The Web

User Tools

Site Tools

Trace:
provenance:statistics:hypothesis_testing

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
provenance:statistics:hypothesis_testing [2026/09/04 08:29] – Review pass: flag the retraction from the run table at the top, state that this page's threshold and the corpus-wide four-verdict rule are not comparable, correct 73.1 to 73.2, and drop the 'ugrep' attribution. Authored by Claude karel.kubicek.claudeprovenance:statistics:hypothesis_testing [2026/09/17 07:25] (current) – Markup rendering sweep: wrap escapes, CLI flag typography, and heading quotes. Authored by Claude. karel.kubicek.claude
Line 61: Line 61:
 ''participants'', not ''humanAnnotation'' — crowdworkers labelling data are annotators, not subjects, and conflating them double-counts Mechanical Turk. ''participants'', not ''humanAnnotation'' — crowdworkers labelling data are annotators, not subjects, and conflating them double-counts Mechanical Turk.
  
-===== The fold: ''test_fold.mjs'' =====+===== The fold: test_fold.mjs =====
  
 ''statistics[].method'' is free text and agrees run-to-run on ~20% of exact strings, so it is never aggregated by exact string. **798 distinct strings describe about forty procedures.** The fold is an ordered rule list; first match wins; anything matching no rule lands in ''residue'' and is printed. ''statistics[].method'' is free text and agrees run-to-run on ~20% of exact strings, so it is never aggregated by exact string. **798 distinct strings describe about forty procedures.** The fold is an ordered rule list; first match wins; anything matching no rule lands in ''residue'' and is printed.
Line 193: Line 193:
 Every quote published on the content page was located by hand. Every quote published on the content page was located by hand.
  
-==== RETRACTED, 2026-09-04: the Mai et al. quotes are in ''paper.cols.txt'' ====+==== RETRACTED, 2026-09-04: the Mai et al. quotes are in paper.cols.txt ====
  
 This section previously said that four of Mai et al.'s methodology quotes were present in the stored ''paper.pdf'' and in **none** of ''paper.cols.txt'', ''paper.norm.txt'' or ''paper.txt'', and drew three consequences from it. **The claim was false and the consequences with it.** The original text is **summarised rather than reproduced** below, and kept rather than deleted, because the way it was got wrong is worth more than the claim was. This section previously said that four of Mai et al.'s methodology quotes were present in the stored ''paper.pdf'' and in **none** of ''paper.cols.txt'', ''paper.norm.txt'' or ''paper.txt'', and drew three consequences from it. **The claim was false and the consequences with it.** The original text is **summarised rather than reproduced** below, and kept rather than deleted, because the way it was got wrong is worth more than the claim was.
Line 315: Line 315:
 | A8 | The bug table below contained a backslash-escaped pipe inside a table cell. **DokuWiki does not treat a backslash-escaped pipe as an escape** — the pipe still delimits, so the row rendered with 5 cells in a 3-column table and broke the table from there down | **FIXED.** Found by a cell-count consistency check over every table on both pages, not by reading. **And then it happened again**: the row you are reading originally quoted the offending character and broke this table too. The check caught that as well. Do not write a pipe inside a DokuWiki table cell, not even to talk about one | | A8 | The bug table below contained a backslash-escaped pipe inside a table cell. **DokuWiki does not treat a backslash-escaped pipe as an escape** — the pipe still delimits, so the row rendered with 5 cells in a 3-column table and broke the table from there down | **FIXED.** Found by a cell-count consistency check over every table on both pages, not by reading. **And then it happened again**: the row you are reading originally quoted the offending character and broke this table too. The check caught that as well. Do not write a pipe inside a DokuWiki table cell, not even to talk about one |
  
-==== ''sonnet'' — figures against the script ====+==== sonnet — figures against the script ====
  
 Re-ran ''test_fold.mjs'' (146/146), ''report_hypothesis_testing.mjs'', ''ht_quotecheck.mjs'' and the demo, confirmed the scripts were byte-identical to the frozen copies, and checked every table cell. Re-ran ''test_fold.mjs'' (146/146), ''report_hypothesis_testing.mjs'', ''ht_quotecheck.mjs'' and the demo, confirmed the scripts were byte-identical to the frozen copies, and checked every table cell.
Line 328: Line 328:
 | R1-7 | Running ''check_page_numbers.mjs'' against the **provenance** page reports many unaccounted numbers, all of them historical or external (DOI fragments, the before/after fold values like 212 → 213, byte counts) | **REJECTED as a defect.** The guard is built to audit a content page against its report; a working log that deliberately records superseded numbers is out of its scope. Noted here so the next run does not "fix" it | | R1-7 | Running ''check_page_numbers.mjs'' against the **provenance** page reports many unaccounted numbers, all of them historical or external (DOI fragments, the before/after fold values like 212 → 213, byte counts) | **REJECTED as a defect.** The guard is built to audit a content page against its report; a working log that deliberately records superseded numbers is out of its scope. Noted here so the next run does not "fix" it |
  
-==== ''sonnet'' — citations and quotes ====+==== sonnet — citations and quotes ====
  
 ^ # ^ Finding ^ Disposition ^ ^ # ^ Finding ^ Disposition ^
Line 337: Line 337:
 | R2-5 | Divine et al. 2018, Rochon 2012 and Campbell 2007 were assessed from abstracts and search results, not primary full text (paywalled) | **ACCEPTED as a limit**, recorded in //What could not be established//. Divine et al.'s thesis is in its title, so the risk is low, but it is not zero | | R2-5 | Divine et al. 2018, Rochon 2012 and Campbell 2007 were assessed from abstracts and search results, not primary full text (paywalled) | **ACCEPTED as a limit**, recorded in //What could not be established//. Divine et al.'s thesis is in its title, so the risk is low, but it is not zero |
  
-==== ''sonnet'' — external currency, as of 2026-08-13 ====+==== sonnet — external currency, as of 2026-08-13 ====
  
 ^ # ^ Finding ^ Disposition ^ ^ # ^ Finding ^ Disposition ^
Line 348: Line 348:
 | R3-7 | No dead or renamed links | No change | | R3-7 | No dead or renamed links | No change |
  
-==== ''fable'' — generic ====+==== fable — generic ====
  
 Run on the post-fix snapshot ''out/review_ht/page_r2.txt''. It found the single most consequential item of the whole review, and its closing observation is the one to keep. Run on the post-fix snapshot ''out/review_ht/page_r2.txt''. It found the single most consequential item of the whole review, and its closing observation is the one to keep.
Line 438: Line 438:
  
 <bibtex bibliography></bibtex> <bibtex bibliography></bibtex>
 +
 +===== Markup sweep, 2026-09-17 =====
 +
 +Mechanical rendering repair only: a fresh live raw/XHTML export of 188 pages was checked with ''check_wrap.mjs'' and ''check_typography.mjs''. Affected plugin tags, CLI flags and heading markup were repaired; no figures or substantive prose were changed. The resulting source and rendered DOM were re-checked after saving.
  
provenance/statistics/hypothesis_testing.1788510543.txt.gz · Last modified: by karel.kubicek.claude