User Tools

Site Tools


provenance:design:crawling_location

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
provenance:design:crawling_location [2026/09/04 17:29] – Citekey consolidation 2026-09-04: repoint duplicate bibliography keys to the kept key and add a dated amendment; no prose or figure changed. Authored by Claude karel.kubicek.claudeprovenance:design:crawling_location [2026/09/17 10:45] (current) – Record consentAction audit propagation; Authored by Claude karel.kubicek.claude
Line 30: Line 30:
 | ''crawled'' ∧ assessed a US law | ''legal[].law'' matches ''/CCPA|CPRA|COPPA|CALOPPA|VPPA|CIPA/i'' | 43 | | ''crawled'' ∧ assessed a US law | ''legal[].law'' matches ''/CCPA|CPRA|COPPA|CALOPPA|VPPA|CIPA/i'' | 43 |
 | ''crawled'' ∧ assessed no law | ''legal.length === 0'' | 989 | | ''crawled'' ∧ assessed no law | ''legal.length === 0'' | 989 |
-| ''crawled'' ∧ states a consent action | ''crawlConfig.consentAction'' is not a sentinel | 349 |+| ''crawled'' ∧ audited states a consent action | 2026-09-05 full-text audit of the 349 non-sentinel labels; 55 survive as paper claims | 55 |
  
 Sentinels (''not-stated'', ''none-mentioned'', ''not-applicable'', ''unclear'', ''unknown'') are counted as silence, never as a value. The "does the paper say where" table exists precisely to publish that silence. Sentinels (''not-stated'', ''none-mentioned'', ''not-applicable'', ''unclear'', ''unknown'') are counted as silence, never as a value. The "does the paper say where" table exists precisely to publish that silence.
Line 42: Line 42:
 node scripts/report_crawling_location.mjs         # every figure on the page node scripts/report_crawling_location.mjs         # every figure on the page
 node scripts/report_crawling_location.mjs --wiki  # the same, as DokuWiki tables node scripts/report_crawling_location.mjs --wiki  # the same, as DokuWiki tables
 +node scripts/consent_action_noninteraction_audit.mjs
 node scripts/check_page_numbers.mjs \ node scripts/check_page_numbers.mjs \
   pages/design_crawling_location.txt out/new/report_crawling_location.txt \   pages/design_crawling_location.txt out/new/report_crawling_location.txt \
Line 74: Line 75:
 | …of those, EU/EEA vantage | 29 of 34 (85.3%) | 45 of 52 (86.5%) | | …of those, EU/EEA vantage | 29 of 34 (85.3%) | 45 of 52 (86.5%) |
 | …assessed an EU law from outside the EEA | 5 | 7 | | …assessed an EU law from outside the EEA | 5 | 7 |
-| States a consent action | 270 | 349 | +| ''consentAction'' field populated (schema; not an audited claim) | 270 | 349 | 
-| …of those, EU/EEA vantage | 48 (17.8%) | 68 (19.5%) | +| …of raw schema labels, EU/EEA vantage | 48 (17.8%) | 68 (19.5%) | 
-| …of those, no location at all | 166 | 210 |+| …of raw schema labels, no location at all | 166 | 210 |
  
 **Moved by more than a rounding step:** **Moved by more than a rounding step:**
Line 182: Line 183:
   * The matcher was **substring**, not word-boundary, so ''report.includes('59')'' was satisfied by ''11.59 bits''. One genuinely stale figure sat inside a checked window and passed for that reason.   * The matcher was **substring**, not word-boundary, so ''report.includes('59')'' was satisfied by ''11.59 bits''. One genuinely stale figure sat inside a checked window and passed for that reason.
  
-Both are fixed in ''scripts/check_page_numbers.mjs'': matching is now anchored with lookarounds, ISO dates and URLs are stripped before scanning, ''--code'' opts into scanning ''<file>'' blocks, and omitting the heading markers checks the whole page. **Run it windowed //and// whole-page.** The whole-page run is noisy — a page's non-corpus half is full of figures quoted from other papers — so read its output rather than expecting it to exit clean.+Both are fixed in ''scripts/check_page_numbers.mjs'': matching is now anchored with lookarounds, ISO dates and URLs are stripped before scanning, ''%%--code%%'' opts into scanning ''%%<file>%%'' blocks, and omitting the heading markers checks the whole page. **Run it windowed //and// whole-page.** The whole-page run is noisy — a page's non-corpus half is full of figures quoted from other papers — so read its output rather than expecting it to exit clean.
 Fixed on this page's content page as a result: the lead paragraph's headline **70.9% → 70.8%**, reworded to say what it measures ("record a vantage point and never say where it was" — the old wording implied it included the 31 papers with no vantage record at all, which would be 73.6%); and PlanetLab **7 → 8 papers** in //Research measurement platforms//, which contradicted the page's own provider table. Fixed on this page's content page as a result: the lead paragraph's headline **70.9% → 70.8%**, reworded to say what it measures ("record a vantage point and never say where it was" — the old wording implied it included the 31 papers with no vantage record at all, which would be 73.6%); and PlanetLab **7 → 8 papers** in //Research measurement platforms//, which contradicted the page's own provider table.
  
Line 203: Line 204:
  
 [[design:crawling_location|← back to the content page]] · [[literature:corpus|corpus-level provenance]] [[design:crawling_location|← back to the content page]] · [[literature:corpus|corpus-level provenance]]
 +
 +===== Markup sweep, 2026-09-17 =====
 +
 +Mechanical rendering repair only: a fresh live raw/XHTML export of 188 pages was checked with ''check_wrap.mjs'' and ''check_typography.mjs''. Affected plugin tags, CLI flags and heading markup were repaired; no figures or substantive prose were changed. The resulting source and rendered DOM were re-checked after saving.
 +
 +===== ConsentAction audit propagation, 2026-09-17 =====
 +
 +**What was wrong.** The consent-action paragraph on [[design:crawling_location]] treated the raw non-sentinel ''crawlConfig.consentAction'' population (349 of 1,120; 31.2%) as if it were a paper-claim count, and therefore published 68 EU/EEA papers and 210 with no location. The 2026-09-05 full-text audit of all 313 ''no-interaction'' labels found 279/313 unsupported (89.1%).
 +
 +**Command and real output.** ''node scripts/consent_action_noninteraction_audit.mjs'' → 349 raw labels; **55** papers audited as stating a consent action (4.9% of 1,120), **37** EU/EEA (67.3%), **11** with no location. ''node scripts/report_crawling_location.mjs'' → the page's consent section prints exactly: ''Papers audited as stating a consent action: 55. Of those, 37 (67.3%) state an EU/EEA vantage, 11 state no place at all.''
 +
 +**What changed.** The page now names the audited denominator and uses 55/37/11. The population table labels the 349 row as raw schema population, and ''report_crawling_location.mjs'' consumes the exported audited paper-key set from ''consent_action_noninteraction_audit.mjs''.
 +
 +**Review.** One **model: 'sonnet'** figures-vs-script pass re-ran the report and checked the edited figure plus the adjacent legal-framing figures and the full report output. It found no mismatch. No citation pass was needed: no citekey or quoted claim changed.
 +
 +**Rejected finding.** The eight papers that say they do not interact at all but never mention consent were not counted as papers stating a consent action; they remain a separate lenient comparison in the audit output. The 279 unsupported defaults were not treated as paper claims.
  
provenance/design/crawling_location.1788542991.txt.gz · Last modified: by karel.kubicek.claude