Differences

This shows you the differences between two versions of the page.

--- provenance:design:existing_datasets [2026/08/28 19:05] – Add the mechanical-guard run (check_wrap, check_tables, check_page_numbers) and the hand-read of its 29 unaccounted figures to the review log. Authored by Claude karel.kubicek.claude
+++ provenance:design:existing_datasets [2026/09/17 07:44] (current) – Markup rendering sweep correction: preserve table heading and escape residual CLI flag. Authored by Claude. karel.kubicek.claude
@@ Line 3594: / Line 3594: @@
 ==== Pass A — figures vs script (Sonnet) ====
-Re-ran the script, diffed it against the committed output, checked every number and denominator on the page, audited the script internals, swept ''--members'' for every published family, and reproduced four headline figures independently in Python from ''extractions.jsonl''.
+Re-ran the script, diffed it against the committed output, checked every number and denominator on the page, audited the script internals, swept ''%%--members%%'' for every published family, and reproduced four headline figures independently in Python from ''extractions.jsonl''.
 ^ Finding ^ Verdict ^ What was done ^
@@ Line 3627: / Line 3627: @@
   * "It is the modal sentence" (about undated dataset references) was an unsupported superlative. Replaced with the figure that //is// supported: 43.3% of the 2,534 existing-dataset papers give neither a first nor a last date.
   * A section on **reusing another paper's released artifact** was missing, even though the item this page answers names "last year's crawl" explicitly. Added, built on two figures the page already has (9 of 60 residue strings name a prior paper's dataset by citation; 57.7% artifact release) plus {[demir2022_reproducibility]}. The Demir citation was first written as "measured how much a repeated crawl of the same list differs from itself", which is **not** what that paper did; corrected to its actual design (4.5M pages, 24 setups) and its own sentence.
-  * The dataset-family table originally showed 24 of the fold's 35 Internet/web/security families, cutting the tail silently — including a 34-paper family. Replaced with the complete table generated from ''--wiki'', plus a sentence naming the counts in the four scopes that are **not** tabulated, so nothing is dropped without a number.
+  * The dataset-family table originally showed 24 of the fold's 35 Internet/web/security families, cutting the tail silently — including a 34-paper family. Replaced with the complete table generated from ''%%--wiki%%'', plus a sentence naming the counts in the four scopes that are **not** tabulated, so nothing is dropped without a number.
 ==== Mechanical guards, after every fix ====
@@ Line 3668: / Line 3668: @@
 | Main agent | Claude (Opus 5) — corpus queries, fold, report script, page text, provenance page |
 | Sub-agents | one currency sweep (Sonnet) before writing; four reviewers after — figures-vs-script (Sonnet), citations-and-quotes (Sonnet), external-currency (Sonnet), generic (Fable) |
-| Write path | ''node scripts/dw.mjs'' (JSON-RPC), every save with ''--if-rev'' |
+| Write path | ''node scripts/dw.mjs'' (JSON-RPC), every save with ''<nowiki>--if-rev</nowiki>'' |
 | Bibliography | appended to a fresh export of the live page, not to a local copy; duplicate check by key, DOI and title before appending |
 | Accidental exposure or mistakes caught in review | the ''artifacts.links'' definition bug in §11; four fold regex bugs in §6; two working hypotheses about external services refuted in §9. All caught before publication. |
@@ Line 3934: / Line 3934: @@
   * [[literature:corpus]] — the dataset, its funnel, its venue scope and its provisional years.
   * [[provenance:design:archives]] — the neighbouring provenance page, for the archive half of the same problem.
+===== Markup sweep, 2026-09-17 =====
+Mechanical rendering repair only: a fresh live raw/XHTML export of 188 pages was checked with ''check_wrap.mjs'' and ''check_typography.mjs''. Affected plugin tags, CLI flags and heading markup were repaired; no figures or substantive prose were changed. The resulting source and rendered DOM were re-checked after saving.