| |
| provenance:design:crawling_location [2026/08/12 09:09] – Create provenance page for design:crawling_location: queries, denominators, folds and residue, spot-checked quotes, and the 4,322 -> 5,859 corpus refresh diff. Partly reconstructed after the fact; marked as such. Authored by Claude. karel.kubicek.claude | provenance:design:crawling_location [2026/08/12 10:07] (current) – Add section 10: the Fable review pass, the windowed-guard defect it exposed (29 corpus figures stale outside the audited heading window across six pages), the hardened check_page_numbers.mjs, and the page-specific fixes. Authored by Claude. karel.kubicek.claude |
|---|
| * **Why ''vantage'' never fires for 31 crawling papers.** These are papers whose study type says they crawled but which produced no ''vantage'' tuple at all. Whether that is extraction failure or genuine silence in the paper has not been checked; 31 of 1,120 is 2.8% and it does not move any figure on the page. | * **Why ''vantage'' never fires for 31 crawling papers.** These are papers whose study type says they crawled but which produced no ''vantage'' tuple at all. Whether that is extraction failure or genuine silence in the paper has not been checked; 31 of 1,120 is 2.8% and it does not move any figure on the page. |
| |
| ===== 9. Run log ===== | ===== 10. Review pass, 2026-08-12 ===== |
| | |
| | //Recorded.// The refresh was reviewed by a second model (Claude Fable 5), told explicitly that the summary it was given might not be exhaustive, with instructions to hunt stale numbers. It found a **systematic defect, not a scatter of typos**, and it is worth stating because it will recur on the next refresh: |
| | |
| | * ''check_page_numbers.mjs'' was run with a **heading window** — normally ''Use in Publications'' to the next section — so it audited only the corpus section. Every corpus figure repeated in a page's **intro, tooling section, recommendations, footnotes, Related Pages or an embedded code block** was outside the window and stayed at its 4,322-corpus value. Across the six pages **29 such figures** survived the first pass. |
| | * The matcher was **substring**, not word-boundary, so ''report.includes('59')'' was satisfied by ''11.59 bits''. One genuinely stale figure sat inside a checked window and passed for that reason. |
| | |
| | Both are fixed in ''scripts/check_page_numbers.mjs'': matching is now anchored with lookarounds, ISO dates and URLs are stripped before scanning, ''--code'' opts into scanning ''<file>'' blocks, and omitting the heading markers checks the whole page. **Run it windowed //and// whole-page.** The whole-page run is noisy — a page's non-corpus half is full of figures quoted from other papers — so read its output rather than expecting it to exit clean. |
| | Fixed on this page's content page as a result: the lead paragraph's headline **70.9% → 70.8%**, reworded to say what it measures ("record a vantage point and never say where it was" — the old wording implied it included the 31 papers with no vantage record at all, which would be 73.6%); and PlanetLab **7 → 8 papers** in //Research measurement platforms//, which contradicted the page's own provider table. |
| | |
| | ===== 11. Run log ===== |
| |
| ^ ^ ^ | ^ ^ ^ |
| | Caveats deleted | "IEEE S&P is only 43% retrieved (paywall)" — no longer true, 780 of 780 selected papers are now retrieved. "2010–2024" everywhere. | | | Caveats deleted | "IEEE S&P is only 43% retrieved (paywall)" — no longer true, 780 of 780 selected papers are now retrieved. "2010–2024" everywhere. | |
| | Mistakes caught in review | The first version of ''vantage_fold.mjs'' failed to match ''Amazon Web Services'' (the regex had ''web\s+service'' with a trailing ''\b'', so the plural did not match), leaving 8 papers in the residue and Amazon at 60 rather than 68. Caught by reading the residue list, which is why the residue is printed. | | | Mistakes caught in review | The first version of ''vantage_fold.mjs'' failed to match ''Amazon Web Services'' (the regex had ''web\s+service'' with a trailing ''\b'', so the plural did not match), leaving 8 papers in the residue and Amazon at 60 rather than 68. Caught by reading the residue list, which is why the residue is printed. | |
| | | Review | Reviewed by Claude Fable 5 on 2026-08-12 with the instruction that the summary might not be exhaustive. It found the windowed-guard defect in §10 and 2 stale figures on this page. All fixes were applied and re-saved the same day. | |
| |
| [[design:crawling_location|← back to the content page]] · [[literature:corpus|corpus-level provenance]] | [[design:crawling_location|← back to the content page]] · [[literature:corpus|corpus-level provenance]] |
| |
