User Tools

Site Tools


provenance:design:ip_classification

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

provenance:design:ip_classification [2026/08/12 09:23] – Create provenance page for design:ip_classification: queries, denominators, the 18-string fold residue and where each went, two report-script bugs, quote verification, and the 4,322 -> 5,859 refresh diff. Partly reconstructed; marked as such. Authored by karel.kubicek.claudeprovenance:design:ip_classification [2026/08/12 10:07] (current) – Add section 10: the Fable review pass, the windowed-guard defect it exposed (29 corpus figures stale outside the audited heading window across six pages), the hardened check_page_numbers.mjs, and the page-specific fixes. Authored by Claude. karel.kubicek.claude
Line 154: Line 154:
   * **Criminal IP's family.** See §5.1. One paper, and it could reasonably go under //Is it known-bad?//.   * **Criminal IP's family.** See §5.1. One paper, and it could reasonably go under //Is it known-bad?//.
  
-===== 9. Run log =====+===== 10. Review pass, 2026-08-12 ===== 
 + 
 +//Recorded.// The refresh was reviewed by a second model (Claude Fable 5), told explicitly that the summary it was given might not be exhaustive, with instructions to hunt stale numbers. It found a **systematic defect, not a scatter of typos**, and it is worth stating because it will recur on the next refresh: 
 + 
 +  * ''check_page_numbers.mjs'' was run with a **heading window** — normally ''Use in Publications'' to the next section — so it audited only the corpus section. Every corpus figure repeated in a page's **intro, tooling section, recommendations, footnotes, Related Pages or an embedded code block** was outside the window and stayed at its 4,322-corpus value. Across the six pages **29 such figures** survived the first pass. 
 +  * The matcher was **substring**, not word-boundary, so ''report.includes('59')'' was satisfied by ''11.59 bits''. One genuinely stale figure sat inside a checked window and passed for that reason. 
 + 
 +Both are fixed in ''scripts/check_page_numbers.mjs'': matching is now anchored with lookarounds, ISO dates and URLs are stripped before scanning, ''--code'' opts into scanning ''<file>'' blocks, and omitting the heading markers checks the whole page. **Run it windowed //and// whole-page.** The whole-page run is noisy — a page's non-corpus half is full of figures quoted from other papers — so read its output rather than expecting it to exit clean. 
 +Fixed on this page's content page as a result: the **intro paragraph**, which carried ''234 / 92 / 53'' where the corpus section says ''295 / 114 / 68''; the operator-prefix-list full-text grep, **six papers of 4,322 → seven of 5,859** (the seventh is ''NDSS/2025/secure-ip-address-allocation-at-cloud-scale''); the abuse-feed count **13 of 234 → 17 of 295**; and a surviving corpus-window statement — the page said Ali et al. (NDSS 2026) was "published after our corpus closes", and it is now **in** the corpus at ''NDSS/2026/beyond-rtt-an-adversarially-robust-two-tiered-approach-for-residential-proxy-detection''
 + 
 +===== 11. Run log =====
  
 ^ ^ ^ ^ ^ ^
Line 164: Line 174:
 | Caveats deleted | "IEEE S&P is only 43% retrieved (paywall)" — 780 of 780 selected papers are now retrieved. "The corpus ends in 2024." | | Caveats deleted | "IEEE S&P is only 43% retrieved (paywall)" — 780 of 780 selected papers are now retrieved. "The corpus ends in 2024." |
 | Mistake caught in review | The hardcoded ''234'' would have shipped a table headed "Share of 234" with shares computed out of 295. It was caught by diffing the report output against the committed one, which is the whole argument for keeping the old output on disk. | | Mistake caught in review | The hardcoded ''234'' would have shipped a table headed "Share of 234" with shares computed out of 295. It was caught by diffing the report output against the committed one, which is the whole argument for keeping the old output on disk. |
 +| Review | Reviewed by Claude Fable 5 on 2026-08-12 with the instruction that the summary might not be exhaustive. It found the windowed-guard defect in §10 and 4 stale figures on this page, one of them a surviving corpus-window statement. All fixes were applied and re-saved the same day. |
  
 [[design:ip_classification|← back to the content page]] · [[literature:corpus|corpus-level provenance]] [[design:ip_classification|← back to the content page]] · [[literature:corpus|corpus-level provenance]]
  
provenance/design/ip_classification.txt · Last modified: by karel.kubicek.claude

Except where otherwise noted, content on this wiki is licensed under the following license: CC BY-NC-SA 4.0
CC BY-NC-SA 4.0 Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki