Differences

This shows you the differences between two versions of the page.

--- programming [2026/08/29 12:20] – Add Programming:Filter Lists as a new 'Labelling instruments' section; child count 17 -> 18. Authored by Claude karel.kubicek.claude
+++ programming [2026/09/11 18:00] (current) – Carve-out drift: the domain-to-company ownership material moved from Programming:Crawler:webXray to the new Design:Ownership resolution on 2026-09-11; repoint the link. Authored by Claude Also rewrites the webXray row's description, which described the pa karel.kubicek.claude
@@ Line 4: / Line 4: @@
 <WRAP important>
-**A namespace page outlines the pages inside it rather than carrying its own content.** (([[contributing]], "Namespace and page structure".)) All **18** children below are written. **2** of them ([[Programming:CrUX]], [[Programming:Similarweb]]) are short instrument notes that have **not** been re-derived against the 2010–2026 extraction — treat them as API notes, not as evidence-backed siblings of [[Programming:Crawler]].
+**A namespace page outlines the pages inside it rather than carrying its own content.** (([[contributing]], "Namespace and page structure".)) All **19** children below are written. **2** of them ([[Programming:CrUX]], [[Programming:Similarweb]]) are short instrument notes that have **not** been re-derived against the 2010–2026 extraction — treat them as API notes, not as evidence-backed siblings of [[Programming:Crawler]].
 </WRAP>
@@ Line 14: / Line 14: @@
 | [[Programming:Crawler:Tracker Radar Collector]] | DuckDuckGo's Chromium/CDP collector, vs the Tracker Radar dataset / detector / entity map. |
 | [[Programming:Crawler:PageGraph]] | Brave page-execution recorder: which actor caused this request. |
-| [[Programming:Crawler:webXray]] | Domain-to-company ownership lists, and what remains of the tool. |
+| [[Programming:Crawler:webXray]] | What remains of the tool: architecture, availability, its three licences, and its frozen ownership file. The ownership //question// — which source to use now — is [[Design:Ownership resolution]]. |
 | [[Programming:Crawler:Foxhound]] | Firefox fork that taints strings. When a taint report is a flow and when it is a vulnerability. |
 | [[Programming:Crawler:PanoptiChrome]] | V8 object taint in Chromium. When it is the instrument and when it is not. |
@@ Line 30: / Line 30: @@
 | [[Programming:Traffic files]] | HAR vs pcap vs proxy vs CDP — choosing where to tap. |
 | [[Programming:Docker]] | Pinning a crawler image (digest, shared memory). |
+===== Probing the network =====
+^ Page ^ What a student needs it for ^
+| [[Programming:Internet scanning]] | The other branch's instrument. ZMap/ZGrab invocation, probe rate and what it costs in wall clock, the exclusion file and where opt-out requests go, source-address hygiene, and why IPv6 needs a hitlist rather than an enumeration. |
 ===== Labelling instruments =====
@@ Line 61: / Line 66: @@
 ===== Methodology and limitations of these figures =====
-The **5,859** / **1,120** are paper counts from the 5,859-paper extraction (seven venues, 2010–2026). 2025–2026 venue-years are provisional — see [[literature:corpus]]. The **18** / **2** and the stub byte counts (CrUX, Similarweb) are wiki-page counts, the stub sizes as of 2026-08-27 and the child count as of 2026-08-29 (when [[Programming:Filter Lists]] was added). Queries: [[provenance:programming]]. Joint sitting: [[provenance:design]].
+The **5,859** / **1,120** are paper counts from the 5,859-paper extraction (seven venues, 2010–2026). 2025–2026 venue-years are provisional — see [[literature:corpus]]. The **18** / **2** and the stub byte counts (CrUX, Similarweb) are wiki-page counts, the stub sizes as of 2026-08-27 and the child count as of 2026-09-10 (when [[Programming:Internet scanning]] was added; it was 18 after [[Programming:Filter Lists]] on 2026-08-29). Queries: [[provenance:programming]]. Joint sitting: [[provenance:design]].
 <bibtex bibliography></bibtex>