Old Revisions

These are the older revisons of the current document. To revert to an old revision, select it from below, click Edit this page and save it.

2026/09/17 07:41 programming:crawler:openwpm – Markup rendering sweep correction: escape residual CLI flag. Authored by Claude. karel.kubicek.claude +4 B (current)
2026/09/17 07:22 programming:crawler:openwpm – Markup rendering sweep: wrap escapes, CLI flag typography, and heading quotes. Authored by Claude. karel.kubicek.claude +16 B
2026/09/05 14:15 programming:crawler:openwpm – Verification pass on the 2026-09-05 corrections: the corrected Firefox-version count was itself short — 9 of 15 papers state a crawl browser, not 7 (the re-sweep had run over reviewer-named slugs, not the population), split 4 match the pin / 3 differ / 2 karel.kubicek.claude +933 B
2026/09/05 13:59 programming:crawler:openwpm – Generic (no-checklist) review pass, 2026-09-05: 7 of 15 papers state a crawl Firefox version, not 3, and 3 differ from the pin (the hand map's seed regex was too narrow); correct the false Open Question about num_browsers; refresh the maintenance table to karel.kubicek.claude +6 KB
2026/09/04 17:29 programming:crawler:openwpm – Citekey consolidation 2026-09-04: repoint duplicate bibliography keys (fouad2022my/boettger2025_regional/ahmad2026_ipfp/bouhoula2024automated/lerner2016internet) to the kept key; no prose or figure changed. Authored by Claude karel.kubicek.claude +5 B
2026/08/21 08:32 programming:crawler:openwpm – [Open Questions] karelkubicek +19 B
2026/08/19 11:34 programming:crawler:openwpm – Programming:Stateful stateless is no longer a notes stub; update the pointer to say what it now covers. Authored by Claude karel.kubicek.claude +48 B
2026/08/14 10:33 programming:crawler:openwpm – [Open Questions] formatting admin -19 B
2026/08/14 10:26 programming:crawler:openwpm – Add two pitfalls from practice: OpenWPM is fork-shaped not library-shaped (monkey-patch over a pinned release instead), and the pinned unbranded Firefox expires from Mozilla CI after ~1 year (mirror it; container images are the escape hatch). Authored by karel.kubicek.claude +5 KB
2026/08/14 08:54 programming:crawler:openwpm – Apply the generic review pass: fix a data-loss bug in the published smoke script (save_content with no unstructured storage provider drops every body), correct MD5 -> SHA-256 for content_hash, drop the false Xvfb-extraction claim for what the data shows, karel.kubicek.claude +2.2 KB
2026/08/14 08:44 programming:crawler:openwpm – Flag the container recommendation as untested on this host and attribute it to the project's own README; add the citation the project asks for to the reporting checklist. Authored by Claude. karel.kubicek.claude +580 B
2026/08/14 08:41 programming:crawler:openwpm – Add a 'Papers to read first' section (six papers, in the order useful before running a crawl). Authored by Claude. karel.kubicek.claude +1.3 KB
2026/08/14 08:37 programming:crawler:openwpm – New page: OpenWPM — instrumentation surfaces and their defaults, stateful/stateless as implemented, the release-to-Firefox pin, known pitfalls, maintenance status as of 2026-08-14, install/test results on this host, and 60 corpus papers' reporting. Proven karel.kubicek.claude +51.2 KB