User Tools

Site Tools


provenance:design:archives

This is an old revision of the document!


Provenance: design:archives

Working notes behind archives — every query with its population and denominator, the report script and its unedited output, the fold and its full residue, the quotes that were checked, the external sources that were verified or rejected, and what could not be established. Corpus-level caveats that apply to every page on this site are on corpus and are not restated here.

Contemporaneous. Written during the run that produced the content page, 2026-08-13, not reconstructed afterwards.

1. What this page is backing

Item Value
Content page archivesextended, not created. Prior revision 9,423 bytes, 1 TODO, written by a human contributor.
Report script scripts/report_archives.mjs
Fold it depends on scripts/arch_fold.mjs (archive-name families)
Quote checker extension scripts/quote_check.mjs gained a –temporal mode; no other flag reaches temporal tuples
Data data/extract/run1/extractions.jsonl, 5,859 papers, 7 venues, 2010–2026
Bibliography 3 new entries (lerner2017_rewriting, singh2026_empire, roth2022_security), 1 entry corrected in place (hantke2025web: arXiv preprint → published USENIX Security 2025)
Previous figures none carried over. The prior page contained no figures from this corpus at all — every number on it was from an external source or a paper.

2. Scope: extend, do not create a neighbour

The judgement call. The prior design:archives was already a good page on which archive to pick and how to query it — HTTP Archive's BigQuery setup, the Wayback Machine's API surface, a short limitations section, and a TODO asking for more on alternative archives. It was not a candidate for a parallel page: a second page called “archive fidelity” would have split one topic into two, and the reader arriving with “should I use an archive” would have found the wrong half.

So this was an extension. What was kept from the prior page, edited for accuracy: the HTTP Archive section (BigQuery access steps, both SQL examples, the cost warning, the HAR-download route), the Wayback Machine section, the archive-selection criteria, and the reference to Wikipedia's archiving-initiatives list. What was added: the Use in Publications section built from this corpus, the whole What an Archive Preserves section, the Doing It Right checklist, The anachronism trap, Recording Your Own Archive, What to Report, and Open Questions. What was corrected: six factual or misleading statements, listed in §7.

The TODO (“Adding more information to alternative archives would be helpful”) is resolved: Arquivo.pt, Archive-It, Common Crawl and the national archives now have text with measured coverage figures rather than a list of names, and the reason the list is short — the aggregator that would have enumerated them is gone — is now stated.

3. Populations and denominators

Every figure on the content page comes from one of these. “All 5,859 papers” is never a denominator on that page.

Tag Definition (as the report script implements it) N
corpus all extraction records 5,859
empirical isEmpirical === true 5,118
crawled crawlConfig !== null OR studyTypes contains automated-web-crawl 1,120
temporal population ≥1 temporal[] tuple — the only legitimate denominator for temporal.mode, since a paper with no tuple has no mode 5,342
mode = web-archive ≥1 temporal tuple with that enum value 68
mode = live-crawl ≥1 temporal tuple with that enum value 1,261
named a web-page archive ≥1 archive-family name across five free-text fields, after folding and exclusion 122
… of which a replay archive family ∈ {Internet Archive, Arquivo.pt, Archive-It, Memento, national, unspecified} 85
… Common Crawl / HTTP Archive only the remainder 37
and empirical — the numerator for every “% of empirical” figure namedWebArchiveempirical 115
… named an archive but is not empirical mostly LLM work using Common Crawl as a training corpus 7
mode = web-archiveempirical 65
mode = live-crawlempirical 1,236
archive-attributed temporal tuple of the 122, those with a temporal tuple attributable to an archive 94

The intersection is not cosmetic and the first draft got it wrong. Shares of empirical were computed as 122 / 5,118 and 1,261 / 5,118 — a numerator drawn from all 5,859 papers over a denominator of 5,118. It inflated the headline from 2.2% to 2.4%, the live-crawl comparison from 24.2% to 24.6%, and shifted four of five rows of the trend table and five of seven venue rows. Caught by the generic review pass (§11, pass D), which noticed it in the script rather than on the page — the figures pass had diffed page against script and both were wrong in the same way. That the corpus overview independently reports 65 of 5,118 for web-archive is the check that should have been run at the start.

The two counts of “papers using an archive” — 68 and 122 — are both published on the content page, neither is presented as the answer, and the reason is in §5.

4. Running it

cd /workspace/artifacts/wiki
node scripts/report_archives.mjs                 # the audit trail below
node scripts/report_archives.mjs --wiki          # DokuWiki tables
node scripts/report_archives.mjs --list          # the 122 papers, by year
node scripts/report_archives.mjs --quotes Wayback   # evidence quotes
node scripts/quote_check.mjs --temporal 'wayback|internet archive|archive\.org|web-archive|common ?crawl|http ?archive' --show 30

The unedited output of the first command, 2026-08-13, is in §12. Every figure on the content page appears in it.

5. The two counts, and why both are published

temporal.mode is an enum and enums are the stable part of this extraction, so web-archive = 68 papers looks like the publishable number. It is a floor, and this was established by hand rather than assumed:

  • [1Singh, Sachin Kumar; Mahmud, Faisal; Ricci, Robert; Siby, Sandra (2026): "The Empire Strikes Back (at Your Privacy): An Archaeology of Tracking on Government Websites", Proceedings on Privacy Enhancing Technologies 2026(2):108-126. (DOI)] (PETS 2026) takes all of its measured content from the Wayback Machine — 16,500 archived government websites, 1996–2025, two snapshots per site per year. (Its site list comes from a prior IMC 2024 study; the bytes it measures are all archival.) Its temporal.mode is existing-dataset, with source = “Internet Archive Wayback Machine”. It is not in the 68.
  • The extraction is not wrong to do this. From the paper's own framing the archive is a pre-existing dataset. The enum answers “where did the bytes come from as a matter of study design”, not “did you touch an archive”.

So the report also sweeps five free-text fields — temporal.source, tools[].name, otherToolsMentioned[].name, population[].sourceList, classification[].resourceName — for archive names, folds them, and takes the union per paper. That gives 122. It is a ceiling: it counts a paper that used the Wayback Machine once to check a dead link the same as one built on it.

  • 59 of the 68 enum papers are also caught by the name sweep. The 9 that are not gave a source too vague to match (e.g. an unnamed “archived version”), or named a non-web archive (Debian snapshot, APKPure) that the fold excludes.
  • 63 papers are named-but-not-enum: the enum's undercount factor is 1.8×.

The content page gives both, says which is which, and uses 122 for the headline share because the alternative is publishing a number known to be low.

6. The fold, and its residue in full

Free-text archive names are the exact case the corpus README warns about: ~20% run-to-run agreement on exact strings. Measured here on 2026-08-13, the Internet Archive alone appears under 27 distinct spellings, and counting exact strings would have split one archive into 27 and reported the largest as “Wayback Machine, 35 papers” instead of 82.

scripts/arch_fold.mjs is a first-match-wins ordered rule list. Three decisions a reasonable person would have made differently:

  1. Access APIs and client libraries fold into the archive. Wayback CDX Server API, Wayback Availability API, Wayback Machine Metadata API, WaybackPy, Waybackpack, WayBack Machine Scraper all become Internet Archive (Wayback Machine). A paper naming only the CDX API is a paper using the Internet Archive. Keeping them separate would have produced a spurious “six archives” tail.
  2. Archiving software is a separate family from archive services. Heritrix, pywb, Webrecorder and warcprox form their own row (6 papers) and are excluded from the 122. A paper replaying its own WARCs through pywb is not using a public archive, and merging the two would have inflated archive use with self-archiving plumbing.
  3. CC-News is separated from Common Crawl. CC-News is a Common Crawl product, but in this corpus it is used as an NLP training corpus, not as an archive of pages. It gets its own family (3 papers) and is excluded from the 122; names that pair it with other NLP datasets (“The Pile and CC-News”, “WikiText-103, XSum, Amazon Reviews, CC-News, and Reddit”) are excluded outright. Folding it into Common Crawl would have put LLM-training papers into an archives page's headline count.

Unmapped residue: 0 names. Every string that matched the candidate regex was either folded into a family or explicitly excluded.

Excluded as not-a-web-page-archive: 21 distinct names, printed here in full so the exclusions are auditable rather than invisible:

    4  CleanMX
    3  APKPure
    1  Spamtrap feed and CleanMX feed
    1  Google Play Store and six online sources: Androidapps, Apkhere, Apkmirror, Apkpure, Uptodown, and Aptoide
    1  archive.org/details/stackexchange
    1  4plebs
    1  Debian snapshot
    1  warc-clueweb2
    1  Google Play, apkpure.com, and apktada.com
    1  apps hosted by several third party app markets including apkpure, an unofficial mirror of Google Play and wandoujia, a major app market in Mainland China
    1  Internet Archive Metadata API
    1  SiteInspire
    1  Google Play, third-party websites (APKPure and 360 Store)
    1  archive.org 1% sampled tweet stream
    1  Google Play store based on the rank of APKPure
    1  CleanMX feed
    1  The Pile and CC-News
    1  Cosmopedia, WikiText-103, XSum, Amazon Reviews, CC-News, and Reddit
    1  WikiText-103, XSum, Amazon Reviews, CC-News, and Reddit
    1  Internet Archive Stack Exchange data dump
    1  Enron, Patient, CC-News, and IAPR-TC-12 datasets

One of those is a judgement call worth flagging: Internet Archive Metadata API is excluded because in that paper it retrieves item metadata from archive.org's general collections, not web-page captures — but the same API is what [2Hantke, Florian; Calzavara, Stefano; Wilhelm, Moritz; Rabitti, Alvise; Stock, Ben (2023): "You Call This Archaeology? Evaluating Web Archives for Reproducible Web Security Measurements", in: Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security, pp. 3168–3182. Association for Computing Machinery, New York, NY, USA. (DOI) (Link)] uses to resolve Wayback contributors. The exclusion is right for this corpus and would be wrong in a different one.

The full spelling-by-family listing is in the script output in §12.

7. Corrections made to the prior page

Six statements on the previous revision were wrong, stale, or correct-but-unsafe-to-generalise. Each was checked against a primary source before being changed.

Prior text Problem What it says now
“The archive includes 800+ archived web pages” Wrong by orders of magnitude even as a typo for “800+ billion”; superseded regardless. One trillion, October 2025, cited to the Internet Archive's own announcement.
“Wayback Machine applies rate limiting to their API to no more than 15 requests per minute”, citing archive.org/details/toomanyrequests_20191110 Misreads its own source. That notice limits Save Page Now submissions, not reads: “We are limiting the number of URLs you can submit to be Archived to the Wayback Machine, using the Save Page Now features, to no more than 15 per minute.” A researcher planning a read crawl would have taken the wrong number. States there is no published read-side limit, gives the submission limit in a footnote with the verbatim quote, and gives two usable operational numbers instead: [1Singh, Sachin Kumar; Mahmud, Faisal; Ricci, Robert; Siby, Sandra (2026): "The Empire Strikes Back (at Your Privacy): An Archaeology of Tracking on Government Websites", Proceedings on Privacy Enhancing Technologies 2026(2):108-126. (DOI)]'s 3–5 s sequential delay, and the wayback library's 0.4 CDX calls/s default.
“Portugal's public library service Arquivo.pt Arquivo.pt is operated by FCCN, a unit of Portugal's FCT (Foundation for Science and Technology). Not a library service. Corrected, with its January 2026 holdings from its own “in numbers” page.
“there are numerous archives out there” + a TODO for more on alternatives True in 2023, misleading now: the aggregator that made “numerous archives” discoverable and queryable is decommissioned. A <WRAP important> on the Memento Time Travel shutdown, plus measured coverage for the alternatives that remain.
Implicit throughout: archives store pages Never stated what a static crawl does not store, which is the single most consequential fact for a privacy measurement. The whole What an Archive Preserves section.
“let's take the 1000 most popular websites … AND rank = 1000 The query is correct, but only for this one value, and the page did not say why. CrUX rank magnitudes are cumulative-but-exclusive buckets: rank = 10000 returns ranks 1,001–10,000, not the top 10,000. A reader generalising the example would have silently dropped the head of their own sample. The bucket semantics are now stated, with the rank ⇐ N form and the Chrome team's own worked example footnoted.

The prior page's claim that “at the time of archiving, crawlers typically read and store web resources but do not execute them” was correct and is retained — the extension quantifies it rather than replacing it.

8. Quotes and figures spot-checked

node scripts/quote_check.mjs –temporal '…' '' over the archive-related temporal tuples: 118 quotes checked, 62 exact, 35 partial (≥60% of five-word windows), 21 below threshold, 0 with no full text on disk. Three of the below-threshold cases were then read by hand against ''paper.cols.txt:

Paper Quote Verdict
WWW 2022, Through the Lens of the Web Conference Series “we had to \”summon\“ the Internet Archive Wayback Machine to exhume now-disappeared websites” Real. Fails automatically because the source text is column-spliced as summon“ the Internet ArchiveWayback.
NDSS 2025, Duumviri “using Wayback Machine [28].” Real, line 696. Fails only because a five-word-window test on a five-word quote is degenerate.
CCS 2016, Lurking Malice in the Cloud “Searching the Common Crawl dataset, collected in February 2015” Real. The source reads “Common Crawl [?] dataset, collected in February 2015” — the extractor dropped an unresolved citation marker.

Figures quoted on the content page from individual papers were read in their own full text, not taken from the extraction:

Figure Source Checked at
73.89% / 95.31% static vs dynamic trackers (2016), 73.10% / 91.56% (2022) [2Hantke, Florian; Calzavara, Stefano; Wilhelm, Moritz; Rabitti, Alvise; Stock, Ben (2023): "You Call This Archaeology? Evaluating Web Archives for Reproducible Web Security Measurements", in: Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security, pp. 3168–3182. Association for Computing Machinery, New York, NY, USA. (DOI) (Link)] Table 3 2023/CCS/you-call-this-archaeology…/paper.cols.txt
8.0% syn / 7.0% sem header differences (US), COOP 69.4% [2Hantke, Florian; Calzavara, Stefano; Wilhelm, Moritz; Rabitti, Alvise; Stock, Ben (2023): "You Call This Archaeology? Evaluating Web Archives for Reproducible Web Security Measurements", in: Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security, pp. 3168–3182. Association for Computing Machinery, New York, NY, USA. (DOI) (Link)] Table 4 same
1.26% (81/6,412) unexplained; 93 sites UA-sniffing [2Hantke, Florian; Calzavara, Stefano; Wilhelm, Moritz; Rabitti, Alvise; Stock, Ben (2023): "You Call This Archaeology? Evaluating Web Archives for Reproducible Web Security Measurements", in: Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security, pp. 3168–3182. Association for Computing Machinery, New York, NY, USA. (DOI) (Link)] §5.3 same
1.7%–34.6% impure neighbourhoods; NULL contributor 24% [2Hantke, Florian; Calzavara, Stefano; Wilhelm, Moritz; Rabitti, Alvise; Stock, Ben (2023): "You Call This Archaeology? Evaluating Web Archives for Reproducible Web Security Measurements", in: Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security, pp. 3168–3182. Association for Computing Machinery, New York, NY, USA. (DOI) (Link)] Table 2, §4.2.3 same
8% fewer sites (closest vs union), 12% fewer (intersection vs closest) [2Hantke, Florian; Calzavara, Stefano; Wilhelm, Moritz; Rabitti, Alvise; Stock, Ben (2023): "You Call This Archaeology? Evaluating Web Archives for Reproducible Web Security Measurements", in: Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security, pp. 3168–3182. Association for Computing Machinery, New York, NY, USA. (DOI) (Link)] §4.3 same
Stabilisation: 1,332 domains on day 1, ~1,720 and ~1,760 on days 2–3 [2Hantke, Florian; Calzavara, Stefano; Wilhelm, Moritz; Rabitti, Alvise; Stock, Ben (2023): "You Call This Archaeology? Evaluating Web Archives for Reproducible Web Security Measurements", in: Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security, pp. 3168–3182. Association for Computing Machinery, New York, NY, USA. (DOI) (Link)] §5.2 same
2.2×–5.3× slowdown; >100 requests/site dynamic; 2,026 comparable sites [2Hantke, Florian; Calzavara, Stefano; Wilhelm, Moritz; Rabitti, Alvise; Stock, Ben (2023): "You Call This Archaeology? Evaluating Web Archives for Reproducible Web Security Measurements", in: Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security, pp. 3168–3182. Association for Computing Machinery, New York, NY, USA. (DOI) (Link)] §4.3, §5.4 same
~55% fresh hits on stratified Tranco sample, best alternative 7% [2Hantke, Florian; Calzavara, Stefano; Wilhelm, Moritz; Rabitti, Alvise; Stock, Ben (2023): "You Call This Archaeology? Evaluating Web Archives for Reproducible Web Security Measurements", in: Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security, pp. 3168–3182. Association for Computing Machinery, New York, NY, USA. (DOI) (Link)] §3.3 same
13 endpoints with ≥1 hit; ≤8% coverage for library/museum endpoints; Library of Congress 0 fresh hits; Arquivo 3,412 hits / 338 fresh; IA 4,061 / 3,713 [2Hantke, Florian; Calzavara, Stefano; Wilhelm, Moritz; Rabitti, Alvise; Stock, Ben (2023): "You Call This Archaeology? Evaluating Web Archives for Reproducible Web Security Measurements", in: Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security, pp. 3168–3182. Association for Computing Machinery, New York, NY, USA. (DOI) (Link)] Table 1 same
45.8% of pages differ static vs dynamic; 54.2% equivalent; 10K pages [3Zhu, Jingyuan; Sun, Huanchen; Madhyastha, Harsha V. (2025): "Toward Better Efficiency vs. Fidelity Tradeoffs in Web Archives", in: Proceedings of the ACM Internet Measurement Conference, pp. 1025-1031. (DOI)] §2.3 2025/IMC/toward-better-efficiency…/paper.cols.txt
“only around 5% of the archived pages available on the Wayback Machine were crawled with a browser” [3Zhu, Jingyuan; Sun, Huanchen; Madhyastha, Harsha V. (2025): "Toward Better Efficiency vs. Fidelity Tradeoffs in Web Archives", in: Proceedings of the ACM Internet Measurement Conference, pp. 1025-1031. (DOI)] §1 same — see §10, the appendix that derives it is not in the extracted text
3× throughput gap, browser vs browserless [3Zhu, Jingyuan; Sun, Huanchen; Madhyastha, Harsha V. (2025): "Toward Better Efficiency vs. Fidelity Tradeoffs in Web Archives", in: Proceedings of the ACM Internet Measurement Conference, pp. 1025-1031. (DOI)] §1 same
16.1% of requests attempted to escape; 17.2% of URLs; 11.5% of domains. Robots exclusion 2.0% of requests, not-archived 1.4% of requests — re-read after finding B1, which caught the first draft using the wrong Table 2 row [4Lerner, Ada; Simpson, Anna Kornfeld; Kohno, Tadayoshi; Roesner, Franziska (2016): "Internet Jones and the Raiders of the lost trackers: An archaeological study of web tracking from 1996 to 2016", in: 25th USENIX Security Symposium (USENIX Security 16). (Link)] Table 2 and §5 2016/USENIX/internet-jones…/paper.cols.txt
73% of Top 500 / 80% of Top Million vulnerable [5Lerner, Ada; Kohno, Tadayoshi; Roesner, Franziska (2017): "Rewriting History: Changing the Archived Web from the Present", in: Proceedings of the ACM SIGSAC Conference on Computer and Communications Security, pp. 1741-1755. (DOI)] §6 2017/CCS/rewriting-history…/paper.cols.txt
423,265 of 758,192 URLs (55.8%); median 3 snapshots [6Weinberg, Zachary; Sharif, Mahmood; Szurdi, Janos; Christin, Nicolas (2017): "Topics of Controversy: An Empirical Analysis of Web Censorship Lists", in: Proceedings on Privacy Enhancing Technologies. (DOI)] §4.2 2017/PETS/topics-of-controversy…/paper.cols.txt
16.5K of 18.9K sites archived; two snapshots per year; 3–5 s delay; 2006 list flagged 67, June 2025 list flagged 50, 6 in common [1Singh, Sachin Kumar; Mahmud, Faisal; Ricci, Robert; Siby, Sandra (2026): "The Empire Strikes Back (at Your Privacy): An Archaeology of Tracking on Government Websites", Proceedings on Privacy Enhancing Technologies 2026(2):108-126. (DOI)] §3.1–3.2 2026/PETS/the-empire-strikes-back…/paper.cols.txt
70% of SoK papers runnable with WebREC, 48% against .web archives [7Hantke, Florian; Snyder, Peter; Haddadi, Hamed; Stock, Ben (2025): "Web Execution Bundles: Reproducible, Accurate, and Archivable Web Measurements", in: Proceedings of the USENIX Security Symposium. (Link)] abstract 2025/USENIX/web-execution-bundles…/paper.cols.txt

Rejected: figures the extraction offered and the page does not use

  • detection.prevalence for archive papers generally. The field is populated and useful, but most of the values are results about the web obtained via an archive (CSP adoption, header-bidding latency, tracker counts), not results about archives. Only the four that measure the instrument itself — Lerner's escape rate, Rewriting History's vulnerability rate, Weinberg's coverage, Singh's coverage — are on the page. Publishing the rest would have made an archives page into a summary of what archive papers happened to find.
  • A per-year series ending in 2026. The bucketed table is used instead, with 2025–2026 labelled provisional in the table itself. The unbucketed per-year numbers are in §11 for anyone who wants to cut it differently; they are not on the content page, because a 2026 point that looks like a rise is an artefact of the two venues that have not happened yet.
  • classification.target for archive papers. Computed (§11, section 6) and interesting — 35.7% classify website categories — but it describes what these particular papers were about rather than anything a reader should do, so it stayed in the audit trail.

9. External sources

Every external claim on the content page, how it was verified, and what was rejected. All checks 2026-08-13.

Claim Source How verified
Memento Time Travel decommissioned 2025; site now static GitHub Pages https://mementoweb.org/about/ Primary. Fetched and read: “the site was taken down towards the end of 2025 … The Time Travel service was a Memento aggregator … It operated between 2015 and 2025 as an official service of the Research Library of the Los Alamos National Laboratory.” Corroborated independently: timetravel.mementoweb.org and labs.mementoweb.org do not resolve in DNS, while mementoweb.org resolves to GitHub Pages IPs (185.199.108–111.153).
RFC 7089 still current, Informational rfc-editor.org Fetched; status “not an Internet Standards Track specification … published for informational purposes”; no Obsoleted-by or Updated-by header.
Wayback Machine passed 1 trillion pages, October 2025 https://blog.archive.org/2025/10/31/one-trillion-web-pages-archived-internet-archive-celebrates-a-civilization-scale-milestone/ Primary (the Internet Archive's own blog). URL found by listing the blog's own search results rather than by guessing, after two guessed URLs 404ed.
“15 per minute” is a Save Page Now limit https://archive.org/details/toomanyrequests_20191110 Primary, and it is the source the prior page cited. Read in full; the text is unambiguous.
wayback library defaults: 0.4 CDX calls/s, 8 Memento calls/s; IA limits not published https://wayback.readthedocs.io/en/latest/usage.html Fetched. Maintained research library (EDGI). Its own docs say the Internet Archive's actual limits are not documented.
Arquivo.pt: 23,048 million files, 73 million sites, 1.6 PB, January 2026; operated by FCCN/FCT https://sobre.arquivo.pt/en/about/press/the-portuguese-web-archive-in-numbers/ Primary. Its Memento TimeMap endpoint was also called directly and returns valid rel=“memento” links.
Common Crawl monthly; CC-MAIN-2026-30 is the July 2026 index https://index.commoncrawl.org/collinfo.json Primary, machine-readable.
CrUX rank is a cumulative-but-exclusive magnitude bucket https://developer.chrome.com/blog/crux-rank-magnitude Primary (Chrome team), read in full after a review pass caught a first draft that quoted a non-verbatim sentence and asserted “random order within a bucket” — a claim the blog does not make and which came from a different source (a derived top-list repository). Both were removed. What the blog does establish, with a worked query, is the cumulative semantics and the October 2022 half-steps.
MemGator is a live, maintained Memento aggregator https://memgator.cs.odu.edu/ , https://oduwsdl.github.io/MemGator/archives.json , GitHub API Primary, and it overturned a claim we had already written. A first draft said there is “no maintained replacement aggregator” for Time Travel. The external-currency review disproved it. Verified independently: the hosted instance returns 200 and its TimeMap produces valid aggregated rel=“memento” links; the repo is not archived and was last pushed 2026-04-09; archives.json has 20 entries of which 7 are flagged inactive, some labelled ”(DEFUNCT)“ or ”(MOVED TO A-IT)“ in the file itself. Its own configured list URL is a dead git.io shortener that still redirects, which is how the real path was found.
HTTP Archive tables, BigQuery setup, cost guide https://har.fyi/ Reachable, current; pages/requests schema and wptid/is_root_page confirmed from its reference pages.
WARC is ISO 28500, current spec WARC 1.1 https://iipc.github.io/warc-specifications/ Fetched; WARC 1.1 present with status “standard”, ISO 28500 identified.
pywb v2.9.1 (Oct 2025); browsertrix-crawler v1.14.2 (Aug 2026); Browsertrix hosted; warcio maintained; cispa/webrec exists GitHub API /releases/latest and /repos Machine-checked, not recalled.
Wayback CDX and Availability APIs functional Direct calls Availability API returned valid JSON first time. CDX returned a 504 on the first attempt and succeeded on all three retries — which is why the content page tells readers to retry with backoff rather than read a 504 as absence.

Rejected sources. Two SEO-oriented pages (maxintel.org, archivarix.com) returned by search assert a specific Wayback read limit of “60 requests per minute”, an escalating firewall ban, and a causal story tying throttling to the October 2024 breach. None of it is on the content page. No primary source states any of it; the Internet Archive publishes no read-side limit; and the one peer-reviewed source that looked at this [2Hantke, Florian; Calzavara, Stefano; Wilhelm, Moritz; Rabitti, Alvise; Stock, Ben (2023): "You Call This Archaeology? Evaluating Web Archives for Reproducible Web Security Measurements", in: Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security, pp. 3168–3182. Association for Computing Machinery, New York, NY, USA. (DOI) (Link)] explicitly declined to probe the limit on ethical grounds. A plausible-sounding number with no primary source is exactly the failure this site is meant to avoid.

Not fetched, deliberately: a fresh HTTP Archive crawl size. The report page's sample-size series is only reachable through a rendered chart, and har.fyi states “over 1 million pages” which is inconsistent with the ~13M the prior page quotes for February 2025. The page therefore keeps its dated February 2025 example and tells readers to check the live report rather than trust either number. See §10.

10. What could not be established

  • The derivation of the “5% crawled with a browser” figure. [3Zhu, Jingyuan; Sun, Huanchen; Madhyastha, Harsha V. (2025): "Toward Better Efficiency vs. Fidelity Tradeoffs in Web Archives", in: Proceedings of the ACM Internet Measurement Conference, pp. 1025-1031. (DOI)] states it in the introduction and attributes it to their Appendix B; the appendix is not present in the extracted full text. The content page attributes it as the authors' estimate, which is what it is, and does not restate the method.
  • Current HTTP Archive crawl size. See §9. Two public sources disagree by an order of magnitude and neither is queryable without BigQuery credentials.
  • Whether archive use is really flat, or whether the enum's drift makes it look flat. The trend table uses the name sweep, which is uniform across years, so the shape should be sound — but the 68/122 gap is itself a property of how the extractor read papers, and nobody has checked whether that reading changed over the corpus's sixteen years.
  • Whether the field's dependence on one archive matters. Raised as an open question on the content page. Nothing in the corpus can answer it: it needs a study that runs the same measurement through two independent archives, and the only viable second archive was rejected on coverage rather than validated on agreement.
  • Four duplicate-entry pairs exist in bibliography, all predating this run: lerner2016internet/lerner2016_internet (USENIX Sec 2016), bouhoula2024automated/bouhoula2024_automated (USENIX Sec 2024), fouad2022my/fouad2022_cookie (PETS 2022), and bottger2025_regional/boettger2025_regional (PETS 2025, differing only in umlaut transliteration). The last three were found by the citations reviewer, not by us. None were fixed here: both keys in each pair resolve, nothing breaks, and silently deleting a key another page may cite is a worse failure than an untidy bibliography. Flagged for whoever next edits that file.

11. Review passes, 2026-08-13

Four reviewers, all told explicitly that the author's context might not be exhaustive, all handed the page text, both scripts, the script output and these notes. The three focused ones ran in parallel first; their findings were acted on before the generic pass, which then ran over the corrected pages. 30 findings in total, 29 accepted, 1 rejected. Pass D — the one with no checklist — found the single worst defect, and found it by reading code the other three had already been given.

Pass A — figures against the script (Claude Sonnet)

Re-ran report_archives.mjs, diffed against the committed output, and re-derived every paper-sourced figure from the full texts.

# Finding Disposition
A1 The lead paragraph said “only 8 (6.6%) used an archive as their sole source — the other 93% ran a live crawl alongside it”. 93% is just 100−6.6 and does not mean “ran a live crawl”; the page's own §5 table says 58.2%. An internal contradiction between the lead and the table. Accepted. The lead now says 58.2%.
A2 The “8 (6.6%) sole source” figure suffers from the exact enum-coding bias the page warns about for the headline count, and [1Singh, Sachin Kumar; Mahmud, Faisal; Ricci, Robert; Siby, Sandra (2026): "The Empire Strikes Back (at Your Privacy): An Archaeology of Tracking on Government Websites", Proceedings on Privacy Enhancing Technologies 2026(2):108-126. (DOI)] — the page's own flagship example — is excluded from it. The caveat was never attached. Accepted, and it changed the page's substance. A second, looser reading was added to the script: papers with no live-crawl, active-probing or passive-collection tuple at all, i.e. that collected nothing themselves. That is 31 papers (25.4%), four times the strict count, and it is now the number the page leads with; 8 is kept as the floor, italicised.
A3 The archive-family table gave “archiving software: 6 papers, 4.9%” as a share of the 122 — but 4 of those 6 are not in the 122, because the fold deliberately excludes self-hosted archiving from the population. A share of a population its members are excluded from. Same bug latent on the CC-News row. Accepted — a real bug. The script now blanks the share column for excluded families, prints how many of their papers also name a real archive, and labels them [not in the 122]. The content page moved both families into a sentence below the table.
A4 Stabilisation: the page rounded Hantke et al.'s day-2 and day-3 figures (1,720 and 1,760) to ”~1,700 on each of days 2 and 3“. Accepted. Both numbers restored.
A5 “16,500 (87%)” is our arithmetic on Singh et al.'s raw counts; the paper's own headline is 88% averaged per country. Accepted. Both figures now given, each labelled.
A6 Latent bug: the §4 “archive-attributed tuple” filter tested foldArchive(source) for truthiness without checking WEB_PAGE_ARCHIVES, so excluded families could have counted. Does not change today's figure of 94. Accepted. Fixed anyway — a filter that is right by luck is one data update from being wrong. Fixing it moved three cells: spanStart 72→71 (76.6%→75.5%) and cadence 34→33 (36.2%→35.1%). Those are now the published numbers.

Everything else the reviewer checked — the full Hantke Tables 1–4, the Zhu, Lerner 2016, Lerner 2017, Weinberg and Singh figures, and a byte-for-byte re-run of the script — matched.

Pass B — citations and quotes (Claude Sonnet)

# Finding Disposition
B1 “robots-exclusion (1.4% of requests)” reads the wrong row of Lerner et al.'s Table 2. Robots exclusions are 1,115/56,173 = 2.0%; 1.4% is the Not Archived row. Accepted, after checking Table 2 in the full text ourselves. The sentence was rewritten to give all three failure modes with their correct rows.
B2 The ”~1.55% of unexplained live-crawl variance reported independently by Roth et al.“ is a claim we took from Hantke et al.'s prose. The paper it refers to is The Security Lottery, USENIX Security 2022 — not roth2020complex, which the same page cites twice for something else. A reader could not tell which Roth paper was meant, and the right one was not in the bibliography. Accepted. The primary source was read: “our crawl detected 127 sites which have some type of intra-test inconsistency”, against “8,174 sites made use” of at least one mechanism. roth2022_security added to the bibliography (pages 2047–2064, verified from the PDF's own page markers), the claim re-attributed, and the wording tightened from “unexplained variance” to what the paper actually measures.
B3 The CrUX footnote presented a non-verbatim sentence as a direct quote, and the “random ordering within a bucket” claim it supported is not in the cited blog post at all. Accepted without argument — this is the worst kind of error on this site. The quote came from a search-result summary that blended two sources; it was never checked against the page. Both the fabricated quote and the unsupported claim are gone, replaced with the blog's own worked example, verbatim.
B4 lerner2017_rewriting had no pages field. Accepted. 1741–1755, verified from the PDF's page markers.
B5 Three further duplicate-entry pairs in the shared bibliography beyond the one we knew about. Accepted as a finding, rejected as a fix. Recorded in §10; not repaired, for the reason given there.
B6 87% vs the paper's 88%. Duplicate of A5.
B7 The provenance page said Singh et al. draws its “entire dataset” from the Wayback Machine; the site list comes from a prior study. Accepted. Reworded to “all of its measured content”.

Pass C — external currency (Claude Sonnet)

# Finding Disposition
C1 The page claimed three times that there is no maintained replacement for the Memento Time Travel aggregator. MemGator is live, hosted by the same Old Dominion University group, and actively maintained. Accepted, and it is the most valuable finding of the four passes. Verified independently (§9). All three claims rewritten; MemGator now has its own paragraph, the Open Questions item was recast from “no successor” to “the census needs redoing with a smaller instrument”, and the national-archives bullet now points at archives.json as the machine-readable inventory.
C2 curl against web.archive.org returns a spoofed 498/404 from this sandbox while the same requests succeed from other HTTP clients — a reviewer testing only with curl could wrongly conclude the endpoints are dead. Noted, no page change. Our own curl probes against the CDX API did succeed (once after a 504 retry), so the block is intermittent rather than absolute. Recorded here so the next run does not mistake it for an outage.

The reviewer independently re-verified and confirmed: the Memento shutdown text, RFC 7089's status, the one-trillion-pages announcement, the Save Page Now notice, the Availability/CDX/replay/id_ endpoints, httparchive.crawl.* table names, har.fyi's BigQuery procedure, Arquivo.pt's operator and figures, Common Crawl's latest index, pywb v2.9.1, browsertrix-crawler v1.14.2, Browsertrix, warcio, cispa/webrec, the WARC 1.1 spec, Wikipedia's list, the wayback library defaults, and that HTTP Archive still runs WebPageTest.

Pass D — generic, no checklist (Claude Fable)

Ran last, over both pages, the scripts and the previous published revision. Fifteen findings; the four most serious are recorded here in full because they are the ones the focused passes were structurally unable to catch.

# Finding Disposition
D1 The headline share divided a numerator drawn from all 5,859 papers by a denominator of 5,118 empirical ones. namedWebArchive and modeArchive were never intersected with empirical, so “122 of 5,118 empirical papers” asserted a subset relation nothing enforced. Found by reading the script, not the page — the figures pass had checked page against script and both agreed, because both were wrong. Accepted; the most consequential finding of the run. 7 of the 122 are not empirical. The script now intersects, and the numbers moved: headline 2.4%→2.2% (122→115), live-crawl 24.6%→24.2%, four of five trend rows and five of seven venue rows. The 7 non-empirical papers are printed by the script so the gap stays visible.
D2 The provenance page's own §8 quote table still carried the pre-B1 (wrong) reading of Lerner's Table 2 while the content page carried the corrected one — a contradiction on the page whose job is checking numbers. Accepted. §8 corrected and annotated with the finding that caused it.
D3 Three derived glosses overstated the page's own figures: “more than twenty percentage points” (true for 2016, not 2022), “a factor of about four” (3.5× and 4.2×), “by an order of magnitude” for escapes (8×). All were the page's arithmetic on correctly quoted numbers, which is precisely the gap between a figures-vs-script check and the truth. Accepted. All three softened to what the numbers carry.
D4 “the papers that use archives increasingly say what they did about it” — an unsupported trend claim, when the schema would allow measuring it. Accepted. Rewritten as an explicitly labelled impression from reading, with the note that the reporting figures are not time-sliced.

The other eleven, all accepted: the go/no-go passage was buried at the end of a how-to section and is now its own section near the top with a two-column table; “roughly two thirds of endpoints” did not follow from 13 of 64 and was replaced with the paper's own counts; the stabilisation counts had no denominator (11,364 domains, added); Lerner's 16.1% escape rate is from 2016 and is now dated as such; the page demanded escape-blocking without saying how (one interception rule, now given, plus the instruction to report the count); “a snapshot is static so a later reader can fetch the same one” ignored retroactive exclusions (now qualified); “Recording Your Own Archive” claimed “no escapes”, which is a property of the replayer not the WARC (now “escapes you can block because you control the replayer”); the wayback library was buried in a rate-limit footnote and is now in the access-paths list; the 55%/7% coverage figure was stated twice verbatim (deduplicated); Methodology and limitations was structurally a subsection of What to Report and has moved back under Use in Publications; and the page had neither the What to Read First nor the Related Pages section its neighbours carry (both added). One nit was also taken: the REPLAY_ARCHIVES parenthetical under-described its own definition.

Rejected from pass D: nothing. All fifteen were accepted.

12. The report script and its unedited output

scripts/report_archives.mjs, run 2026-08-13 against data/extract/run1 (5,859 papers), after the three bug fixes from review passes A and D. Nothing below is edited; the full spelling-by-family listing that §6 refers to is the block headed Raw spellings folded into each family, and the EXCLUDED block is the same residue printed in §6.

========================================================================
POPULATIONS
========================================================================
corpus                                              5859
empirical (measured the world as it is)             5118
crawled   (ran an automated web crawl)              1120
with >=1 temporal (data-provenance) tuple           5342

========================================================================
1. DATA PROVENANCE (temporal.mode), of papers with >=1 temporal tuple
========================================================================
Multi-valued: one paper can both crawl live and consult an archive, so the
column does not sum to 100%. not-stated is a value, never an answer.

temporal.mode       papers  share of 5342
------------------  ------  -------------
existing-dataset    2534    47.4%
active-probing      1780    33.3%
live-crawl          1261    23.6%
passive-collection  1012    18.9%
not-stated          353     6.6%
web-archive         68      1.3%

mode=web-archive                68 papers
mode=live-crawl                 1261 papers
ratio live-crawl : web-archive  18.5 : 1
(shares of `empirical` are computed further down, on the intersected sets)

========================================================================
2. NAMED A WEB ARCHIVE, folded (5 free-text fields, union per paper)
========================================================================
papers naming a web-page archive service            122
  ... of which a REPLAY archive (IA, Arquivo, ...)  85
  ... i.e. Common Crawl / HTTP Archive only         37

SHARES OF EMPIRICAL — numerator intersected with `empirical`, never the raw count:
  named an archive AND empirical                    115   2.2%  (of 5118)
  of the 122, NOT empirical                         7
  mode=web-archive AND empirical                    65   1.3%
  mode=live-crawl AND empirical                     1236   24.2%

The 7 papers in the 122 that are not empirical (mostly LLM-training uses of Common Crawl):
  2014 USENIX   iSeeYou: Disabling the MacBook Webcam Indicator LED
  2014 USENIX   Automatically Detecting Vulnerable Websites Before They Turn Malicio
  2021 USENIX   Extracting Training Data from Large Language Models
  2022 WWW      WebFormer: The Web-page Transformer for Structure Information Extrac
  2025 USENIX   Private Investigator: Extracting Personally Identifiable Information
  2026 NDSS     Was My Data Used for Training? Membership Inference in Open-Source L
  2026 WWW      MCP vs RAG vs NLWeb vs HTML: A Comparison of the Effectiveness and E
papers with temporal.mode = web-archive             68
  ... of those, also caught by the name sweep       59
papers the mode enum MISSES (named, mode != archive) 63
undercount factor of the enum                       1.8x

Folded families (paper-counted; multi-valued, so shares do not sum).
IMPORTANT: two families are NOT part of the 122 — self-hosted archiving
software, and CC-News used as an NLP corpus. Their shares would be shares of
a population they are excluded from, so the share column is blank for them
and their papers are counted separately.

archive family                                              papers  share of 122  note                                 raw spellings
----------------------------------------------------------  ------  ------------  -----------------------------------  -------------
Internet Archive (Wayback Machine)                          82      67.2%                                              27
Common Crawl                                                28      23.0%                                              12
HTTP Archive                                                16      13.1%                                              5
archiving software (Heritrix, pywb, ...)  [not in the 122]  6       —             2 of these also name a real archive  4
unspecified web archive                                     4       3.3%                                               6
CC-News (text corpus from Common Crawl)  [not in the 122]   3       —             2 of these also name a real archive  5
Memento / Time Travel                                       1       0.8%                                               1

Raw spellings folded into each family — this is what folding bought:
  Internet Archive (Wayback Machine)  (27)
      Archive.org
      Archive.org historical snapshots
      Internet Archive
      Internet Archive / Wayback Machine
      Internet Archive Wayback Machine
      Internet Archive and Google page snapshots
      Internet Archive and other web archives
      Internet Archive's Wayback Machine
      Internet Archive: Wayback Machine
      Internet Wayback Machine
      WayBack Machine Scraper
      Wayback Availability API
      Wayback CDX API
      Wayback CDX Server API
      Wayback Machine
      Wayback Machine / Internet Archive
      Wayback Machine API
      Wayback Machine Availability JSON API
      Wayback Machine archives
      WaybackMachine CDX API
      WaybackPy
      Waybackpack
      archive.org
      authors' archives, community-shared snapshots, and Internet Archive
      legal documents containing web.archive.org URLs
      live web and Internet Archive
      public firmware archives, official update channels, and Wayback Machine
  Common Crawl  (12)
      Citizen Lab lists, full Tranco list, and Common Crawl Project
      Common Crawl
      Common Crawl CC-MAIN-2021-31
      Common Crawl Project
      Common Crawl and Tranco
      Common Crawl dataset
      Common Crawl email-pattern subset
      Common Crawl's Web Crawl Data
      CommonCrawl
      ICANN Centralized Zone Data Service and full Common Crawl host list
      TLD zone files, Citizen Lab test lists, Tranco list, and Common Crawl project
      subset of the Common Crawl dataset
  unspecified web archive  (6)
      Own weekly crawls and Web Archive
      SWIPE web archive
      Web Archive
      Web Archive API
      custom domain pool from historical snapshots
      web archive snapshots and search engine indexes
  HTTP Archive  (5)
      HTTP Archive
      HTTP Archive 1.2
      HTTP Archive and device data
      HTTP Archive dataset
      HTTPArchive
  CC-News (text corpus from Common Crawl)  (5)
      CC-News
      Common Crawl CC-News
      Common Crawl News
      Common Crawl News (CC-News)
      Common Crawl News (English articles after language filtering)
  archiving software (Heritrix, pywb, ...)  (4)
      Heritrix
      Webrecorder
      pywb
      warcprox
  Memento / Time Travel  (1)
      Memento API

========================================================================
2b. RESIDUE — printed so the part that could not be classified stays visible
========================================================================
UNMAPPED raw names (matched the candidate regex, no fold rule): 0

EXCLUDED as not-a-web-page-archive: 21 distinct names
    4  CleanMX
    3  APKPure
    1  Spamtrap feed and CleanMX feed
    1  Google Play Store and six online sources: Androidapps, Apkhere, Apkmirror, Apkpure, Uptodown, and Aptoide
    1  archive.org/details/stackexchange
    1  4plebs
    1  Debian snapshot
    1  warc-clueweb2
    1  Google Play, apkpure.com, and apktada.com
    1  apps hosted by several third party app markets including apkpure, an unofficial mirror of Google Play and wandoujia, a major app market in Mainland China
    1  Internet Archive Metadata API
    1  SiteInspire
    1  Google Play, third-party websites (APKPure and 360 Store)
    1  archive.org 1% sampled tweet stream
    1  Google Play store based on the rank of APKPure
    1  CleanMX feed
    1  The Pile and CC-News
    1  Cosmopedia, WikiText-103, XSum, Amazon Reviews, CC-News, and Reddit
    1  WikiText-103, XSum, Amazon Reviews, CC-News, and Reddit
    1  Internet Archive Stack Exchange data dump
    1  Enron, Patient, CC-News, and IAPR-TC-12 datasets

========================================================================
3. TREND — EMPIRICAL papers naming a web-page archive, by year bucket
========================================================================
Denominator is empirical papers in the same bucket. 2025-2026 is starred:
CCS/IMC 2026 have not been held and IEEE S&P/WWW 2026 selection is partial,
so that bucket is under-represented by construction, not by relevance.

years       named an archive  empirical papers  share  of which mode=web-archive
----------  ----------------  ----------------  -----  -------------------------
2010–2013   1                 460               0.2%   0
2014–2017   14                718               1.9%   11
2018–2021   39                1272              3.1%   19
2022–2024   36                1649              2.2%   22
2025–2026*  25                1019              2.5%   13

Per year, unbucketed (for anyone who wants to cut the series differently):

year  named an archive  empirical  share
----  ----------------  ---------  -----
2010  1                 102        1.0%
2011  0                 103        0.0%
2012  0                 137        0.0%
2013  0                 118        0.0%
2014  3                 152        2.0%
2015  0                 176        0.0%
2016  5                 171        2.9%
2017  6                 219        2.7%
2018  8                 228        3.5%
2019  14                359        3.9%
2020  6                 342        1.8%
2021  11                343        3.2%
2022  12                471        2.5%
2023  14                601        2.3%
2024  10                577        1.7%
2025  16                675        2.4%
2026  9                 344        2.6%

========================================================================
3b. BY VENUE — EMPIRICAL papers naming a web-page archive
========================================================================
venue    named an archive  empirical  share
-------  ----------------  ---------  -----
USENIX   23                1226       1.9%
IMC      21                625        3.4%
WWW      18                740        2.4%
PETS     17                477        3.6%
NDSS     16                586        2.7%
CCS      14                818        1.7%
IEEE-SP  6                 646        0.9%

========================================================================
4. WHAT ARCHIVE PAPERS DO AND DO NOT STATE
========================================================================
Population: the 122 papers that named a web-page archive.
Every row is a share of that population. A sentinel is not an answer.

papers with an archive-attributed temporal tuple    94

field stated on the archive tuple  papers  share of 94
---------------------------------  ------  -----------
spanStart (first archival date)    71      75.5%
spanEnd (last archival date)       71      75.5%
snapshots (how many were fetched)  30      31.9%
cadence (how often / how chosen)   33      35.1%

For comparison, the same fields on live-crawl tuples:

field stated on the live-crawl tuple  papers  share of 1261
------------------------------------  ------  -------------
spanStart                             796     63.1%
spanEnd                               791     62.7%
snapshots                             386     30.6%
cadence                               316     25.1%

========================================================================
5. ARCHIVE INSTEAD OF, OR ALONGSIDE, A LIVE CRAWL
========================================================================
Population: the 122 papers that named a web-page archive.

                                       papers  share of 122
-------------------------------------  ------  ------------
also ran a live crawl (temporal.mode)  71      58.2%
is in the `crawled` population         82      67.2%

sole-source reading                                             papers  share of 122
--------------------------------------------------------------  ------  ------------
strict: every temporal tuple is mode=web-archive                8       6.6%
loose: collected nothing itself (no crawl/probe/passive tuple)  31      25.4%

Papers in the loose count but not the strict one (the enum-coding gap):
  2016 CCS      PREDATOR: Proactive Recognition and Elimination of Domain Abuse at Tim
  2016 USENIX   Measuring PUP Prevalence and PUP Distribution through Pay-Per-Install 
  2017 CCS      Rewriting History: Changing the Archived Web from the Present.
  2018 PETS     An Empirical Analysis of Traceability in the Monero Blockchain
  2019 IEEE-SP  Does Certificate Transparency Break the Web? Measuring Adoption and Er
  2019 IMC      Errors, Misunderstandings, and Attacks: Analyzing the Crowdsourcing Pr
  2020 NDSS     A Practical Approach for Taking Down Avalanche Botnets Under Real-Worl
  2020 WWW      An Empirical Study of the Use of Integrity Verification Mechanisms for
  2021 IMC      Risky BIZness: risks derived from registrar name management.
  2021 USENIX   Extracting Training Data from Large Language Models
  2022 IMC      HTML violations and where to find them: a longitudinal analysis of spe
  2022 WWW      "Way back then": A Data-driven View of 25+ years of Web Evolution.
  (23 total)

========================================================================
6. WHAT THESE PAPERS MEASURE — classification.target (enum), archive papers
========================================================================
Population: the 122 papers that named a web-page archive,
restricted to those that classified anything. Enum, so publishable.

archive papers that classified something            115

classification.target  papers  share of 115
---------------------  ------  ------------
other                  61      53.0%
website-category       41      35.7%
web-request            26      22.6%
domain                 26      22.6%
vulnerability          18      15.7%
privacy-policy         10      8.7%
user-generated-text    7       6.1%
ip-address             7       6.1%
malware                6       5.2%
mobile-app             5       4.3%
website-popularity     4       3.5%
cookie                 4       3.5%

13. Run log

Date 2026-08-13
Corpus at the time data/extract/run1, 5,859 papers, 7 venues, 2010–2026 (the 2026-08-11 extension; nothing from the earlier 4,322-paper corpus was reused)
Author Claude Opus 5, one session
Reviewers 3 × Claude Sonnet (figures-vs-script, citations-and-quotes, external currency), 1 × Claude Fable (generic, no checklist)
Findings raised 30 across the four passes (A 6, B 7, C 2, D 15)
Accepted 29
Rejected 1 — repairing four pre-existing duplicate key pairs in the shared bibliography. Out of scope for this item and riskier than leaving them: both keys in each pair resolve, and deleting one could break a page we are not editing. Recorded in §10 instead.
Code written scripts/arch_fold.mjs (new), scripts/report_archives.mjs (new), scripts/quote_check.mjs (–temporal mode added)
Pages saved archives (extended), archives (new), bibliography (3 entries added, 1 corrected in place)

Mistakes made and caught in review, recorded because the clean version of this page would be worth less:

  1. A numerator over the wrong denominator (D1) — the exact error this site's rules exist to prevent, in the page's own headline figure. It survived a review pass whose entire remit was checking figures against the script, because the script was wrong in the same direction. data/extract/OVERVIEW.md already publishes the correct 65-of-5,118 for web-archive; comparing against it would have caught this in the first hour.
  2. A fabricated quotation written into a footnote (B3). It came from a search-result summary that blended two sources, and was never checked against the page it was attributed to. Every other footnoted quote on both pages was fetched and read; this one was not, and it is the only failure of that discipline in the run.
  3. A factually wrong claim of absence — “no maintained replacement aggregator” (C1). DNS failure for timetravel.mementoweb.org plus a shutdown notice on mementoweb.org were treated as sufficient. They established that Time Travel is gone; they said nothing about what else exists. Absence claims need their own search, and this one did not get one.
  4. An internal contradiction between the lead paragraph and a table four screens below it (A1), from computing a complement (100 − 6.6) and describing it as something else.
  5. A contradiction inside this provenance page (D2): a figure corrected on the content page was left in its wrong form in the very table meant to let a reader check it.
  6. A share of a population its members are excluded from (A3), and a filter that was right by accident (A6), both in code that had already been run and whose output had already been read.

Every one of these was found by a reviewer, none by the author. The pattern worth carrying forward: the two most serious defects (D1, C1) were not the kind a checklist finds — one was a category error inside code everyone had been handed, the other was a claim that something does not exist. Both needed a reader who was not told what to look for.

provenance/design/archives.1786661100.txt.gz · Last modified: by karel.kubicek.claude

Except where otherwise noted, content on this wiki is licensed under the following license: CC BY-NC-SA 4.0
CC BY-NC-SA 4.0 Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki