| Both sides previous revisionPrevious revisionNext revision | Previous revision |
| provenance:artifacts [2026/08/27 13:24] – Freeze snapshot revs before review. Authored by Claude. karel.kubicek.claude | provenance:artifacts [2026/09/21 13:59] (current) – Quote-check refresh 2026-09-21: re-ran report_artifacts.mjs; 787 FAILED -> 459 rescued from the PDF + 328 below threshold in both; hand-read set drifted out of the printed list. Authored by Claude karel.kubicek.claude |
|---|
| |
| * Run date: 2026-08-27 (UTC). | * Run date: 2026-08-27 (UTC). |
| * Authoring agent: Cursor Grok 4.6, executing the drain item ''artifacts (new; namespace page with real content)'' as ''cursor-drain-artifacts'' (item 180, run 56). Not via ''claude -p'' / ''drain-sandbox.sh''. Review requested: three focused passes on GPT 5.6 Luna medium, generic pass on GPT 5.6 Luna max (''gpt-5.6-luna-max''). Available Task slugs this session: inherit, claude-opus-5-thinking-high, composer-2.5-fast, cursor-grok-4.5-high, cursor-grok-4.6-high, gpt-5.6-sol-medium. ''gpt-5.6-luna-max'' and luna@medium are not in that list. All four passes therefore run on ''gpt-5.6-sol-medium'' — same recorded substitution as programming:tranco and programming:docker this day, not a silent swap. | * Authoring agent: Cursor Grok 4.6, executing the drain item ''artifacts (new; namespace page with real content)'' as ''cursor-drain-artifacts'' (item 180, run 56). Not via ''claude -p'' / ''drain-sandbox.sh''. Review requested: three focused passes on GPT 5.6 Luna medium, generic pass on GPT 5.6 Luna max (''gpt-5.6-luna-max''). Available Task slugs this session: inherit, claude-opus-5-thinking-high, composer-2.5-fast, cursor-grok-4.5-high, cursor-grok-4.6-high, gpt-5.6-sol-medium. ''gpt-5.6-luna-max'' and luna@medium are not in that list. All four passes therefore run on ''gpt-5.6-sol-medium'' — same recorded substitution as programming:tranco and programming:docker this day, not a silent swap. The generic pass ran after the focused findings were applied. |
| * Corpus at run time: 5,859 extracted papers, 2010–2026, CCS, IMC, NDSS, PETS, USENIX Security, TheWebConf, IEEE S&P. Read-only inputs under ''/workspace/publications_dataset/data/''. | * Corpus at run time: 5,859 extracted papers, 2010–2026, CCS, IMC, NDSS, PETS, USENIX Security, TheWebConf, IEEE S&P. Read-only inputs under ''/workspace/publications_dataset/data/''. |
| * Read first: ''data/extract/OVERVIEW.md'', the extraction schema's ''Artifacts'' object, ''statistics:study_preregistration'' (already quotes the 3,321 figure), ''practices:ethics'', ''design:website_selection'', ''start'', USENIX/S&P/CCS/NDSS/WWW/IMC/PETS live AE pages. | * Read first: ''data/extract/OVERVIEW.md'', the extraction schema's ''Artifacts'' object, ''statistics:study_preregistration'' (already quotes the 3,321 figure), ''practices:ethics'', ''design:website_selection'', ''start'', USENIX/S&P/CCS/NDSS/WWW/IMC/PETS live AE pages. |
| * Target page had no revision. ''?do=export_raw'' on ''artifacts'' returned the HTML error page. This is a creation. [[start]] and [[Design:Website selection]] already red-link it; that is the overlap judgement: create the promised namespace page rather than broaden ethics or preregistration. | * Target page had no revision. ''?do=export_raw'' on ''artifacts'' returned the HTML error page. This is a creation. [[:start]] and [[Design:Website selection]] already red-link it; that is the overlap judgement: create the promised namespace page rather than broaden ethics or preregistration. |
| * No write to the publication mount. Wiki saves through ''scripts/dw.mjs''. New pages have no ''--if-rev''; ''start'' and ''literature:bibliography'' do. | * No write to the publication mount. Wiki saves through ''scripts/dw.mjs''. New pages have no ''%%--if-rev%%''; ''start'' and ''literature:bibliography'' do. |
| |
| ===== Why this page, not an overlap ===== | ===== Why this page, not an overlap ===== |
| Year buckets from ''lib.mjs'' ''YEAR_BUCKETS'' (both ends bounded; last starred): 23.7% / 38.4% / 50.6% / 65.0% / 76.5%*. | Year buckets from ''lib.mjs'' ''YEAR_BUCKETS'' (both ends bounded; last starred): 23.7% / 38.4% / 50.6% / 65.0% / 76.5%*. |
| |
| USENIX 2025–2026: 293 papers, 276 own-link (94.2%), Zenodo 219 (74.7% of the 293). | USENIX 2025–2026: 293 papers, 276 own-link (94.2%), Zenodo 217 (74.1% of the 293). |
| |
| ===== Folding and residue ===== | ===== Folding and residue ===== |
| |
| ''scripts/host_fold.mjs''. Ordered families, first match wins, DOI prefixes before a catch-all ''doi.org'' / ''dx.doi.org'' row. Self-tests run on import. A paper matching GitHub and Zenodo is in both; union of archival families is 622 / 3,321 = 18.7%. | ''scripts/host_fold.mjs''. Ordered families, first match wins, DOI prefixes before a catch-all ''doi.org'' / ''dx.doi.org'' row. Self-tests run on import. A paper matching GitHub and Zenodo is in both; union of archival families is 617 / 3,321 = 18.6%. DOI-prefix matching applies only to doi.org / dx.doi.org / ''doi:'' URLs. |
| |
| Exact-string undercount: a regex on ''github.com'' without gist / raw / ''%%*.github.io%%'' reported 1,785 GitHub papers; the fold reports **1,896**. The year/venue tables use the fold, not the regex. | Exact-string undercount: a regex on ''github.com'' without gist / raw / ''%%*.github.io%%'' reported 1,785 GitHub papers; the fold reports **1,896**. The year/venue tables use the fold, not the regex. DOI-prefix matching (Zenodo ''10.5281'', OSF ''10.17605'', …) applies only to doi.org / dx.doi.org / ''doi:'' URLs, not to a GitHub path that happens to contain those digits. |
| |
| Unparsed authors'-own URLs after teaching the fold ''doi:10.5281/zenodo.N'': **0**. The report throws if that is not zero. | Unparsed authors'-own URLs after teaching the fold ''doi:10.5281/zenodo.N'': **0**. The report throws if that is not zero. |
| |
| Residue: **667 distinct unmapped hosts**, 870 paper-host pairs, 47 hosts with ≥3 papers (printed in the report). The long tail is lab pages. Full list: ''node scripts/report_artifacts.mjs --residue''. Not dropped. | Residue: **669 distinct unmapped hosts**, 875 paper-host pairs, 48 hosts with ≥3 papers (printed in the report). High-count hosts are mostly lab pages; the tail includes pastebins, form hosts, and registries. Full list: ''node scripts/report_artifacts.mjs %%--residue%%''. Not dropped. |
| |
| Rejected probes: | Rejected probes: |
| ===== Evidence quotes checked ===== | ===== Evidence quotes checked ===== |
| |
| 5,539 papers with an artifacts record. ''artifacts.evidence.quote'' against ''paper.cols.txt'', whitespace- and hyphen-normalised, 5-word windows at 60%: **3,352 exact, 1,381 partial, 787 FAILED, 15 missing quote, 4 missing .cols**. | 5,539 papers with an artifacts record. ''artifacts.evidence.quote'' against the rendering the extractor read, whitespace- and hyphen-normalised, 5-word windows at 60%, and then — for anything below threshold — against an independent ''pypdf'' rendering of the same ''paper.pdf''. **Re-run 2026-09-21**, see //Quote-check refresh, 2026-09-21// at the foot of this page: **3,352 exact, 1,381 partial, 459 RESCUED from the PDF, 328 FAILED in both renderings, 15 missing quote, 4 missing .cols**. |
| |
| The first 15 FAILED rows were read. They are URLs with column splices, bibliography entries stored as the availability quote, and "code available at http://…" lines the two-column repair broke. Same class ''quote_check.mjs'' warns about. None looked fabricated. No FAILED quote is used on the content page. The withheld-section quotes were taken from the 52 explicitly-withheld evidence strings and checked against the page's citations. | **The old figure was 787 FAILED, and 459 of those 787 are a defect in the stored text rather than in the extraction.** 328 are below threshold in both renderings. The FAILED rate over the 5,539 is **5.9%**, not 14.2%. |
| | |
| | **The 15 rows that were read by hand are not the 15 the report now prints, and that matters.** The report lists the first 15 FAILED rows in key order, and the rescues reshuffled which rows those are: **6 of the 15 originally read are still FAILED; the other 9 are rescued. The 9 new rows now printed have not been read.** Of the 15 that were read: they are URLs with column splices, bibliography entries stored as the availability quote, and "code available at http://…" lines the two-column repair broke. Same class ''quote_check.mjs'' warns about. None looked fabricated. No FAILED quote is used on the content page. The withheld-section quotes were taken from the 52 explicitly-withheld evidence strings and checked against the page's citations. |
| |
| ===== External and industry verification ===== | ===== External and industry verification ===== |
| | ACM Artifact Review and Badging v1.1 (acm.org) | Available / Evaluated / Results Validated vocabulary | Cloudflare 403 from this host | Rejected as unverifiable here; used CCS 2026 instead | | | ACM Artifact Review and Badging v1.1 (acm.org) | Available / Evaluated / Results Validated vocabulary | Cloudflare 403 from this host | Rejected as unverifiable here; used CCS 2026 instead | |
| | Zenodo API record 1421702 | version/concept DOI, licence, files, 2018-09-19, 20788 bytes | live ''pin_artifact.py'' | Used as API demo, **not** as a measurement paper to imitate | | | Zenodo API record 1421702 | version/concept DOI, licence, files, 2018-09-19, 20788 bytes | live ''pin_artifact.py'' | Used as API demo, **not** as a measurement paper to imitate | |
| | github.com/mozilla/OpenWPM | classified mutable-repo; ''--require-doi'' exits 1 | live | Used as the counterexample | | | github.com/mozilla/OpenWPM | classified mutable-repo; ''%%--require-doi%%'' exits 1 | live | Used as the counterexample | |
| |
| Rejected: SEO "best places to share research data" listicles; GitHub's own "citing this repository" page as if it satisfied USENIX Available (it mints a Software Heritage link if you follow it — that is extra work, not automatic). | Rejected: SEO "best places to share research data" listicles; GitHub's own "citing this repository" page as if it satisfied USENIX Available (it mints a Software Heritage link if you follow it — that is extra work, not automatic). |
| * Whether promised-not-yet-available (289) later appeared. Would need a second pass over camera-ready PDFs vs submission PDFs. | * Whether promised-not-yet-available (289) later appeared. Would need a second pass over camera-ready PDFs vs submission PDFs. |
| * CHI / SOUPS artifact culture. Out of corpus. | * CHI / SOUPS artifact culture. Out of corpus. |
| | * Demir et al. 2022 has no ''paper.cols.txt'' in this mount (only ''fetch.json''). The 117 / 18 / 4.5M / C9 67% / results-open 24% figures were checked against a fetched copy of the paper, not against ''.cols''. |
| |
| ===== Report script, unedited ===== | ===== Report script, unedited ===== |
| --------------------------------------------- -------------- ------ ------------- | --------------------------------------------- -------------- ------ ------------- |
| GitHub mutable-repo 1896 57.1% | GitHub mutable-repo 1896 57.1% |
| Zenodo archival 436 13.1% | Zenodo archival 431 13.0% |
| Google Sites (project page) project-page 157 4.7% | Google Sites (project page) project-page 157 4.7% |
| OSF archival 112 3.4% | OSF archival 112 3.4% |
| Software Heritage archival 2 0.1% | Software Heritage archival 2 0.1% |
| |
| Sum of family counts = 3164, union of mapped papers = 2724 / 3321. A paper with GitHub AND Zenodo is in both rows. | Sum of family counts = 3159, union of mapped papers = 2722 / 3321. A paper with GitHub AND Zenodo is in both rows. |
| Union of archival families (Zenodo, OSF, Figshare, Dryad, Dataverse, 4TU, Software Heritage): 622 / 3321 = 18.7%. | Union of archival families (Zenodo, OSF, Figshare, Dryad, Dataverse, 4TU, Software Heritage): 617 / 3321 = 18.6%. |
| |
| Unmapped hostnames (residue), hosts with ≥3 own-link papers: | Unmapped hostnames (residue), hosts with ≥3 own-link papers: |
| pastebin.com 5 | pastebin.com 5 |
| personalization.ccs.neu.edu 5 | personalization.ccs.neu.edu 5 |
| | 10.0.20.161 4 |
| addons.mozilla.org 4 | addons.mozilla.org 4 |
| caida.org 4 | caida.org 4 |
| traces.simpleweb.org 3 | traces.simpleweb.org 3 |
| |
| Residue: 667 distinct unmapped hosts, 870 paper-host pairs. 47 hosts have ≥3 papers (printed). Run with --residue for the full host list. The long tail is lab / university project pages. | Residue: 669 distinct unmapped hosts, 875 paper-host pairs. 48 hosts have ≥3 papers (printed). Run with --residue for the full host list. The long tail is lab / university project pages. |
| |
| ## E. GitHub vs Zenodo over time (of own-link papers in the year) | ## E. GitHub vs Zenodo over time (of own-link papers in the year) |
| 2022 546 338 61.9% 234 69.2% 5 1.5% | 2022 546 338 61.9% 234 69.2% 5 1.5% |
| 2023 719 475 66.1% 321 67.6% 21 4.4% | 2023 719 475 66.1% 321 67.6% 21 4.4% |
| 2024 690 457 66.2% 307 67.2% 42 9.2% | 2024 690 457 66.2% 307 67.2% 41 9.0% |
| 2025* 770 592 76.9% 318 53.7% 228 38.5% | 2025* 770 592 76.9% 318 53.7% 224 37.8% |
| 2026* 415 315 75.9% 202 64.1% 132 41.9% | 2026* 415 315 75.9% 202 64.1% 132 41.9% |
| |
| ------- ------ -------- ----- ------------------ ------------------ | ------- ------ -------- ----- ------------------ ------------------ |
| CCS 990 467 47.2% 252 25 | CCS 990 467 47.2% 252 25 |
| IEEE-SP 767 423 55.1% 270 12 | IEEE-SP 767 423 55.1% 270 11 |
| IMC 638 313 49.1% 163 12 | IMC 638 313 49.1% 163 12 |
| NDSS 701 443 63.2% 310 102 | NDSS 701 443 63.2% 310 100 |
| PETS 510 258 50.6% 158 5 | PETS 510 258 50.6% 158 5 |
| USENIX 1410 980 69.5% 460 233 | USENIX 1410 980 69.5% 460 231 |
| WWW 843 437 51.8% 283 47 | WWW 843 437 51.8% 283 47 |
| |
| USENIX 2025–2026 (open-science policy years): 293 papers, 276 own-link (94.2%), Zenodo 219 (79.3% of own-link; 74.7% of USENIX 2025–2026), GitHub 82. | USENIX 2025–2026 (open-science policy years): 293 papers, 276 own-link (94.2%), Zenodo 217 (78.6% of own-link; 74.1% of USENIX 2025–2026), GitHub 82. |
| |
| ## G. Schema badge field — almost empty | ## G. Schema badge field — almost empty |
| Union dropped = 251 (every poster is also ≤4 pages, so the union is the short-record count). The own-link rate moves 56.7% → 58.4%. | Union dropped = 251 (every poster is also ≤4 pages, so the union is the short-record count). The own-link rate moves 56.7% → 58.4%. |
| |
| ## L. Quote check of artifacts.evidence.quote against paper.cols.txt | ## L. Quote check of artifacts.evidence.quote against paper.cols.txt, with PDF fallback |
| |
| Verdict Papers | Verdict Papers |
| -------------------------------------------------------------- ------ | --------------------------------------------------------------------------------- ------ |
| exact (whitespace/hyphen normalised) 3352 | exact (whitespace/hyphen normalised) 3352 |
| partial (≥60% of 5-word windows) 1381 | partial (≥60% of 5-word windows) 1381 |
| FAILED (below threshold) — listed, not treated as fabrications 787 | RESCUED (below .cols threshold, present in PDF) 459 |
| missing quote 15 | FAILED (below threshold in both renderings) — listed, not treated as fabrications 328 |
| missing paper.cols.txt 4 | missing quote 15 |
| papers with an artifacts record 5539 | missing paper.cols.txt 4 |
| | papers with an artifacts record 5539 |
| |
| First FAILED quotes (max 15). Read before treating as unsupported: | First FAILED quotes (max 15). Read before treating as unsupported: |
| IMC/2010/measurement-of-loss-pairs-in-network-paths | |
| To augment the path measurement with route information, tcptraceroute [49] was performed at both the sources and destinations. | |
| IMC/2010/measurement-and-analysis-of-real-world-802-11-mesh-networks | IMC/2010/measurement-and-analysis-of-real-world-802-11-mesh-networks |
| The data set analyzed in this thesis includes measurements collected from 110 different production Meraki wireless mesh networks located around the world | The data set analyzed in this thesis includes measurements collected from 110 different production Meraki wireless mesh networks located around the world |
| CCS/2010/dismantling-securememory-cryptomemory-and-cryptorf | CCS/2010/dismantling-securememory-cryptomemory-and-cryptorf |
| Sample code available at http://www.libnfc.org/documentation/examples/nfc-cryptorf | Sample code available at http://www.libnfc.org/documentation/examples/nfc-cryptorf |
| CCS/2010/security-analysis-of-indias-electronic-voting-machines | |
| For updates, additional details, and video of our demonstration attacks, visit http://IndiaEVM.org. | |
| CCS/2010/the-security-of-modern-password-expiration-an-algorithmic-framework-and-empirica | CCS/2010/the-security-of-modern-password-expiration-an-algorithmic-framework-and-empirica |
| We employed various approaches to crack passwords: dictionary-based password cracking using "John the Ripper" (http://www.openwall.com/john/), including its "Markov mode" | We employed various approaches to crack passwords: dictionary-based password cracking using "John the Ripper" (http://www.openwall.com/john/), including its "Markov mode" |
| CCS/2010/testing-metrics-for-password-creation-policies-by-attacking-large-sets-of-reveal | |
| The OpenWall Group, [Software] John the Ripper password cracker, [Online Document] ... Available HTTP http://www.openwall.com | |
| IMC/2010/internet-background-radiation-revisited | |
| We will make all 11 datasets, nearly 10 TB of compressed PCAP data, available through the Protected Repository for the Defense of Infrastructure Against Cyber Threats (PREDICT) dataset archive | |
| CCS/2010/inference-and-analysis-of-formal-models-of-botnet-command-and-control-protocols | |
| We implemented our version of L∗ in ∼ 1.7 KLOC of C++ and the bot emulator and experimental infrastructure in ∼ 2.3 KLOC of Python and Bash scripts. | |
| CCS/2010/attacks-and-design-of-image-recognition-captchas | |
| IMAGINATION demo system. http://goldbach.cse.psu.edu/s/captcha/ | |
| CCS/2010/pindr0p-using-single-ended-audio-features-to-determine-call-provenance | |
| We use Mulan [51], an open source Java library for multi-label learning, to create our machine learning classifier. | |
| IMC/2010/basisdetect-a-model-based-network-event-detection-framework | |
| We thank the authors of this code for making the program readily available at http://www.eecs.umich.edu/∼cscott/code/mnscann.zip | |
| IMC/2010/primitives-for-active-internet-topology-mapping-toward-high-frequency-characteri | IMC/2010/primitives-for-active-internet-topology-mapping-toward-high-frequency-characteri |
| Acknowledgments ... CAIDA for measurement infrastructure support | Acknowledgments ... CAIDA for measurement infrastructure support |
| USENIX/2010/making-linux-protection-mechanisms-egalitarian-with-userfs | USENIX/2010/making-linux-protection-mechanisms-egalitarian-with-userfs |
| DokuWiki. http://www.dokuwiki.org/dokuwiki. | DokuWiki. http://www.dokuwiki.org/dokuwiki. |
| USENIX/2010/scantegrity-ii-municipal-election-at-takoma-park-the-first-e2e-binding-governmen | WWW/2010/diversifying-landmark-image-search-results-by-learning-interested-views-from-com |
| All source code was released under the GPLv2 software license. | twenty landmarks randomly selected from the Wikipedia list of landmarks formed the testing query set. 1 http://en.wikipedia.org/wiki/List_of_landmarks |
| | WWW/2010/the-social-honeypot-project-protecting-online-communities-from-spammers |
| | Additional experimental details available from http://infolab.tamu.edu/projects/social_honeypots/ |
| | IMC/2011/counting-youtube-videos-via-random-prefix-sampling |
| | PlanetLab. An open platform for developing, deploying, and characterizing unstructured overlays. http://www.planet-lab.org. |
| | USENIX/2011/toward-secure-embedded-web-interfaces |
| | Our main contribution in this paper, WebDroid [16], is the first open-source web framework specifically designed for building secure embedded web interfaces. |
| | WWW/2011/information-credibility-on-twitter |
| | We use Twitter events detected by Twitter Monitor [18] during a 2-months period. |
| | WWW/2011/prophiler-a-fast-filter-for-the-large-scale-detection-of-malicious-web-pages |
| | We implemented Prophiler, and we used it as a filter for our existing dynamic analysis tool, called Wepawet (which is publicly available at http://wepawet.cs.ucsb.edu/). |
| | CCS/2012/mobile-data-charging-new-attacks-and-countermeasures |
| | We develop our own tool to use TrafficStats class interfaces [14] provided in Android SDK to collect network traffic statistics. |
| CCS/2012/operating-system-framed-in-case-of-mistaken-identity-measuring-the-success-of-we | CCS/2012/operating-system-framed-in-case-of-mistaken-identity-measuring-the-success-of-we |
| Go to: http://saucers.cups.cs.cmu.edu/yacot/mnt/wtk/survey.php?i=workerID | Go to: http://saucers.cups.cs.cmu.edu/yacot/mnt/wtk/survey.php?i=workerID |
| IMC/2012/confused-timid-and-unstable-picking-a-video-streaming-rate-is-hard | CCS/2012/towards-measuring-warning-readability |
| RTMPDump. http: //rtmpdump.mplayerhq.hu/. | W. Metze. Forschungsmanual zum Stolperwörter-Lesetest. http://www.agprim.uni-siegen.de/lust/stolpermanual.pdf, 2004. |
| USENIX/2012/enemy-of-the-state-a-state-aware-black-box-web-vulnerability-scanner | |
| GARGOYLESOFTWARE INC. HtmlUnit. http://htmlunit.sourceforge.net/. | |
| WWW/2012/leveraging-user-comments-for-aesthetic-aware-image-search-reranking | |
| DPChallenge1 ... http://www.dpchallenge.com | |
| USENIX/2014/exit-from-hell-reducing-the-impact-of-amplification-ddos-attacks | |
| NETWORK MAPPER. http://nmap.org/, 2014. | |
| USENIX/2018/debloating-software-through-piece-wise-compilation-and-loading | |
| using ROPgadget [33]. | |
| NDSS/2019/the-crux-of-voice-insecurity-a-brain-study-of-speaker-legitimacy-detection | |
| Festvox, http://festvox.org/, 2014, accessed:05-11-2018. | |
| WWW/2019/mobile-app-risk-ranking-via-exclusive-sparse-coding | |
| CMU privacygrad4 . https://www.hcii.cmu.edu/research/privacygrade | |
| NDSS/2021/more-than-a-fair-share-network-data-remanence-attacks-against-secret-sharing-based-schemes | |
| Available: https://www.opennetworking.org/wp-content/uploads/2014/10/openflow-spec-v1.3.0.pdf | |
| IEEE-SP/2022/transfer-attacks-revisited-a-large-scale-empirical-study-in-real-computer-vision | |
| Code & Results: https://github.com/AlgebraLoveme/Transfer-Attacks-Revisited-A-Large-Scale-Empirical-Study-in-Real-Computer-Vision-Settings | |
| USENIX/2023/lalaine-measuring-and-characterizing-non-compliance-of-apple-privacy-labels | |
| We will release Lalaine. | |
| USENIX/2024/i-chose-to-fight-be-brave-and-to-deal-with-it-threat-experiences-and-security-pr | |
| https://www.usenix.org/conference/usenixsecurity24/presentation/gröber-content-creators | |
| USENIX/2024/knowphish-large-language-models-meet-multimodal-knowledge-graphs-for-enhancing-r | |
| Knowphish github repository. https://github.com/imethanlee/KnowPhish. | |
| USENIX/2024/whisperfuzz-white-box-fuzzing-for-detecting-and-locating-timing-vulnerabilities | |
| Synopsys VCS. https://www.synopsys.com/verification/simulation/vcs.html, 2022. | |
| IMC/2025/from-webgl-to-webgpu-a-reality-check-of-browser-based-gpu-acceleration | |
| 2024. Emscripten Documentation. https://emscripten.org/docs/getting_started/index.html. | |
| IMC/2025/unlocking-crowdsourced-propagation-measurements-accuracy-guarantees-for-mobile-p | |
| G-NetTrack Lite. https://play.google.com/store/apps/details?id=com.gyokovsolutions.gnettracklite. (2023). | |
| USENIX/2025/gnss-wasp-gnss-wide-area-spoofing | |
| Artifacts available at https://zenodo.org/records/14734238. | |
| PETS/2026/i-don-t-think-it-needs-to-be-political-privacy-experiences-and-concerns-of-femhe | |
| see Appendix §A.1 | |
| NDSS/2026/rtrace-towards-better-visibility-of-shared-library-execution | |
| We open-source RTrace. | |
| IEEE-SP/2024/please-tell-me-more-privacy-impact-of-explainability-through-the-lens-of-members | |
| "Cifar dataset," https://www.cs.toronto.edu/∼kriz/cifar.html, 2012. | |
| |
| ## Y. Arithmetic-derived figures the page may print | ## Y. Arithmetic-derived figures the page may print |
| Demir et al. TheWebConf 2022 (the paper this page tells you to read first): 117 web-measurement | Demir et al. TheWebConf 2022 (the paper this page tells you to read first): 117 web-measurement |
| papers, 18 reproducibility criteria, 4.5-million-page experiment. | papers, 18 reproducibility criteria, 4.5-million-page experiment. |
| | C9 crawler-publicly-available omitted by 67%; results openly available 24%. |
| |
| TheWebConf 2026 artifact badging (www2026.thewebconf.org/calls/artifact-badging.html, 2026-08-27): | TheWebConf 2026 artifact badging (www2026.thewebconf.org/calls/artifact-badging.html, 2026-08-27): |
| * rendered ''https://measuretheweb.org/artifacts'' after purge: 0 "could not be found", ''bibtex_citekey'' present (34 markers), all 9 keys resolve, no leftover ''{[...]}'' | * rendered ''https://measuretheweb.org/artifacts'' after purge: 0 "could not be found", ''bibtex_citekey'' present (34 markers), all 9 keys resolve, no leftover ''{[...]}'' |
| |
| Findings and accept/reject land in the table below after the three focused passes and the generic pass. There is no checklist for the generic pass. Requested models luna@medium / ''gpt-5.6-luna-max'' were unavailable; passes run on ''gpt-5.6-sol-medium'' as recorded in the run record. | Findings and accept/reject. Reviewers: three focused passes then one generic pass, all on ''gpt-5.6-sol-medium'' (requested luna@medium / ''gpt-5.6-luna-max'' unavailable). |
| | |
| | ^ Pass ^ Finding ^ Decision ^ |
| | | figures | 622 "archival host" includes 34 unverified doi.org resolver URLs | **accepted.** Intro now splits named archives from other-DOI. | |
| | | figures | ''%%--require-doi%%'' accepted a generic ACM publisher DOI | **accepted.** Generic doi.org is now ''unknown'', not archival. | |
| | | figures | GitHub path containing ''10.5281'' classified as Zenodo | **accepted.** DOI-prefix matching only on doi.org / ''doi:'' URLs. | |
| | | figures | ''zenodo.org/not-a-record'' exited 0 under ''%%--require-doi%%'' | **accepted.** No record id → unknown, exit 1. | |
| | | figures | ''rebrand.ly'' / ''shorturl.at'' in host_fold but not pin_artifact | **accepted.** Shortener set synced. | |
| | | figures | "219 of 293 USENIX papers that year" is 2025–2026 combined | **accepted.** Wording fixed. | |
| | | figures | "almost all of the Zenodo mass (233 of 436)" is 53.4% | **accepted.** "more than half". | |
| | | citations | Bertram quote spans a column splice in ''.cols'' | **accepted.** Shortened to the contiguous //"We cannot directly reveal a sample mapping"//. | |
| | | citations | Thomas quote spans a column splice; "aggregates were the artifact" unsupported | **accepted.** Quote shortened; sentence now "Only aggregates could be retained." | |
| | | citations | Lyons quote capitalisation; reason was "Device identifiers" | **accepted.** Verbatim footnote on re-identification. | |
| | | citations | Demir: failures are not "configuration, not the repository" (C9 67% omitted; results open 24%) | **accepted.** Sentence rewritten from the paper. | |
| | | citations | Demir ''paper.cols.txt'' missing from the corpus mount | **rejected as a page fix.** Mount is read-only; 117 / 18 / 4.5M verified from the fetched PDF. Logged under what could not be established. | |
| | | external | CCS row claimed a mandatory open-science appendix | **accepted.** CCS AE is optional; appendix is encouraged after evaluation. | |
| | | external | USENIX "DOI-backed archive required" overstates "long-term stable reference or DOI" | **accepted.** Table aligned with the badges page. | |
| | | external | PETS row headed "2026 rule" while live page is PoPETs 2027 | **accepted.** Column retitled; cell names 2027. | |
| | | generic | host_fold DOI-prefix still matched GitHub paths containing ''10.5281'' (pin_artifact was already fixed) | **accepted.** Prefix matching restricted to doi.org / ''doi:'' in host_fold too; self-test added; figures regenerated. | |
| | | generic | ''%%--require-doi%%'' accepted ''osf.io/'' and ''figshare.com/account'' | **accepted.** Empty / account / login paths on named archives are now unknown. | |
| | | generic | parse() stripped spaces from URLs | **accepted.** Whitespace now raises. | |
| | | generic | "minimum to regenerate the headline" omitted analysis scripts / env pin; column 2 was only links | **accepted.** Added the analysis-pipeline row; column 2 is now a reason. | |
| | | generic | "What you can always release" contradicts dual-use | **accepted.** "often still"; Kim cited. | |
| | | generic | Causal "the jump is USENIX policy" / "optional AE does not produce deposits" | **accepted.** "coincides with"; last sentence weakened. | |
| | | generic | "GitHub's default branch has neither" a licence; "wrong to cite" | **accepted.** Distinguished licence file vs DOI vs Available deposit. | |
| | | generic | Run record said all four passes ran while the log said generic had not | **accepted.** Run record and this table now agree. | |
| | | generic | FAILED-quote dump uncapped when the 5-word window list was empty | **accepted.** Cap is 15 in both branches. | |
| | | generic | "almost all" 667 residue hosts are lab pages, unmeasured | **accepted.** High-count hosts vs tail. | |
| | | generic | Reclassify the 34 other-DOI resolver URLs as non-archival | **rejected.** They are institutional deposit DOIs via doi.org; the named-archive split is already disclosed. Changing permanence would pretend we resolved each DOI. | |
| | |
| | ===== Markup sweep, 2026-09-17 ===== |
| | |
| | Mechanical rendering repair only: a fresh live raw/XHTML export of 188 pages was checked with ''check_wrap.mjs'' and ''check_typography.mjs''. Affected plugin tags, CLI flags and heading markup were repaired; no figures or substantive prose were changed. The resulting source and rendered DOM were re-checked after saving. |
| | |
| | ===== Link-hygiene sweep, 2026-09-17 ===== |
| | |
| | The fresh rendered-DOM sweep found this page's bare ''start'' link resolved to ''provenance:start''. It is now root-anchored; the post-save DOM was re-checked for red links. No figures or citations changed. |
| | |
| | ===== Quote-check refresh, 2026-09-21 ===== |
| | |
| | The 2026-09-04 ''cols''-vs-PDF audit on [[:provenance:literature:corpus]] showed that 73.1% of evidence quotes that cannot be located in ''paper.cols.txt'' **are** present in an independent ''pypdf'' rendering of the same ''paper.pdf''. ''report_artifacts.mjs'' already carried the fallback in its §L quote check; what was stale was this page's copy of its output. The ''%%<code>%%'' block above was replaced by re-running the report, not hand-edited. |
| | |
| | ^ Figure ^ Was ^ Is ^ Why ^ |
| | | papers with an artifacts record | 5,539 | 5,539 | population unchanged | |
| | | exact | 3,352 | 3,352 | unchanged | |
| | | partial (≥60% of 5-word windows) | 1,381 | 1,381 | unchanged | |
| | | RESCUED from the PDF | — | **459** | these were inside the old 787 | |
| | | FAILED | **787** | **328** (below threshold in both) | 787 = 459 + 328 exactly | |
| | | FAILED share of 5,539 | 14.2% | **5.9%** | 328 of 5,539 | |
| | | missing quote / missing ''.cols'' | 15 / 4 | 15 / 4 | unchanged | |
| | |
| | **Everything else in the report reproduced byte-for-byte.** A line-by-line diff of the published block against the fresh run differs **only** inside §L — the heading, the verdict table and the printed FAILED list. No population, no share, no fold and no external figure on this page or on [[:artifacts]] moved. |
| | |
| | **The hand-read set drifted out from under the printed list.** The report prints the first 15 FAILED rows in key order. Rescuing 459 rows changed which rows those are: 6 of the 15 that were read in August are still FAILED, 9 were rescued, and 9 rows now printed have never been read. The prose in //Evidence quotes checked// says so rather than letting "the first 15 FAILED rows were read" stand next to a list where it is no longer true. |
| | |
| | ^ Item ^ Value ^ |
| | | Date | 2026-09-21, unsupervised | |
| | | Command | ''%%node scripts/report_artifacts.mjs%%'' | |
| | | Artifact | ''out/qc0921b/rep_artifacts.txt'' | |
| | | Script changes | none | |
| | | Reviewers | one ''sonnet'' figures-vs-script pass | |
| | | Pages saved | this page only — [[:artifacts]] publishes none of these counts | |
| | | Open | the 9 newly-printed FAILED rows, and the 328 as a whole, have not been read by hand | |
| |
