Table of Contents
Provenance: design:existing_datasets
Working notes behind existing_datasets — every query with its population and denominator, the report script and its unedited output, the fold and its full residue, the quotes that were checked, the external sources that were verified or rejected, and what could not be established. Corpus-level caveats that apply to every page on this site are on corpus and are not restated here.
Contemporaneous. Kept as an append-only log during the run of 2026-08-28 that produced the content page, and tidied into tables before saving. No ~~DISCUSSION~~ block: comments belong on the content page.
1. What this page is backing
| Item | Value |
|---|---|
| Content page | existing_datasets — created, not extended. It did not exist; nothing linked to it. |
| Report script | scripts/report_existing_datasets.mjs |
| Fold | scripts/ds_fold.mjs (dataset-name families, all-matches rule) |
| Residue sampler | scripts/ds_residue_sample.mjs → scripts/ds_residue_audit.tsv (the hand-audit) |
| Quote checker | scripts/ds_quotecheck.mjs |
| Full-text probe | scripts/ds_probe.mjs (whitespace-collapsed proximity probe over paper.cols.txt) |
| Data | data/extract/run1/extractions.jsonl, 5,859 papers, 7 venues, 2010–2026 |
| Bibliography | 3 new entries: izhikevich2021_identifying, huang2025_trust, sethuraman2022_ipv4. 7 existing keys reused (durumeric2015_search, durumeric2024_years, vandersloot2016_complete, wu2025_revealing, hantke2023you, singh2026_empire, demir2022_reproducibility), 10 citekeys on the page in total. No key added twice; checked by key string, by DOI and by title against a fresh export before appending. |
| Previous figures | none. Nothing was carried over from any earlier page, dossier or METHOD.md; every figure was derived on 2026-08-28 against the current run1. |
2. Scope: a new page, not a broader neighbour
The judgement call, stated so a later run can disagree with it.
automated_measurements is the router for crawl / scan / app analysis and explicitly refuses this topic: “An existing-dataset analysis by itself … is not running a measurement. The design questions that remain — which snapshot, which query, which join key — belong on the child page for that artefact”. Those child pages exist for specific artefacts (archives for archives, tls_certificates for CT and the web PKI, website_selection for ranking lists, mobile_and_app_measurement for app corpora) and each covers its own artefact well. None of them covers the general case, and the general case is where the reporting failures are: which snapshot, which query, which join key, and what a producer's configuration does to your denominator.
Broadening a neighbour was considered and rejected in each direction:
- Broadening
design:archiveswould make an archive-fidelity page carry Censys, AndroZoo and NVD. An archive is a recording of pages; a scan corpus is not. The two share the anachronism trap and nothing else. - Broadening
design:automated_measurementswould put a full page of content inside a router whose whole value is that it is short and routes. - Broadening
security:tls_certificateswould file the general problem under one instrument.
So: a new page, with an explicit boundary table at the top and a cross-link added to the parent's What this is not bullet. The risk taken is overlap with those four neighbours; it is managed by routing rather than restating — the page names each neighbour where the artefact-specific advice lives and does not repeat it.
3. Populations and denominators
Every figure on the content page comes from one of these. “All 5,859 papers” is a denominator on that page only where the field applies to every paper.
| Tag | Definition, as report_existing_datasets.mjs implements it | N |
|---|---|---|
| corpus | all extraction records | 5,859 |
empirical | isEmpirical === true | 5,118 |
| temporal population | ≥1 temporal[] tuple — the only legitimate denominator for temporal.mode | 5,342 |
| population population | ≥1 population[] tuple — the denominator for samplingMethod | 5,712 |
crawled | crawlConfig !== null OR studyTypes has automated-web-crawl | 1,120 |
| scan-tagged | studyTypes has network-scan-or-probe | 930 |
| A | ≥1 temporal tuple with mode = existing-dataset | 2,534 |
| B | ≥1 population tuple with samplingMethod = pre-existing-dataset | 2,029 |
| C | studyTypes has existing-dataset-analysis | 2,615 |
| reuse union | A ∪ B ∪ C — the page's inclusive population | 3,389 |
| core | A ∩ B ∩ C — the page's conservative population | 1,292 |
| live-crawl comparison | ≥1 temporal tuple with mode = live-crawl | 1,261 |
| dateable, existing-dataset | of A, those with a spanEnd containing a parsable 4-digit year ≤ the venue year | 1,329 |
| dateable, live-crawl | same rule on the live-crawl population | 779 |
| residue hand-audit sample | 60 of the 3,192 residue strings, seed 20260828 | 60 |
Contract checks run first and the script exits 1 if any fails, so a corpus change breaks the script rather than silently changing a published number. The nine contracts are the corpus size, empirical, the temporal and population populations, crawled, scan-tagged, and A, B and C.
4. Running it
cd /workspace/artifacts/wiki node scripts/report_existing_datasets.mjs # the audit trail in §12 node scripts/report_existing_datasets.mjs --wiki # DokuWiki tables node scripts/report_existing_datasets.mjs --residue-all # + every singleton residue string node scripts/report_existing_datasets.mjs --members "Censys" # raw strings folded into a family node scripts/report_existing_datasets.mjs --quotes "^Censys" # evidence quotes behind a family node scripts/ds_residue_sample.mjs 60 # the hand-audit sample, seed 20260828 node scripts/ds_quotecheck.mjs 40 # quotes vs paper.cols.txt node scripts/ds_probe.mjs "Censys" "(stale|snapshot|coverage|underestimat)" 300 # full-text probe
5. Three fields, one concept, and why a range is published
The extraction encodes “this paper analysed data somebody else collected” three times, in three different families, and the three do not agree:
| Slice | Papers |
|---|---|
A only (temporal.mode) | 252 |
B only (samplingMethod) | 203 |
C only (studyTypes) | 437 |
| A ∩ B | 1,611 |
| A ∩ C | 1,963 |
| B ∩ C | 1,507 |
| all three — the core | 1,292 |
| exactly one of three | 892 |
| union | 3,389 |
The core is 38.1% of the union. Some of that gap is extraction instability — studyTypes agrees with itself run-to-run on 57% of papers on a 100-paper sample (measured on the previous corpus, not re-measured on this one) — but most of it is real: the three fields ask different questions. temporal.mode asks where the bytes came from. samplingMethod asks how the study population was drawn. studyTypes asks what kind of paper it is. A paper that ran its own crawl over a Tranco list is B but not A; a paper that re-analyses a partner's logs is A but might not be B.
Decision: publish 1,292–3,389 as a range on the content page, use the union for shares, and label the union as ranking-grade rather than precise. Publishing only 3,389 would overstate; publishing only 1,292 would understate by a factor of 2.6. The alternative considered and rejected was defining the page's population as A alone (2,534, the most stable of the three) — rejected because it excludes 855 papers that two other fields call a re-analysis, and because the disagreement is itself the finding the parent page asked for.
6. The fold
population[].sourceList (on pre-existing-dataset tuples) and temporal[].source (on existing-dataset tuples) are free text, ~20% run-to-run stable on exact strings, so they are folded before counting and counted by paper.
Two rules, both deliberate and both arguable:
- All matches, not first match. One string is often several sources — “RouteViews, RIPE NCC RIS, UCSD Network Telescope, CAIDA Ark” is one
sourceListvalue and four datasets. First-match-wins would have dropped three of them. The cost is that a family's paper count includes papers that named it inside a list of six. - Families, not canonical names. “Censys” is its own family because the page names it; “RIPE and RIR data other than Atlas/RIS” is a bucket. A bucket cannot be read as “N papers used X”, only as “N papers used something in this family”, and the content page's column header says so.
Sentinels (not-stated, none-mentioned, not-applicable, unclear, unknown, n/a) are dropped before folding and never counted as a value.
Four regex bugs were found and fixed during the run, all the same bug: a trailing \b after a token that is routinely followed by a digit never matches. \bcifar\b missed CIFAR10; \bvox ?celeb\b missed VoxCeleb2; \bcic-?(ids|ddos)\b missed CIC-IDS2018; \bspec ?(cpu|int)\b missed SPEC CPU2017. They were caught by reading the residue list, which is the argument for printing it.
6.1 The fold source, in full
- ds_fold.mjs
// Folding free-text dataset names into families, for design:existing_datasets. // // population.sourceList and temporal.source are free text and agree run-to-run // on roughly a fifth of exact strings (data/extract/README.md), so they are // never aggregated by exact string. This module maps a raw string to at most // one FAMILY, by an ordered list of regexes: first match wins. Order matters // and is part of the published method — "Rapid7 SSL Certificate Scans" is // filed under scan data, not under certificates, because the thing you query // is Rapid7's scan corpus. // // Everything that matches nothing is RESIDUE and is printed in full by // report_existing_datasets.mjs. A residue that only exists in a local script // output is a residue nobody looks at. // scope: 'internet' — an Internet/web measurement data source, this page's subject // 'adjacent' — reused data that is not an Internet measurement of the web // (social dumps, blockchains, credential leaks, code hosts) // 'benchmark' — ML or software benchmark suites, out of scope, counted so // the head of the raw ranking is explained rather than hidden export const FAMILIES = [ // --- Internet measurement ------------------------------------------------- ['Censys', 'internet', /\bcensys\b/i], ['Shodan', 'internet', /\bshodan\b/i], ['Other scan search engine', 'internet', /\b(zoomeye|fofa|binaryedge|netlas|onyphe)\b/i], ['Rapid7 / scans.io', 'internet', /\b(rapid ?7|project sonar|scans\.io|sonar (dns|ssl|https?))\b/i], ['IPv6 Hitlist', 'internet', /\bipv6 hitlist\b/i], ['Address-space census (LANDER, Trinocular)', 'internet', /\b(lander|trinocular|isi (internet )?census|ipv4 address space census)\b/i], ['CAIDA', 'internet', /\bcaida\b|\b(ark|archipelago) (dataset|traces?)\b|\bitdk\b|\bucsd network telescope\b/i], ['RouteViews', 'internet', /\broute ?views\b/i], ['RIPE RIS', 'internet', /\bripe\b.*\bris\b|\brouting information service\b|\bris (raw|live)\b|\bripe ris\b/i], ['RIPE Atlas', 'internet', /\bripe atlas\b|\batlas probes?\b/i], ['Other RIPE / RIR data', 'internet', /\bripe\b|\bapnic\b|\barin\b|\bafrinic\b|\blacnic\b|\brir whois\b|\brpki\b/i], ['BGPStream / BGPmon', 'internet', /\bbgp ?(stream|mon)\b/i], ['PeeringDB', 'internet', /\bpeering ?db\b/i], ['iPlane / DIMES / mrinfo', 'internet', /\bi ?plane\b|\bdimes\b|\bmrinfo\b/i], ['M-Lab', 'internet', /\bm-?lab\b|\bmeasurement ?lab\b|\bndt\b/i], ['OpenINTEL', 'internet', /\bopen ?intel\b/i], ['Farsight DNSDB / SIE', 'internet', /\bdnsdb\b|\bfarsight\b|\bsecurity information exchange\b|\bsie\b/i], ['Other passive/active DNS', 'internet', /\bactive ?dns\b|\bdgarchive\b|\bpassive dns\b|\bczds\b|\bcentralized zone data\b|\bzone file/i], ['Certificate Transparency', 'internet', /\bcertificate transparency\b|\bct logs?\b|\bcrt\.sh\b/i], ['Common Crawl', 'internet', /\bcommon ?crawl\b|\bcc-(main|news)\b|\bclueweb/i], ['HTTP Archive', 'internet', /\bhttp ?archive\b/i], ['Internet Archive / Wayback', 'internet', /\b(internet archive|wayback)\b|\bweb archive\b/i], ['Popularity ranking list', 'internet', /\btranco\b|\balexa\b|\bcrux\b|\bchrome user experience\b|\bmajestic\b|\b(cisco )?umbrella\b|\bsimilar ?web\b|\bquantcast\b|\bchrome ux report\b/i], ['Traffic trace archive (MAWI, CRAWDAD, CIC, DARPA)', 'internet', /\bmawi|\bcrawdad\b|\bcic-? ?(ids|ddos)|\bnsl-?kdd\b|\bdarpa (tc|transparent computing)\b|\bunsw-?nb15|\bnetflow\b|\bpacket traces?\b|\bbackbone (traces?|packet)/i], ['Tor Metrics / CollecTor', 'internet', /\bcollec ?tor\b|\btor metrics\b|\btor consensus\b|\bonionoo\b/i], ['Censorship list (Citizen Lab, OONI)', 'internet', /\bcitizen ?lab\b|\bclbl\b|\booni\b|\bcensored planet\b/i], ['Filter list / tracker database', 'internet', /\beasy(list|privacy)\b|\bdisconnect\b|\btracker radar\b|\bwhotracks\b|\bublock\b/i], ['Threat feed / blocklist', 'internet', /\bphish ?tank\b|\bopen ?phish\b|\bapwg\b|\bspamhaus\b|\bsafe ?browsing\b|\bspamcop\b|\bblack ?list|\bblock ?list|\bsurbl\b|\burlhaus\b/i], ['VirusTotal', 'internet', /\bvirus ?total\b/i], ['Malware corpus (VirusShare, Drebin, Genome, EMBER, Koodous)', 'internet', /\bvirus ?share\b|\bdrebin\b|\bmalware genome\b|\bember\b|\bkoodous\b|\bmalware bazaar\b|\bmalsign\b|\banubis\b|\btheZoo\b/i], ['App store / app corpus (AndroZoo, Play, F-Droid)', 'internet', /\bandro ?zoo\b|\bgoogle play\b|\bplay store\b|\bapp ?store\b|\bapk ?pure\b|\bf-?droid\b|\bplay ?drone\b|\bandroid market\b|\bchrome web store\b|\bmozilla add-?ons\b|\brico\b/i], ['Vulnerability database (NVD, CVE, KEV, Snyk)', 'internet', /\bnvd\b|\bcve\b|\bnational vulnerability database\b|\bsnyk\b|\bexploit-?db\b|\bknown exploited vulnerabilit/i], ['Bug tracker / fuzzing corpus (syzbot, OSS-Fuzz, Bugzilla)', 'internet', /\bsyzbot\b|\boss-?fuzz\b|\bbugzilla\b/i], ['Code host / package registry (GitHub, npm, PyPI)', 'adjacent', /\bgithub\b|\bgh ?archive\b|\bnpm\b|\bpypi\b|\bmaven\b|\bdebian packages?\b|\blibraries\.io\b|\bsourceforge\b/i], ['Website-fingerprinting trace set (Wang, AWF, DF, BigEnough)', 'internet', /\b(wang|awf|df|bigenough|walkie-?talkie|drl-?fp)( |-)?(dataset|traces?|set)?\b(?=.*(dataset|trace|fingerprint)|$)/i], ['Other public data service (OpenStreetMap, OpenSky, WiGLE, Google Trends)', 'internet', /\bopen ?street ?map\b|\bopen ?sky\b|\bwigle\b|\bopencellid\b|\bgoogle trends\b|\bgoogle bigquery\b|\bpublic dns server list\b|\bbitnodes\b/i], ['Industry / proprietary data (a partner gave it to them)', 'proprietary', /\bproprietary\b|\bpartner\b|\bsecurity (company|vendor|firm)\b|\bpalo alto\b|\bsymantec\b|\bmcafee\b|\btrend ?micro\b|\bcloudflare\b|\bakamai\b|\bmicrosoft (internal|telemetry)\b|\bindustry partner\b|\bisp (logs?|traces?|data)\b|\bcustomer\b|\binternal (logs?|data|dataset)\b|\bnda\b|\bcollaborat(or|ing) (company|organi[sz]ation)\b|\bunder nda\b/i], ["Authors' own or unnamed source", 'unnamed', /^(custom|our own|self-?collected|unnamed|prior work|previous (study|work)|table \d+|corpus|scientific literature)\b|\bcustom (seed list|dataset|corpus|list)\b|\bcollected by (the|us)\b|\bour (previous|earlier|prior)\b/i], // --- Adjacent reused data ------------------------------------------------- ['Social / UGC platform dump', 'adjacent', /\bpushshift\b|\breddit\b|\btwitter\b|\bfacebook\b|\bflickr\b|\byoutube\b|\byelp\b|\bwikipedia\b|\blivejournal\b|\bfoursquare\b|\bgowalla\b|\blinkedin\b|\bweibo\b|\bdianping\b|\bsteam\b|\bimdb\b|\bmovielens\b|\brotten tomatoes\b/i], ['Underground forum corpus (CrimeBB)', 'adjacent', /\bcrime ?bb\b|\bunderground forum/i], ['Blockchain / chain explorer', 'adjacent', /\bethereum\b|\bbitcoin\b|\bether ?scan\b|\bbitnodes\b|\bzcash\b|\bmonero\b|\bsmart contract sanctuary\b|\bblockchain\b/i], ['Leaked credential corpus', 'adjacent', /\brock ?you\b|\bcomb\b|\b4iq\b|\b000 ?webhost\b|\bneopets\b|\bhave i been pwned\b|\bleaked password/i], ['Email corpus (Enron)', 'adjacent', /\benron\b/i], ['Privacy-policy corpus (OPP-115)', 'adjacent', /\bopp-?115\b|\bprivaseer\b|\bpolisis\b|\bprivacy ?policy corpus\b/i], ['Scholarly / bibliographic', 'adjacent', /\bdblp\b|\barxiv\b|\bgoogle scholar\b|\bmicrosoft academic\b|\bpubmed\b|\bsemantic scholar\b|\bcite ?seer\b/i], ['Government / official statistics', 'adjacent', /\bamerican community survey\b|\bdata\.gov\b|\bhcup\b|\bcensus bureau\b|\btexas hospital\b|\bgene expression omnibus\b/i], // --- Out of scope, counted ------------------------------------------------ ['ML benchmark dataset', 'benchmark', /\bcifar|\bmnist\b|\bimage ?net|\bceleb ?a\b|\bsvhn\b|\bgtsrb\b|\blibri ?speech\b|\bvox ?celeb|\btimit\b|\bvctk\b|\blfw\b|\bkitti\b|\bbdd100k\b|\bsquad|\bglue\b|\bmmlu\b|\bgsm8k\b|\bwikitext|\bthe pile\b|\bag news\b|\bsentiment140\b|\bcora\b|\bpubmed\b|\bfashion-? ?mnist\b|\bstl-?10\b|\bcinic|\bvgg ?face|\bffhq\b|\bnuscenes\b|\bcub-?200\b|\bemnist\b|\bspeech commands\b|\bdailydialog\b|\balpaca\b|\bcnn\/daily ?mail\b|\bfaceforensics|\btiny ?imagenet\b|\basvspoof|\bpurchase ?100?\b|\btexas ?100\b|\badult\b|\buci\b|\bkaggle\b|\bopen speech\b|\baudio ?mnist\b|\bfree spoken digit\b|\bimagenette\b|\bmovielens|\bsift\b|\bcornell movie|\bwine\b|\bgoogle code jam\b|\bstreamspot\b|\bgeotext\b|\bgeolife\b|\bapimu4c\b/i], ['Software / fuzzing benchmark suite', 'benchmark', /\blava-?m\b|\bmagma\b|\bfuzz ?bench\b|\bspec ?(cpu|int)|\bjuliet\b|\bdroid ?bench\b|\bbeebs\b|\bpro ?fuzz ?bench\b|\bfuzzer test suite\b|\bbinsec\b|\bp2im\b|\bswat\b|\bwadi\b|\bsyzkaller\b|\bcustom benchmark\b|\bregexlib\b/i], ]; const SENTINELS = /^(not[- ]stated|none[- ]mentioned|not[- ]applicable|unclear|unknown|n\/a|-)$/i; // Returns every matching family. Empty array = residue. export function foldDataset(raw) { const s = String(raw ?? '').trim(); if (!s || SENTINELS.test(s)) return []; const hits = []; for (const [name, scope, re] of FAMILIES) if (re.test(s)) hits.push({ name, scope }); return hits; } export const isSentinelName = (raw) => { const s = String(raw ?? '').trim(); return !s || SENTINELS.test(s); }; export const FAMILY_SCOPE = new Map(FAMILIES.map(([n, s]) => [n, s]));
6.2 Residue: every string the fold could not place
3,192 distinct strings, 3,162 of them named by exactly one paper. No additional family fixes that — the tail is one-off by nature, which is the content page's point. Printed in full so it is not a number nobody can inspect:
- residue.txt
6. RESIDUE: source strings the fold could not place ========================================================================== residue papers (>=1 unplaced string) 1896 (55.9% of 3389) residue distinct strings 3192 (62.6% of 5103 raw strings) Residue strings named by >= 2 papers (the part worth a family if anyone adds one): 3 Bing search logs 3 Android Security Bulletin 3 SamMobile 3 Purchase 3 GTT23 2 AOL query log 2 Amazon 2 AOL dataset 2 AmpPot 2 AmIUnique 2 Linux kernel git history 2 CodeGuard nightly backups 2 Lending Club loan data 2 Snort 2 Nym network 2 LSMDC 2 Twitter15 2 Twitter16 2 IoT Inspector 2 Harvard Sentences dataset 2 Keystroke100 Dataset 2 ODGen dataset 2 TREC 2 ChatGPT-Roles 2 SIQA 2 FUGIO dataset 2 UC Irvine Machine Learning Repository 2 PSKReporter 2 PII datasets 2 StrongREJECT Residue strings named by exactly one paper: 3162. Full list under --residue-all. 1 #Donttweet dataset 1 .nl ccTLD authoritative traffic 1 .nl ccTLD traffic traces 1 /r/HansaDarknet-Market and /r/DarkNetMarkets 1 /usr/share/dict/ on Mac OS X 1 0-day and N-day firmware datasets 1 1,000 most common words in the English language 1 10 existing mental health analysis datasets 1 10 mainstream VR platforms 1 10-hour location trace of a real user 1 1000 Genomes Project and OpenSNP 1 1000 Genomes Project phase 3 1 11 large real password datasets 1 11 public traffic datasets: HyperVision, CIC, Whisper, Kitsune, NetBeacon, and CTU datasets 1 12 password datasets 1 12 real-world public datasets 1 126, Tianya, Dodonew, Taobao, and CSDN 1 13 password datasets leaked from various web services 1 14 widely used real-world password datasets 1 15 real-world datasets 1 155,030 route traces from the IP level survey 1 16 firmware images 1 1998 World Cup Web Site Access Logs 1 20 Newsgroups 1 2006 flirtlife.de list 1 2009 computerbits.ie list 1 2009 hotmail.com list 1 2010 Privacy-Protected Microdata File and Summary File 1 (SF1) 1 2010 Toyota Camry CAN traffic 1 2010 US Census and US Social Security Administration baby names 1 2010 US Census 1 2010 census 1 2013 general elections in Israel 1 2014 DITL collection 1 2014 PhpBB password leak 1 2015 ACL Workshop on Computational Linguistics and Clinical Psychology dataset 1 2016 ACS provided through NHGIS 1 2016 Virginia statewide general election 1 2018 DITL data 1 2018 House of Representatives election 1 2019 DITL data 1 2019 ZGrab scan data provided by Wan et al. 1 2020 TLS scan provided by Izhikevich 1 2020 US Presidential election results 1 2020 conference welcome note 1 2021 AllSides Media Bias Chart 1 2023 network trace 1 20News 1 22 test lists 1 24 industry reports 1 24 security incidents 1 300W-3D and Texas-3DFR 1 360 Netlab historical WHOIS 1 360 Secure Browser certificate records 1 360 Secure Browser opt-in program 1 3GPP CR database 1 3GPP TS 24.301 v16.6.0 1 3GPP archive 1 3GPP cellular specifications 1 4chan and Lexica 1 4chan dataset 1 4chan, Lexica, and I2P prompt datasets 1 5EPlay 1 7 public audit reports 1 739 .pcap files containing network data from and to two BestMixer hosts 1 750 malware apps from [46] 1 800notes 1 A Million News Headlines 1 A RCUS 1 A-MIU NIQUE crowd-source experiment 1 ABOVE20 1 ACEF Scam-Bait (ASB) 1 ACM Digital Library 1 ACM 1 ACS suite 1 AFLGo test cases 1 AFP and Reuters databases 1 AGNews 1 AI Incident Database 1 AI-Writer 1 AIR, MARDY, REVERB and RWCP 1 AISHELL test 1 AJE opinion articles 1 ALAD 1 AM I UNIQUE 1 AMD dataset [42] (AMD) 1 AMPds 1 AMiner citation network 1 ANT IP Hitlist 1 ANT outages data set 1 AOL query log dataset 1 AOL search log 1 AOL search logs dataset with Google Topics classification 1 AOL search logs dataset 1 AOL search logs 1 AOL search query log dataset 1 AOL 1 AOSP Android 14 1 AOSP Android releases 1 APIGraph 1 APKCombo 1 APP-350 1 APS citation network 1 APT and cybercriminal campaign collection 1 APT reports, spam trap, and malware feeds 1 APT sample collections 1 AR-Miner dataset 1 ARESset 1 ARKitScenes 1 ARTS dataset 1 AS-OREGON and PORTLAND network datasets 1 AS-OREGON 1 ASA 1 ASIACCS'17 dataset 1 ASL 1 ASSISTments 1 ASdb, AS2ORG, and ASRank 1 AT&T Faces data 1 AT&T database of faces 1 AT&T dataset 1 AURORA 1 AV telemetry dataset 1 AV-vendor behavioral telemetry 1 AW-SomePy dataset 1 AWS SPS dataset 1 AWS Serverless Application Repository and Alibaba Serverless Application Center 1 AWS Spot Price History 1 AWS outage traffic data 1 AWS pricing history API 1 Aachen impulse response database and MIT IR Survey 1 Abilene Internet2 backbone network data 1 Abilene Internet2 backbone network 1 ActRecTut 1 ActiveDNSProject 1 ActiveRT2017 1 Activity Type (Gait) Dataset 1 ActivityNet Captions 1 ActivityNet 1 Ad Fingerprinting dataset from [14] 1 Ad Fingerprinting dataset from a related research study [14] 1 Additional leaked and cracked password sets augmenting PGS 1 Adobe and Myspace databases 1 Adobe email leakage dataset 1 Adobe leak 1 Adobe, Anti Public, and Collection #1 leakage datasets 1 AdvBench Dataset 1 AdvBench and JailbreakBench 1 AdvBench subset 1 AdvBench 1 AdvBench; safe-guard-prompt-injection dataset 1 AgeDB-30 1 Ahmad et al. [11] 1 Aion log-based dataset 1 Alexander Mylnikov 1 Ali-CCP Dataset 1 AliMe 1 AliPay consented volunteer dataset 1 Aliapoulios et al. pre-policy change dataset 1 Alibaba online credit payment service dataset 1 Alice et al. low-entropy experiment 1 All scams 1 AllSides-S 1 AlpacaCare-MedInstruct-52k 1 AlphaBay (2015-2017), from Van Wegberg et al. [24] parsed and analyzed data set 1 AlphaBay crawl data from Soska and Christin 1 AlphaBay crawl data 1 AlphahomaraExploit 1 Amazon CD 1 Amazon Cell Phone 1 Amazon Mechanical Turk 1 Amazon Reviews, Multi-News, and HotpotQA 1 Amazon Reviews 1 Amazon product reviews 1 Amazon review dataset 1 Amazon reviews 1 Amazon-Baby 1 Amazon-Beauty 1 AmazonMovies 1 American Physical Society 1 Aminer citation dataset 1 Amitay dataset 1 Amitay-4-digit dataset 1 Amitay-4-digit 1 AmpPot authors' honeypot dataset 1 Android 11 (RQ3A.211001.001) & 12 (SP2A.220505.002) images of Pixel 3a 1 Android 11 and 12 Pixel 3a system images 1 Android AOSP source code 1 Android Dumps 1 Android and IoT firmware images 1 Android factory OS images 1 Android framework versions 8 through 11 1 Android platform releases 1 Android system images 1 Android unlock pattern datasets 1 Android-4.14-p-release 1 Andrubis dataset 1 Anonymous Authority ground-truth dataset 1 Anonymous Authority 1 Anthropic red-team data 1 Antichat SQL dump 1 Antiy AVL Mobile Security 1 Antiy AVL 1 Antrim County election-system records 1 Anycast census snapshots 1 AotM, Zhihu, Spotify, and Goodreads 1 AotM 1 Apache mailing list archives, "java-user" mailing list 1 Apache mailing list archives 1 Apkcombo 1 Apollo BA-MSF input trace 1 Apollo Data Open Platform 1 App installation logs 1 AppBrain.com 1 AppCensus 1 AppFigures 1 Apple Store 1 Apple XNU kernel versions 1 Apple egress IP geolocation feed 1 Apple iOS firmware images 1 Application-Host 1 Arbor Networks traffic and attack dataset 1 Arbor Security Engineering and Response Team ATLAS system 1 Arcade and DYNAMO permission mappings 1 Archipelago (Ark) 1 Area-Codes.com 1 Ares dataset 1 Argoverse 1 Arteau dataset 1 ArticleForge 1 Asian ISP 1 Asylum Stresser leaked backend database 1 Australian Ad Observatory 1 AutoCog Android dataset 1 Avalanche takedown ground truth and historical third-party datasets 1 Avazu click-through rate prediction data 1 Avazu dataset 1 Azure Function Trace 2019 1 Azure Public Dataset 1 Azure public cloud dataset 1 B-Root DNS anomaly dataset 1 B-Root traffic logs 1 B-long 1 B-root and Dutch national scrubbing-center datasets 1 B-root attack data 1 B-root attack traces 1 BBC news dataset 1 BBCNews 1 BEC-Guard-processed emails 1 BEIR benchmark 1 BEIR collection 1 BGL 1 BGP visibility data 1 BIBIFI competition submissions 1 BIBIFI competitions 1 BIND and OpenSSL git repositories 1 BIND, OpenSSL, and Linux kernel source releases 1 BLAG dataset 1 BMS-POS 1 BNB Smart Chain historical transactions 1 BTC.com 1 Baby 1 Back-Side SEM Images and Respective Modified GDSII Chip Designs 1 Bad Packets honeypots 1 Bad Packets 1 Bad set 1 Baidu Network bidding logs 1 Baidu URL Snapshot Dataset 1 Baidu evil pages 1 Baidu search-volume snapshot 1 Baidu-128 1 Baidu-64 1 Balasubramanian et al. 2024 US Elections dataset 1 Balasubramanian et al. [4] 2024 US Elections dataset 1 BankDomain 1 Baqir et al. Ukraine-Russia War dataset 1 Baqir et al. [5] Ukraine-Russia War dataset 1 Barracuda Networks active customers 1 Barracuda malicious-email corpus 1 Battlefield Heroes 1 Bayer et al. behavior profiles 1 BayesDroid dataset 1 BeIR 1 BeatLeader Dataset 1 BeeTrove 1 Beijing Multi-Site Air-Quality Dataset 1 Berkeley, IN-RIA, and face-turning vision datasets 1 BestWhois service 1 BeyondPhish 1 Bfield 1 Big-Vul 1 Bing Search dataset 1 Bing URL snapshots 1 Bing auction engine 1 Bing internal advertiser and advertising-network records 1 Bing query data sample 1 Bing query logs and Bing click logs 1 Bing query reformulation data 1 Bing query-click logs 1 Bing sampled search query log 1 Bing search log 1 Bing search query logs 1 Bing search toolbar histories 1 Bing user visit activity logs 1 Bing 1 Bitcoinabuse 1 Bitdefender 1 Bitfinex and LN-BIG relay lists 1 Bitswap logs 1 BlackFan Dataset 1 BlackhatWorld SQL dump 1 BlockSec database 1 BlockSec 1 Blockchair 1 Blogger public blog-post corpus 1 Blogwatcher GPS trajectory data 1 Bloomberg Terminal 1 Bloxy 1 Blue Gene/L supercomputer system logs 1 Boats 1 BookCrossing 1 Books / Goodreads public dataset 1 Books 1 BootStomp dataset 1 Bosch Night dataset 1 Boston taxi trace dataset used by MIT Challenge 1 Bot Adversarial Dialog (BAD) test set 1 Botlab 1 Botometer Bot Repository and original benchmark datasets 1 Botometer Bot Repository 1 Brain MRI segmentation dataset 1 Brazilian government foreign-trade datasets 1 Brazzers, Clixsense, and CSDN 1 Brazzers 1 Breach Level Index 1 BreachCompilation 1 BrightKite 1 Brightkite dataset 1 Brisbane ETC infrastructure and public toll-road information 1 Brown Corpus 1 Brown corpus 1 Browser dataset 1 Build-it Break-it Fix-it dataset 1 Bulk WHOIS dataset 1 Bulk WHOIS snapshots 1 C3PA 1 C4 corpus 1 CA-published CRLs 1 CA4P-483 1 CAN traffic data logged from a Dodge Ram Pickup 2010 by Daily 1 CAN traffic data logged from a Toyota Camry 2010 by Ruth et al. 1 CAN traffic data 1 CAN traffic logs from Toyota Camry 2010 and Dodge Ram Pickup 2010 1 CAN-MIRGU and OTIDS 1 CAN-MIRGU 1 CANHunter dataset 1 CASIA NIR-VIS 2.0 face database 1 CASIA 1 CAsT-19 1 CAsT-20 1 CD-ADD 1 CDN BEACON dataset 1 CDN Clients 1 CDN DEMAND dataset 1 CDR dataset provided by a cell phone operator in Europe 1 CENTRIS OSS dataset 1 CENTRIS dataset 1 CEPH/Utah Pedigree 1463 1 CERT Insider Threat Test Dataset 1 CERT insider threat dataset v6.2 1 CETA transcript database 1 CFP-FP 1 CGR [59] 1 CHQ-Summ 1 CIC datasets 1 CIC-Evasive-PDFMal2022 dataset 1 CICAPT-IIoT2024 1 CICDataset 1 CICIoT2023 1 CIDDS 1 CIRA-CIC-DoHBrw-2020 (DoHBrw) 1 CIRA-CIC-DoHBrw-2020 1 CLEF Technology Assisted Reviews (TAR) 2018 collection 1 CLUST 1 CMS Law GDPR Enforcement Tracker 1 CMU ARCTIC 1 CMU Arctic and VoxForge 1 CMU_ARCTIC 1 CMU_arctic 1 CNCF project list 1 CNN-DM 1 CNN-DailyMail News Text Summarization dataset 1 CO-oPS app usage logs 1 COCO 1 COCO2017 and Flickr30k 1 COMPAS 1 CONLL2012 1 COVID19 USFlows 1 CPP4APP, CA4P-483, and MAPP Corpus 1 CPP4APP 1 CQ500 dataset 1 CRATE datasets 1 CREMA-D 1 CRLs for public-facing SSL servers on the Internet 1 CRUW dataset 1 CRXcavator 1 CSDN, Tianya, Duduniu, 7k7k, and 178.com 1 CSDN 1 CSIC and PKDD datasets 1 CSIC dataset 1 CSQA dataset 1 CSUKIED 1 CT-log ingestion pipeline 1 CTD [26] 1 CTD 1 CTU-13 1 CUG Hand dataset 1 CW dataset, modified with random desynchronization 1 CYBER PROBE dataset 1 Cabspotting dataset 1 Cali [52] 1 Cali, DG, CGR, NH, Boats, and Grid datasets 1 California Intersections 1 California Public Salaries Data 1 California Road Network dataset 1 Call Detail Records (CDRs) 1 Call Detail Records provided by a tier-1 cellular operator 1 Caltech 101 1 Cambridge Cybercrime Centre 1 CarTel project testbed 1 Carat research project 1 Carat 1 Carders SQL dump 1 Carla simulator 1 Carnus dataset by Karami et al. 1 Carnus 1 CaseHOLD 1 Celeb-DF (CDF) 1 CelebDF 1 Celebrity-1000 dataset 1 CelesTrak satellite position data 1 CelesTrak's NORAD / Space-Track APIs 1 CelesTrak 1 Census Income dataset 1 Census-income Dataset 1 CensusHub system of Eurostat 1 Centers for Disease Control and Prevention body height and weight dataset 1 Cerner Corporation's PowerChart EMR system 1 CertStream 1 Certik, Slowmist, and Blocksec security reports 1 Certora audit reports 1 Chainabuse 1 Chainalysis Crypto Investigations 1 Chainalysis-attributed centralized mixers active during BestMixer's lifetime 1 ChakraCore regression test suite 1 ChangeMyView argumentative corpus 1 ChangeMyView forum 1 Char-level dataset published in [63] 1 ChatLog-HC3 1 Chest X-ray8 1 ChestX-ray 1 Chicago Open Data 1 Chicago Open Data; Minneapolis Open Data; Edmonton E-Scooter Share API 1 Chiew et al. phishing dataset 1 China Population Data 1 Chinese public financial documents 1 ChipWhisperer CW dataset 1 ChoCo 1 Chordify Annotator Subjectivity Dataset (CASD) 1 Chrome CRLSets 1 Chrome Platform Status 1 Chrome extension manifests 1 Chrome product help forum 1 Chrome telemetry 1 Chrome user metrics and certificate-error telemetry 1 Chrome's user metrics program 1 Chromium and Firefox public bug reports and revision histories 1 Chromium issue tracker 1 Ciao, Epinions, and Filmtrust 1 Ciao 1 Cisco/Meraki location analytics dataset 1 Cit0day Collection 1 Cit0day 1 City of Chicago data portal 1 Civil Comments portion of Wilds 1 ClariQ-FKw 1 Classic 1 Clauset et al. [12] 1 CleanMX feed 1 Clemens [37] dataset 1 Clemens dataset 1 Clinic CMS transcripts 1 ClinicalTrials.gov 1 Clixsense 1 CoDeeN access logs 1 CoDeeN full-content cache-miss traffic 1 CoMon 1 Coalition Against Stalkerware Stalkerware Threat List 1 CodeAlpaca-20K 1 CodexLeaks templates 1 CoinDance 1 CoinWarz 1 Collection#1 1 College IM 1 Common CA Database audit collection 1 Common Objects in COntext (COCO) dataset 1 Common Platform Enumeration (CPE) database 1 Common Vulnerabilities and Exposures dictionary 1 Common Weakness Enumeration (CWE) database 1 CommonVoice 1 Communities 1 Community Notes dataset collected by a previous study 1 Community Notes public data 1 Community Notes, EUvsDisinfo, and Database of Known Fakes 1 Compas 1 Compromised account logs from both universities 1 ConceptNet 1 ConcoctedPharma dataset 1 ConfAIde 1 Conficker IP address lists 1 Conficker sinkhole logs 1 Contagio Mobile 1 Contagio dataset 1 Contagio dataset; CIC-Evasive-PDFMal2022; PDF Association PDF corpus 1 Contagio 1 Conversations Gone Awry dataset 1 Conviva dataset 1 Conviva dataset: VOD provider 1 Conviva dataset: live provider 1 Conviva 1 Cookiebot 1 CopperDroid analysis reports 1 CoralCDN aggregated logs 1 Coremail 15-month email delivery log 1 Coremail email delivery logs 1 Coremail email server log 1 Coremail one-year email reception logs 1 Cornell password change logs 1 Cosmopedia 1 County Distance Database 1 Covid-19 homeschooling survey dataset 1 Credit card fraud detection 1 CreditCard 1 Crimes 2001 to present (city of Chicago) 1 Crimes 2001 to present (city of chicago) 1 CrisisMMD 1 Criteo dataset 1 Criteo display advertising data 1 Cross Platform and Andrubis 1 Cross Platform dataset 1 CrossNet2021 dataset 1 CrossVul, Big-Vul, and VUDENC 1 CrowDEA 1 Crunchbase 1 CryptoAPI-Bench 1 CryptoScamDB 1 CryptopiaHack 1 Cuevas et al. [9] dataset 1 Curlie 1 Curlie/SURL dataset 1 Cutwail C&C servers 1 D&D 1 D-root DNS root server 1 DAKOTA Dataset 1 DALL-E-Prompts-OpenAI-ChatGPT 1 DALLEPrompt 1 DANN 1 DAPS dataset 1 DARPA CGC dataset 1 DARPA Cyber Grand Challenge corpus 1 DARPA Cyber Grand Challenge samples 1 DARPA Engagement 3 datasets 1 DARPA 1 DARPA-Cadets, DARPA-Theia, and DARPA-Trace 1 DARPA/MITLL 1999 intrusion detection dataset 1 DAVIS 1 DAppFL 1 DBPedia 1 DBpedia 1 DCF dataset 1 DD-WRT Firmware Image r21676 and ReadyNAS Firmware Image v6.1.6 1 DD-WRT Firmware Image r21676; ReadyNAS Firmware Image v6.1.6 1 DD16 1 DDO dataset from Debate.org 1 DDXPlus 1 DDoS attack workload collected by a DDoS mitigation company with partnerships with various major ISPs 1 DDoS attack workload from a DDoS mitigation company 1 DEF CON 2015 network traffic 1 DEF CON Media Server 1 DEI dataset 1 DET 1 DF-W and DF-R 1 DF40000 1 DF95 1 DFDC 1 DG [58] 1 DGA 1 DGaze and ET-DK2 1 DGaze dataset 1 DHT logs 1 DIADEM dataset 1 DIE corpus 1 DIRE 1 DISCO 1 DITL (Day In The Life of the Internet) 1 DITL 2017 and B-Root traffic logs 1 DITL 2017 1 DITL A-root data 1 DITL data set 1 DIV2K Train 1 DIV2K Valid 1 DMD dataset 1 DMOZ directory 1 DMap .nl web-crawl datasets 1 DNC, Hynek, GoS and BSI malicious JavaScript collections 1 DNC, Hynek, GoS and BSI 1 DNS B root traffic via IMPACT Cyber Trust program 1 DNS Coffee 1 DNS Zones Authority 1 DNS dataset for malicious domains detection 1 DNS traffic log from a large ISP 1 DNS-OARC DITL 2016 and 2017 collections 1 DNS-OARC DITL 2017 1 DNS-OARC DITL 1 DNS-OARC Day In The Life of the Internet (DITL) 1 DNS-OARC Day-in-the-Life datasets 1 DNS-OARC 1 DNSViz historical database obtained from DNS-OARC 1 DS1 1 DScope HTTP(S) request dataset 1 DSf 1 DSr 1 DVQA, FigureQA, and LEAF-QA 1 DVQA 1 Dagger cloaking data 1 Damballa-tracked botnet C&Cs 1 Dan. Tor node list 1 Dark Net Market archives, 2011-2015 1 Dark Web repository 1 Darknet D1 1 Darknet D2 1 Darknet Market Archives 1 Data Center (DC) 1 Data Set for IMC 2010 Data Center Measurement 1 Data USA API 1 Data is Beautiful 1 Data&Society probabilistic telephone survey 1 DataCon2020, DataCon2021-p1, DataCon2021-p2, Browser, NUDT_MobileTraffic, and CSTNET-TLS1.3 1 DataSF Fire Department Calls for Service 1 DataStreamer.io 1 Database of Known Fakes (DBKF) 1 Dataport 1 Dataset #1 [6], collected via breadth first search using related video links 1 Dataset #2 [9], all videos in the Entertainment category 1 Dataset of detected extensions from Laperdrix et al. 1 DeFi Attacks SoK dataset 1 DeFiHackLabs 1 DeFiLlama and DeFiYield audit databases 1 Debate.org 1 Debian archive 1 Debian stable distribution 1 Debian/Ubuntu security advisories 1 Debloater-Eval benchmark [30] 1 DecodingTrust 1 Deep VC Fingerprinting dataset 1 Deep1B 1 DeepCorr dataset 1 DeepFashion 1 Defects4J 1 Delhi Dataset 1 Department of Health & Human Services policy dataset 1 Department of Health & Human Services 1 Derm7pt, SkinCon, PBC, and Thyroid 1 Derm7pt 1 Desktop telemetry 1 Device Analyzer 1 Devign 1 DexYCB dataset 1 DiDeMo 1 DiDi Chuxing historical dispatching events 1 DiDi Chuxing historical order and vehicle data 1 DiDi Chuxing 1 Diabetic Retinopathy (DR) 1 Diamond Miner interdomain diamonds 1 Diantao App interaction logs 1 DiffusionDB 1 DifuzzRTL 1 Digitec Galaxus clickstream dataset 1 Digitec Galaxus 1 DingXiang 1 Disqus 1 DiverseVul 1 DoHBrw-NetEnv 1 Docker Hub 1 Dolly-15k 1 DomainTools WHOIS dataset 1 DomainTyper 1 Domains Project 1 Domains with English policy documents 1 Domains with robots.txt files 1 Douyin comments 1 Dreaddit 1 Dst Index and Starlink Two Line Elements 1 Du et al. [14] (Corpus III) 1 Du et al. [14] Corpus III 1 Dubois et al. accidental activation dataset and Schönherr et al. crafted triggers 1 Duo logs for U2 1 DynaPD dataset 1 ECHR 1 ECO dataset 1 ECO 1 EFF SSL Observatory 1 EFF data set 1 EFF's SSL Observatory IP addresses 1 EFF 1 ENS official database 1 EOS AFE dataset 1 EOSIO MainNet and on-chain transaction records 1 ERASAN dataset 1 ERASAN, RUSTSAN, RUG, and CrabTree datasets 1 ESC-50 1 ESNet data set 1 ET-DK2 dataset 1 ETF IoT Botnet dataset 1 EU Email 1 EUA dataset 1 EUR-LEX 1 EUvsDisinfo 1 EXTREME BB dataset 1 Earth System Research Laboratory, USA 1 EasyPIMS browsing-history dataset 1 Ecosystem 1 EdgeScope 1 Edinburgh DataShare 1 Edman and Syverson client and destination AS distributions 1 Edmonton E-Scooter Share API 1 Eelco Herder URL traces 1 Egolife 1 Eidsiva enterprise graph and PDNS-Net/domain-IP graph 1 Eidsiva enterprise graph 1 Eight benchmark datasets listed in Table V 1 Elastic Detection Rules 1 Electric Vehicle Database 1 ElectroCardioGram Database 1 EmNetTest dataset 1 EmTaint dataset 1 Empathetic Dialogues dataset 1 EmpatheticIntents dataset 1 English proceedings from WIPO, FORUM, CAC, ADNDRC, and CIIDRC 1 Epinions 1 Eskom's Data Portal 1 EskomSePush API 1 Estonian government education and tax databases 1 Eth-PSD [25] 1 Eth-PSD 1 Euro-CIS and Fake Name Generator datasets 1 Euro-CIS dataset 1 Euro-CIS ground truth 1 EuroC drone dataset 1 European IXP 1 Eurostat; Statistics South Africa; NZ.Stat; Statistics Bureau of Japan; Australian Bureau of Statistics; Statistics Canada; Census and Statistics Department for Hong Kong 1 Eventful website 1 Everyday Conversations for LLMs 1 Evidon Global Opt-out 1 Exploit Database 1 Extension Defender 1 External actions extracted from collected workflows 1 EyeTrack controlled experiment 1 FASHION [58] 1 FCC Disaster Information Reporting System 1 FCC Measuring Broadband America and HSDPA mobile network datasets 1 FCC Measuring Broadband America; HSDPA mobile network datasets 1 FCC National Broadband Map / Broadband Data Collection 1 FCC National Broadband Map changes and challenges 1 FCC National Broadband Map 1 FCC database of digital TV towers in the United States 1 FCC 1 FCC18 dataset 1 FCWs dataset 1 FDNS 1 FDVT browser extension 1 FEDWEB13 1 FEMA 1 FEMNIST 1 FENG14 tweet collection 1 FIFA World Cup 1998 website access logs 1 FLIR ADAS dataset 1 FLIR ADAS, LTIR, and ASL thermal datasets 1 FMNIST 1 FMNV 1 FPAD-OOD 1 FPs reported by users 1 FR200K 1 FRUNI 1 FSDD and TIDIGITS 1 FST and CSNED 1 FTC Do Not Call Complaints 1 FTC fraud complaint database 1 FTREE 1 FUGIO dataset and selected PHP application source code 1 Face Detection Data Set and Benchmark; MIT Indoor Scenes Benchmark 1 FaceScrub 1 Facebook1 [45] 1 Facebook2 [45] 1 Factory Images for Nexus Devices and Samsung Updates 1 Faddoul et al. prior study 1 Fake or Real News dataset 1 FashionStyle14 1 Fbhm, HarMeme, and Mami benchmark datasets 1 FedWeb14 1 Fiebig 1 FigureQA 1 File Appearance Logs 1 File Reputation Logs 1 Filmtrust 1 FinOrg 1 Financial 1 FingerPassDB7 and PatternFinger 1 Fingerprinting In Style dataset by Laperdrix et al. 1 Fire dataset built on PatchDB 1 Fire dataset 1 Firefox extension store 1 Firehol 1 FirmAE testing set and prior research 1 FirmAE's data set 1 FirmSec 1 FirmSolo dataset and Greenhouse dataset 1 FirmSolo dataset 1 Firmadyne dataset 1 Firmadyne's dataset 1 Firmadyne 1 Firmware Scanner / preinstalled-app dataset 1 Firmware Scanner 1 FirmwareDrive and Google factory images 1 Five public datasets obtained from NetShare authors 1 FixMyStreet and ichangemycity 1 Flashbots API 1 Flashbots public API 1 Flashbots searcher bundles 1 Flashbots searcher transactions 1 Flashbots web API 1 Flickr30k 1 Florida Department of Agriculture and Consumer Services skimmer reports 1 Fluent Speech Command Dataset 1 Food Rescue Hero database 1 Footprint Analytics 1 Fortune 1000 company list 1 Fortune 500 1 Fortune top 1000 company list 1 Forward DNS dataset 1 Four major JavaScript engine repositories 1 Frankencert 1 Fraudulent and Legitimate Online Shops Dataset 1 Free Company Dataset 1 FreeDisposableProvider 1 Freebase 1 French National Institute of Statistics and Economic Studies (INSEE) 1 Fuzzilli commit f31876f 1 Fuzzware 1 G REENHOUSE 1 GAP benchmark 1 GCA honeyfarm 1 GDELT 2.0 1 GDELT 1 GDPRHub, EnforcementTracker and PRIVACYAffairs 1 GDPRxiv official corpus 1 GEANT network backbone router data 1 GEANT network backbone router 1 GEO 1 GFWatch public dashboard 1 GIST 1 GOVAU and UMASS 1 GPA 1 GPABench2 1 GPQA 1 GPS sensors equipped by public taxicabs 1 GPT-2 Output Dataset 1 GPT-2 training dataset 1 GPTWiki Intro 1 GPTZoo 1 GROVER News, HC3, GPA, and GPTWiki Intro 1 GROVER News 1 GSMA Mobile Money Tracker 1 Gallup Daily survey 1 Gamba et al. preinstalled-app dataset / Firmware Scanner 1 Gartner product lists 1 Gawker.com password database 1 GeeksOnSecurity malicious JavaScript dataset 1 Geetest 1 Genius dataset and vulnerability dataset [18] 1 Genius dataset 1 GeoCov19 dataset 1 GeoCov19 1 GeoMAC 1 Georgia Tech malware feed 1 German Federal Statistical Office, tables 12411-0018 and 12211-9018 1 GigWork dataset (pseudonym) 1 Giotsas et al. facility-members dataset 1 Giotsas et al. router geolocation dataset 1 Git repository histories 1 Gitee 1 GlavMed back-end database 1 Glibc Testsuite 1 Global Cyber Alliance (GCA) 1 Global Routing Intelligence Platform (GRIP) 1 Global-Ping-Statistics project 1 Gmail SMTP connection logs 1 Gnutella Browse dataset 1 GoEmotions 1 Gong et al. [16, 15] Google+ snapshot 1 Gong-Surakav 1 Good-Bot-Bad-Bot dataset 1 GoodEnough 1 Goodreads 1 Google Chrome and Mozilla Firefox source code repositories 1 Google Chrome browser history database 1 Google Chrome extension samples 1 Google Chrome telemetry data 1 Google Cloud Public Datasets 1 Google Consumer Surveys 1 Google Health Trends 1 Google Local dataset 1 Google Maps internal snapshot 1 Google News Dataset 1 Google News archive 1 Google Products, Amazon and Shopping.com 1 Google Search RTBF request dataset 1 Google Smart Compose production model 1 Google TTS library 1 Google VTS 1 Google Web Corpus 1 Google Web Trillion Word Corpus 1 Google Web crawl 1 Google account recovery claims 1 Google accounts previously identified as victims of targeted attacks 1 Google deployment 1 Google fuzzer-test-suite 1 Google login traces and threat intelligence feeds 1 Google login traces 1 Google n-gram corpus 1 Google open image dataset 1 Google profile pages dataset 1 Google profile/blog dataset 1 Google recent crawl history/search index 1 Google search index 1 Google search query traffic 1 Google static mapping 1 Google's Internet-wide crawl 1 Google's fuzzer-test-suite 1 Google+ dataset from [35], [53] 1 Google+ snapshot collected by Gong et al. 1 Google-Insights 1 Google-disabled PVA 1 Google-provided labeled malware dataset 1 Google-publicly disclosed Android kernel CVEs 1 Google.com search query logs 1 Google20K wordlist 1 Googlebot records 1 Gossamer logs and compromise reports 1 Gossamer logs from two universities (U1 and U2) 1 Gossamer logs 1 GovDomain 1 Grayhat-Warfare 1 GreatFire Analyzer 1 GreatSchools reviews and U.S. Department of Education datasets 1 GreatSchools 1 Greenhouse dataset 1 Greynoise 1 Grid 1 Gridded Population of the World 2020, Version 4, Revision 11 1 Guan and Li evaluation dataset 1 Guo et al. [23] and Sun et al. [37] 1 Guo et al. curated collection 1 Géant traffic matrix 1 H AWK dataset 1 H-MOG dataset 1 HAC dataset 1 HARVARD speech corpus 1 HC3 1 HCRL CAN intrusion dataset 1 HD-EPIC 1 HDFS dataset 1 HDFS log data set 1 HEVC datasets 1 HH-RLHF and MetaTool 1 HHP-2011.xlsx and HHP-2012.xlsx 1 HKD 1 HLTV, FACEIT, and PureSkill.gg CSGO demo files 1 HM dataset 1 HMC2019 1 HOME-OFF and CAMP-OFF correlation datasets 1 HOPSCOTCH, AmpPot, and NETSCOUT 1 HOPSCOTCH 1 HSDPA and FCC bandwidth traces 1 HSDPA, FCC, and self-collected EC2P 1 HTTP logs of infected source websites 1 HTTP traffic log from two university networks and tens of enterprise networks 1 HTTP-14d trace 1 HTTPDataset 1 HTTPS scan in 2021 1 HackerOne public data 1 Hajime dataset 1 Hansa Market back-end database 1 Hansa back-end database seized by Dutch National Police 1 Harm-C and Harm-P 1 Harm-C 1 Harm-P 1 HarvardX-MITx Person-Course Academic Year 2013 De-Identified dataset, version 2.0 1 HateMM 1 Hayes dataset 1 Hayes 1 Health (Heritage Health Prize) 1 HealthCareMagic-100k 1 HealthCareMagic-100k-en 1 HellaSwag, BoolQ, and ARC Easy 1 Heritage Health Dataset 1 Herrmann et al. DNS dataset 1 Herrmann et al. website-fingerprinting dataset 1 Hidost 1 HighD dataset 1 HighSchool-2011, HighSchool-2013, PrimarySchool, ASA, and Hospital 1 HighSchool-2011 1 HighSchool-2013 1 Hilary Clinton's emails 1 Historical BGP updates and Level3 RIBs 1 Holidays 1 HomeSnitch Dataset 1 Hopscotch, AmpPot, and NewKid honeypots 1 Hospital Discharge Data public use files 1 Hospital 1 Hotmail Webmail dataset 1 Hotmail abnormal-activity sample 1 Hotmail account data 1 Hotmail anonymized email and reputation datasets 1 Hotmail more recent user login dataset 1 Hotmail reputation trace 1 Hotmail user login trace 1 HotpotQA 1 HuaTuo 1 Hugging Face Model Hub 1 HuggingFace API 1 HuggingFace 1 Human 1 HumanEval 1 Hussain et al. ad dataset 1 Hussain et al. dataset 1 Hybrid Analysis 1 Hynek Petrak JavaScript malware collection 1 HypeNET hypernymy dataset 1 HyperVision datasets 1 HyperVision 1 I2P (Inappropriate Image Prompts) dataset 1 I2P and Stable Diffusion Prompt Dataset 1 IAC-V1 1 IAC-V2 1 IANA Root Zone Database 1 IANA registrar IDs 1 IAPR-TC-12 1 IARPA Janus Benchmark-C (IJB-C) 1 IARPA Janus Benchmark-C 1 IBM Synthesize, BMS-POS, and Kosarak 1 ICANN RFC 8145 dataset 1 ICANN registry reports 1 ICIJ survey responses 1 ICLab and GreatFire 1 ICLab 1 ICSFuzz Benchmarks 1 ICSI Bro intrusion detection system logs 1 ICSI Notary 1 ICSI SSL Notary 1 ICSPatch Benchmarks 1 ICWSM 2009 Spinn3r Blog Dataset 1 IDLL storefront URLs 1 IDS/DoHBrw combined dataset 1 IDS2017&2018 datasets 1 IEEE-CIS 1 IFTTT applets 1 IFTTT dataset published by Ur et al. 1 IFTTT dataset used in [34] 1 IFTTT publicly published rules 1 IFTTT recipes collected by Ur et al. [31] 1 IFTTT rules with filter code 1 ILSVRC2012 1 IND LAB 1 INEP School Census 1 INRIA CopyDays Dataset 1 INRIA Holidays dataset 1 INSEE 1 IP Whois databases from all five RIRs 1 IP prefix allocation database 1 IPv6 rDNS data provided by Fiebig et al. 1 IPv6-enabled BitTorrent Peers 1 IQVIA dataset 1 IRC dataset 1 IRDB and Remote Central Forums 1 IRR archive 1 IRR database provider archives 1 ISCX VPN-nonVPN traffic dataset and ISCX Tor-nonTor dataset 1 ISCX, USTC, CICDataset, and HKD datasets 1 ISCX-IDS2012 1 ISCX-VPN 1 ISCXTor2016 dataset 1 ISI ANT IP History Dataset 1 ISI IPv4 hitlist 1 ISI Internet Addresses IPv4 Response History Dataset 1 ISI Internet Addresses Survey datasets 1 ISI Internet Addresses Survey 1 ISI Internet Outage Dataset 1 ISI hitlist 1 ISI's IPv4 hitlist 1 ISI's Internet census data 1 ISP DNS trace 1 ISP dataset 1 ITU numbering plan database 1 ITU official test videos 1 IXP Mapping Project 1 IXP-Country-Jedi dataset and supplementary AS-link dataset 1 IXP-Country-Jedi dataset 1 IYP snapshot 1 IYP 1 Image Manipulation Dataset (IMD) 1 In-the-Wild 1 InVivoGPT 1 Indian companies registration data 1 Indiana University X-ray Data (IU X-ray) dataset 1 Individual Household Electricity Power Consumption Dataset 1 Industry Robocall Blocking Dataset 1 InjecAgent benchmark [13], extended by authors 1 Innocenti et al. dataset 1 Inside Airbnb 1 Instacart 1 Instagram interaction network 1 Instagram 1 Institutional DNS scans 1 Instruction-2M, Aimedical, Mentalhealth, Evolcode, CodeparrotApps, NoRobots, and SyntheticGPT 1 Instruction-2M 1 Intel Linux Processor Microcode Data Files and CPUMicrocodes 1 Intelligence X leaked Ledger data dump 1 Interactive Steem API and Interactive TRON API 1 International Warfarin Pharmacogenetics Consortium Dataset 1 International section of the New York Times 1 Internet Address History data set 1 Internet Address History 1 Internet Atlas 1 Internet Census, Critical.IO, and TU Munich SSL scanning data 1 Internet Health Report 1 Internet RLT 1 Internet-Wide Scan Data Repository 1 Internet2 backbone 1 Internet2 data set 1 IoT Inspector dataset 1 IoT SENTINEL dataset 1 IoT and ConfAIde datasets 1 IoT market apps and publicly available IoT datasets 1 IoT 1 IoT-Bench repository 1 IoTMAL and the IFTTT dataset used in [34] 1 IoTMAL public SmartThings benchmark 1 IoTPOT traces 1 IoTProfiler's IoT Sensitive Data Taxonomy 1 IoTSpotter, IoTProfiler, and another study 1 Iris Database 1 Isolario 1 Israel COVID-19 dataset 1 Israel Ministry of Health COVID-19 dataset 1 Israel's National Registry of Live Births 1 JAM evaluation subjects 1 JBB-Behaviors 1 JS150k and Hynek Patrak JavaScript malware collection 1 JS150k 1 JailbreakBench 1 JailbreakHub, JailbreakBench, MultiJail, and AlpacaEval 1 JailbreakV-28K and WildTeaming 1 Janus Dataset 1 JavaScript engine repositories 1 Jing-Dong Logistics dataset 1 Jing-Dong Logistics 1 Johns Hopkins Coronavirus Resource Center 1 Juen's collection of Tor client statistics 1 KAIST Complex Urban dataset 1 KAIST Multi-spectral Advanced Driver Assistance Systems dataset 1 KARONTE dataset 1 KDD12 dataset 1 KDE Plasma desktop image 1 KDEF 1 KNOWN dataset 1 KTH Actions 1 KU-HAR 1 Karisani and Agichtein benchmark dataset 1 Karonte Dataset 1 Keystroke patterns as prosody in digital writings: A case study with deceptive reviews and essays [45] 1 Keystroke100 dataset 1 Khan Academy subset of Cosmopedia 1 Kiela et.al. [28] (Fbhm) 1 Kika Keyboard dataset 1 Kika Keyboard 1 Kinships dataset 1 Kitsune datasets 1 Kitsune 1 Klocwork Test Suite for C/C++ 1 Known Vulnerability Dataset 1 Kontur Population dataset 1 Kosarak 1 Kumar et al.'s IMC 2024 study 1 Kwon et al. study 1 Kyoto 2006+ dataset 1 Kyoto 2006+ 1 Kyoto2006+ 1 L F WC and G REENHOUSE firmware corpora 1 L F WC 1 L33tCrew SQL dump 1 LAION-400M 1 LAION-5B and Lexica 1 LANL dataset 1 LANL 1 LANL-CMSCSE 1 LASTLINE dataset 1 LBE Privacy Guard permission logs 1 LBE Privacy Guard 1 LBL 1 LBNL SMTP, NIDS, and LDAP logs 1 LBNL SSH PCAPs and syslogs 1 LBNL trace 1 LBNL, ICSI, NERSC, and an Amazon EC2 honeypot 1 LEAF-QA 1 LETOR 4.0, MQ2007 1 LETOR 4.0, MQ2008 1 LFWA+ 1 LISA 1 LJ-Speech-Dataset 1 LLMBar 1 LLaMA-Doctor and OPT-History datasets 1 LLaVA and MiniGPT-4 instruction-tuning datasets 1 LMSYS-Chat-1M 1 LN graph snapshot from https://ln.bigsun.xyz/ 1 LN graph snapshot 1 LSAC 1 LSUN, RAVDESS, WikiArt, and Pexels 1 LTIR 1 LaMP-QA 1 Labayen et al. 2020 user-activity dataset 1 Labeled Faces in the Wild 1 Landscape Dataset 1 Lang1995 1 LangChain Benchmarks 1 Last-FM 1 Last.fm dataset 1 LastFM Social Network 1 LastFM 1 Lausanne Data Collection Campaign dataset 1 Lawrence Berkeley National Laboratory (LBL) traffic trace 1 Lawrence Berkeley National Laboratory traffic trace 1 Lawschool 1 LeakIX platform 1 LeakIX 1 Leaked, cracked, and prior-study password datasets 1 Leaked-GPTs 1 Leetcode-cpp 1 Leetcode-py 1 Let's Encrypt certificate issuance and domain validation logs 1 Let's Encrypt certificate logs 1 Let's Encrypt logs 1 Let's Encrypt production deployment log data 1 Lexica 1 LibScout 1 LibriMix dataset 1 LibriSeVoc 1 Lightning Network snapshot 1 Lightning Network topology snapshots from public sources [32] 1 Lightning Network topology 1 Lightning network topology 1 Lilith Games 1 Linked Open Data datasets and LOV 1 Linux 3.19 source tree 1 Linux 5.6 source code 1 Linux Kernel selftests (kselftests) 1 Linux Testing Project (LTP) 1 Linux and FreeBSD kernel source code 1 Linux and FreeBSD kernel source trees 1 Linux kernel 5.11 source snapshot 1 Linux kernel 5.15 source snapshot 1 Linux kernel CVEs project 1 Linux kernel LTS version 6.6 branch 1 Linux kernel UAF CVEs 1 Linux kernel patch history 1 Linux kernel patches 1 Linux kernel repository 1 Linux kernel source code 1 Linux kernel source snapshot 1 Linux kernel source snapshots v4.1 and v5.6.13 1 Linux kernel source 1 Linux kernel v5.12 1 Linux kernel v5.15.83 source tree 1 Linux kernel v5.3, FreeBSD v12.1, and OpenSSL source snapshots 1 Linux kernel version 3.10-rc1 1 Linux mainline branch 1 Linux source and binary releases 1 Literature databases and NDSS paper archive 1 Liu et al.'s speech recognition dataset 1 LivDet-Iris 2020 1 LiveATC.net, VASAviation, and ADSB.lol 1 LiveLab dataset 1 LiveLab 1 Livedet2011 ItalData 1 Lizard Stresser leaked backend database 1 Ln snapshot 1 Local-Global Lexicon (LGL) 1 Location30 1 LongEnough dataset 1 LongEnough 1 Looking Glass dataset 1 Lookout Security & Antivirus samples 1 Los Alamos National Lab's (LANL's) comprehensive cyber-security events dataset 1 Los Alamos National Lab's comprehensive cyber-security events dataset 1 Lucene 1 Lumen Privacy Monitor 1 Lumen database 1 Lumen 1 Lumos5G dataset 1 Lung and Colon Cancer (LC25000) 1 Lyft 1 M-sampled 1 MAIAN scan 1 MALICIA dataset 1 MANRS for Network Operators 1 MANRS 1 MAPP Corpus 1 MASC 1 MATLAB-generated simulation environment 1 MAnycast2 1 MDN Web Docs CSS feature-compatibility data 1 MDN Web Docs CSS feature-compatibility dataset 1 MDN Web Docs 1 METR-LA 1 MHS dataset 1 MIMIC-III 1 MIMIR 1 MIND dataset 1 MIT Places205 1 MIT Reality Mining data 1 MIT67 1 MITRE eCTF team submissions 1 MITRE vulnerability database 1 MME dataset 1 MNBM, FRANK, QAGS, SummEval, FEVER, Vitamin-C 1 MOBIKEY 1 MODIS/Terra daily snow cover and 16-day vegetation datasets 1 MODIS/Terra satellite datasets 1 MOOC 1 MORPH-II 1 MPII 1 MPST dataset 1 MQTBench 1 MS Common Objects in Context (COCO) 1 MS MARCO document and passage collections 1 MS MARCO passage dataset 1 MS MARCO passage ranking benchmark 1 MS1MV3 1 MSAF-32 1 MSAF-Sim 1 MSCOCO and Flickr30k 1 MSCOCO 1 MSDialog 1 MSLR-WEB10K 1 MSMARCO DEV, TREC DL 2019, NQ, and TREC MB 2014 1 MSMARCO DEV 1 MSR-VTT, MSVD, LSMDC, ActivityNet, and DiDeMo 1 MSR-VTT 1 MSRVTT, LSMDC, ActivityNet Captions 1 MSRVTT 1 MSVD 1 MT-Bench and LLMBar 1 MTA published employee payroll record 1 Maass et al. notification study 1 Mahoney enwik8 corpus 1 Major IXP IPFIX traces 1 Major Network Incidents Review 1 MalBeacon Stealers dataset 1 MalBeacon commercial Stealers dataset 1 MalRec dataset 1 Malcert 1 Malicia and Offensive Computing malware repositories 1 Malicia 1 Malpedia, security news websites, and CVEs 1 Malpedia 1 Malware Analysis System, Offensive Computing, and university infrastructure 1 Malware dataset and KDDCUP dataset 1 Malware dataset 1 MalwareBazaar daily feed 1 MalwareDrift dataset 1 Manhattan Highway Crossings, Paris Shops, and Shanghai Bus Stops 1 Mantovani et al. dataset 1 Manycast2 census result 1 Marvin dataset 1 Massachusetts General Hospital (MGH) EEG Data 1 MathOverfow 1 Mathur et al. deceptive pattern dataset 1 MeQSum and CHQ-Summ 1 MeQSum 1 Measuring Broadband America (MBA) 1 Mechanical Turk (prior research studies) 1 Media Cloud 1 Media Frames Corpus (MFC) 1 MediaBias/FactCheck 1 MediaEval Verifying Multimedia Use task 1 Meituan user-service reports 1 Meituan 1 Melo and Martins test set 1 Mempool Guru 1 Mendeley Data Repository 1 Meraki aggregate client data 1 Meraki production network logs 1 Merit Network IPv6 darknet 1 Merit Network darknet 1 Merit ORION 1 Messiq 1 Meta Ad Library API 1 Meta Ad Library 1 MetaTool 1 Metasploit Framework 1 Metropolitan network datasets 1 MiBench 1 Microchip product portfolio 1 Microsoft Bing query log 1 Microsoft Bing's query log 1 Microsoft COCO and ARTS 1 Microsoft COCO dataset 1 Microsoft COCO 1 Microsoft Gaming / GamePass 1 Microsoft Malware Classification Challenge (Big-15) 1 Microsoft Malware Classification Challenge dataset 1 Microsoft Patch Tuesday disclosures 1 Microsoft Visual Studio Marketplace 1 Microsoft Web N-Gram Services 1 Microsoft workplace telemetry dataset 1 Midjourney Discord dataset 1 Milan Social Pulse dataset / Telecom Italia Big Data Challenge 1 Milan Social Pulse dataset 1 Minneapolis Open Data 1 MiraData 1 Mirai Scanner 1 Mirai dataset 1 Mirai-FRGP continuous flow dataset 1 Miramirkhani et al. corpus 1 Mirsky et al. dataset 1 Misra News Category Dataset 1 Mixed_EN and Mixed_CN 1 MoCap 1 MobiPurpose 1 Mobile Century experiment database 1 Mobile Sandbox dataset 1 Mobile telemetry 1 MobileInsight crowd-sourced database 1 MobileInsight platform 1 ModelNet40 1 Mon(IoT)r Dataset 1 Mon(IoT)r dataset 1 Monitor [46] 1 Most common passwords list 1 MotionSense 1 MovieReview, PoliDying, and NYT datasets 1 Movies 1 Mozilla CRLite infrastructure 1 Mozilla Firefox bug database 1 Mozilla Foundation security advisories 1 Mozilla Labs browser-usage dataset 1 Mozilla Labs dataset 1 Mozilla Mercurial repositories 1 Mozilla Public Suffix List 1 Mozilla Test Pilot 1 Mozilla-disclosed CRLs 1 Mozilla-reported browsing-history distribution 1 MsgLogs 1 Mt.Gox 1 MuSiQue, Natural Questions, MultiHop-RAG, and PubMedQA 1 MuSiQue 1 Multi-News 1 Multi-PIE 1 Multi-Target CONAN (MTCo) 1 Multi-Target CONAN and Newsroom datasets 1 MultiHateClip (MHC) 1 MultiHop-RAG 1 Multimedia Automatic Misogyny Identification (MAMI) 1 MyFitnessPal dataset 1 MyFitnessPal 1 MyPageKeeper socware posts 1 MyPageKeeper 1 MySpace list 1 MySpace password set 1 MySpace 1 Myspace leak 1 N ETWORK X publisher accounts 1 NANOG mailing list archives 1 NAS-Bench-301 and four image datasets 1 NASA Connect video collection 1 NASA SEDAC Metropolitan Statistical Areas dataset 1 NASDAQ trading data 1 NASDAQ 1 NCMEC CyberTipline reports 1 NCSOFT-released Lineage game activity logs 1 NCSU and UNSW public IoT datasets 1 NCSU 1 NELA-GT dataset 1 NELA-GT-2018 1 NEP (Next-generation Edge Platform) 1 NETSCOUT 1 NGSIM 1 NH [63] 1 NIST CMVP historical validation list 1 NIST SAMATE Reference Dataset 1 NIST SD09 1 NIST national vulnerability dataset 1 NLDN 1 NOAA Global Climate Observing System Surface Network 1 NOISEX-92 1 NPPES dataset 1 NPS Internet Chatroom Conversations corpus (Release 1.0) 1 NPS Internet Chatroom Conversations corpus 1 NQ 1 NQ-Open 1 NSFW Data Scraper 1 NTCIR-WWW3 1 NTP Pool 1 NTP scan refid fields 1 NTP server logs 1 NUS-48E 1 NYC Health COVID-19 case-count data 1 NYC Taxi and Limousine Commission trip data 1 NYC Taxi and Limousine Commission trip record data 1 NYC Taxi and Limousine Commission 1 NYC taxi data 1 NYC taxi rides dataset 1 NYC taxi trips 1 NYPD Financial Crimes Task Force BOLOs and evidence storage 1 NYTimes 1 Nanosats Database 1 National Indonesia Contraceptive Survey 1987 1 National Vital Statistics System (NVSS) 1 Nations dataset 1 Nationwide Speech Project (NSP) 1 Natural Earth 1 Natural Questions (NQ) 1 Natural Questions, HotpotQA, and MS MARCO 1 Natural 1 NeQuake and THagupit crisis-tweet datasets 1 NeQuake 1 NetBeacon datasets 1 NetEase Youling crowdsourcing platform 1 NetEase 1 Netflix Prize data set and 2010 US Census 1 Netflix Prize data set 1 Netflix Prize dataset 1 Netflix 1 Netlab's Mirai-infected hosts collection 1 Netograph social media dataset 1 Netograph 1 Netresec network trace and sample captures for access network 1 Netresec network trace 1 Netresec publicly available PCAP files 1 Netresec, “Publicly available PCAP files” 1 Netskope malware dataset 1 New Hampshire Elevation 1 New York 2013 Taxi Rides 1 New York City Street Tree Map project and official Amsterdam trees dataset 1 New York City Street Tree Map project 1 New York City Taxi Trip Data (2010-2013) 1 New York City Taxi Trip Data 1 New York Times articles 1 New York Times user-transition dataset 1 New-Hate-Wave dataset 1 News 1 Newsroom dataset 1 NoRobots 1 Node.js benchmark suites 1 Node.js version 16.13.1 source code 1 Nokia Lausanne Data Collection Campaign 1 NorNet Edge infrastructure 1 North American Internet Service Provider 1 North Carolina Voters Registration database 1 Northwestern Memorial Hospital EMR access logs 1 Norton Mobile Security installation dataset, 2017 1 Norton Mobile Security installation dataset, 2018/2019 1 Norton Mobile Security installation dataset 1 Norton antivirus telemetry 1 NortonLifeLock reputation and installation logs 1 NortonLifeLock's mobile security product 1 Nulled database 1 Nulled.io database breach dataset 1 OASST1 and HuaTuo 1 OASST1 1 ODGen repository, Nodest paper, and legacy CVEs 1 ODGen repository, the Nodest paper, and legacy CVEs in 2021 and 2022 1 ODNS clusters 1 OFAC Sanctions List 1 OLTP-Bench 1 ONOS v1.14.0 1 ONYEN single-sign-on system 1 OPV2V 1 ORES topic-model dataset 1 ORION Network Telescope 1 ORION and UCSD network telescopes 1 OS update packages available online (IPSW Downloads) 1 OSSPolice 1 OSVDB 1 OTIDS 1 Oboe 1 Office 365 historical corporate emails 1 Official Stack Overflow Data Dump 1 Ohm et al. malicious JavaScript package collection 1 Omniglot 1 Ookla Open Data Initiative 1 Ookla Speedtest Intelligence dataset 1 Ookla Speedtest Intelligence 1 Ookla crowdsourced RSRP dataset 1 OpTC 1 Open Bandit Dataset 1 Open Directory Project 2008 crawl 1 Open Payments data set from the Centers for Medicare & Medicaid Services (CMS) 1 Open Payments data set 1 Open Posix Test Suite 1 Open Resolver Project and other mismanagement datasets [58] 1 Open Source Vulnerability Database (OSV) 1 Open University Learning Analytics Dataset (OULAD) 1 Open data on human flow in Otemachi, Marunouchi, and Yurakucho area 1 Open-INTEL 1 Open-Wifi.su 1 OpenBMap 1 OpenDigger G-OpenRank results 1 OpenGPS 1 OpenIDEO 1 OpenNet Initiative (ONI) block page corpus 1 OpenPGP server dump 1 OpenReview 1 OpenSNP project 1 OpenSNP raw dump 1 OpenSNP 1 OpenSSL 1 OpenSea and Alchemy NFT APIs 1 OpenSinger 1 OpenStreetMaps user traces 1 OpenWPM 10k Site ID Detection(1) 2016 dataset 1 OpenWPM database and mitigation databases 1 OpenWall Mangled Wordlist 1 OpenWebText and domain-specific fine-tuning corpora 1 OpenWebText 1 OpenXC dataset 1 Opensense Zurich dataset 1 Openwall wordlists collection 1 Opera browser extensions 1 Orange 1 Orca, DeepCC, FCC and HS-DPA 1 Order 1 Org phishing email database and User Session Monitoring System 1 Orion Network Telescope 1 Orlis benchmarks and ATVHunter 1 Orlis benchmarks 1 Oulu-CASIA NIR-VIS dataset 1 Overdorf et al. [25] 1 Overdorf et al. [45] onion service dataset 1 Oxford RobotCar dataset 1 P&Q 1 P1-ARC 1 P4 project bug trackers 1 PA-100K 1 PAMAP2 1 PARSEC 1 PASS dataset 1 PBC 1 PCAP data from working local copy of the SecureDNA system 1 PDF Association PDF corpus 1 PDNS dataset 1 PDNS-Net 1 PEMS-BAY 1 PG-19 / Project Gutenberg 1 PGGAN 1 PGP keydump 1 PGP keyserver dump 1 PGS training data 1 PHEME 1 PHM2017 1 PHP regression tests 1 PHP test suite equipped in the official PHP interpreter repository 1 PIE face database 1 PILE corpus 1 PINGPONG dataset 1 PIQA 1 PKDD dataset 1 PLACES and MIT67 1 PLACES 1 PLCSEC dataset [17] 1 PLCSEC dataset 1 PORTLAND 1 PPA 1 PPCrawl 1 PPGDPR 1 PPI 1 PPTV Web portal sample 1 PPTV server logs 1 PPoNE Enforcement Actions 1 PRONLEX dictionary 1 PROTEINS and D&D 1 PROTEINS 1 PROXY dataset 1 PSID dataset 1 PTMTorrent and HFCommunity 1 PaSa 1 Packet Clearing House (PCH) 1 PanDataset 1 Panchenko et al. webpage traces 1 Panda-70M 1 Panopticlick 1 Papers with Code (PwC) 1 Pascal VOC 1 PassiveDNS1 and QiAnXin PassiveDNS2 1 Pastebin 1 PatchDB 1 PatentClaim 1 Patient 1 PatternFinger 1 PeerRush 1 Penn Treebank (PTB) dataset 1 Penn Treebank (PTB) 1 Pennebaker and King's stream-of-consciousness essays dataset 1 People-flow dataset 1 PersonaChat corpus 1 PersonaChat 1 PersonalReddit 1 Pew Research Center American Trends Panel, Wave 49 1 Pew Research Center American Trends Panel 1 Pew Research Center telephone survey 1 Pheme 1 Phish-A 1 Phish-B 1 PhishIntention's logo dataset 1 PhishPedia 1 PhishStorm, Phishing-Benign, and DGA 1 PhishStorm 1 Phishing-Benign 1 Phishpedia dataset 1 Phishpedia 1 PhoneLab dataset 1 PicAlert dataset 1 Pile 1 PingPong Dataset 1 Places365 1 PlanetLab, PingER, and PerfSONAR 1 Plata database 1 PlusTokenPonzi 1 Pneumonia, Retinal OCT, CT Kidney, and skin disease datasets 1 Podcasts 1 Pokec dataset 1 PoliCheck Dataset 1 PoliCheck test set 1 PolicyLint and IoTProfiler privacy data taxonomies 1 PolicyLint's PrivacyPolicy (PP) Taxonomy 1 Poqemon dataset 1 Porto Alegre IXP routing data 1 Porto Seguro's safe driver prediction data 1 Porto Taxi Trajectory dataset 1 Porto Taxi dataset 1 Portocabs dataset 1 Portuguese municipal meeting minutes 1 Post Millennial 1 Pramanick et.al. [46] (HarMeme) 1 Prep 1 PrimarySchool 1 PrimeVul 1 Princeton Privacy Crawl (PPCrawl) 1 Princeton-Leuven Longitudinal Corpus of Privacy Policies 1 Privacy Illustrated dataset 1 Private-trigger rules with filter code 1 PrivySeal users' installed-app dataset 1 ProPublica COMPAS analysis 1 ProbLink 1 Products-10K 1 Project Gutenberg 1 Promptfoo and Presidio-research 1 Prosper.com 1 Proxy Hunting dataset 1 ProxyBroker 1 PubFig83 1 PubMedQA (PQA) 1 Public Arena dataset 1 Public Dataset from various phishing URL sources 1 Public Dataset 1 Public Git Archive 1 Public census and national statistical datasets 1 Pulse Transit Time PPG Dataset (PTTPPG) 1 PumpOlymp 1 Purchase-50 1 Purchases-100 (P100) 1 PyLingual web service 1 P²IM firmware subjects 1 QALD-9 and QALD-9-plus 1 QALD-9 1 QALD-9-plus 1 QASMBench Benchmark Suite 1 QCEW 1 QEMU CVEs 1 QReCC, TopiOCQA, CAsT-19, and CAsT-20 1 QReCC 1 QUIC dataset 1 QWI, CBP, and imputed CBP public datasets 1 QWI, CBP, and imputed CBP 1 Quack dataset 1 Quora question pairs dataset 1 Quora, Awesome ChatGPT Prompts, and LMSYS-Chat-1M 1 Quova's GeoPoint data 1 RAF-DB 1 RCS files and CVS commit histories 1 REDImadrid academic network 1 RESTORE 1 RFC dataset 1 RFC documents from ietf.org and rfc-editor.org 1 RFC documents, digital libraries, archives, books, and professional publication archives 1 RHMD 1 RIRs Noises dataset 1 RML2016.10a and RML2018.01a 1 RML2016.10a 1 RML2018.01a 1 RNCNIX 1 ROBUST04 1 RPKIViews 1 RPKIviews archive 1 RSRCH-LAB dataset 1 RSSAC-002 1 RSSAC002 datasets 1 RUSTSEC dataset 1 RWCP dataset 1 RWTH Mobnets spectrum measurement dataset 1 RWTH dataset 1 RX-Promotion extracted transactional view 1 RX-Promotion financial metadata 1 Radiocells dataset 1 Rahbarinia et al. P2P traffic dataset 1 RaidForums Massive Database Collection (RMDC) 1 Ramanath et al.'s ACL/COLING 2014 dataset 1 Raschke T.EX dataset [39] 1 ReCon AppVersions dataset 1 ReCon and ReCon extended 1 ReCon dataset 1 ReCon extended dataset 1 ReCon project 1 ReMasc Core dataset 1 Real and Fake Face Detection Challenge 1 RealWorld 1 Recsys2017 1 Redd 1 Reference History dataset 1 Regex101 1 Rekt News, Slowmist, and Cryptosec 1 Renesys BGP-path survey 1 Renesys 1 Renren clickstream dataset 1 Renren operational systems 1 Renren trace 1 ReproDroid 1 Reputation logs 1 Retailrocket 1 Retirement 1 Reverse DNS lookups 1 ReversingLabs 1 Rhode Island pilot audit 1 Rimmer et al. dataset 1 Rimmer's dataset 1 Ripple Data API v2 1 Ripple ledger and public transaction history 1 RmvDroid Dataset 1 RoVista datasets 1 RoVista 1 Robust04 1 RocketFuel 1 Rocketfuel 1 Roongta and Greenstadt [50] site set 1 Root NXD WPAD dataset collected internally by Verisign 1 RustSec Advisory Database 1 SASC 1 SB-Curated and Mini-contracts 1 SC09 1 SEA-HAZEMON 1 SEART-GHS 1 SEO abuse [31] 1 SEO abuse feed [31] 1 SESSION14 1 SET736535 and ABOVE20 1 SET736535, integrated from nine regex datasets 1 SF Uber GPS dataset 1 SHEN13 1 SICK corpus 1 SIFT10K 1 SIGCOMM 2010 network traces 1 SIMET 1 SMS Call Detail Records (CDRs) 1 SMS Spam Collection 1 SNAP 1 SNET pillar portals 1 SNIA IOTTA Repository 1 SNIA traces 1 SNLI 1 SNMPv3 dataset 1 SNMPv3-responsive IPv4-address dataset 1 SNS-based People Flow Data 1 SOLA-DA benchmark 1 SOTorrent 1 SPEC 2006 1 SPEC2000 1 SQL dumps of their underlying databases 1 SQLite test suite 1 SSC 1 SSD 1 SSH2000 1 SSL Pulse 1 SSLA subset of LegalBench 1 SSLMate historical STH archive 1 SST-5 1 ST dataset 1 SV FP reports 1 SV1 ground truth 1 SWDE 1 SaTC dataset 1 SaTML'23 adversarial phishing webpage dataset 1 SafeBench-tiny 1 SafeGraph POI visitation data 1 SafeGraph mobility data 1 SafeGraph platform 1 Safecast dataset 1 Sample captures for access network 1 Samsung firmware releases 1 San Francisco Cab network dataset [34] 1 San Francisco Employee Compensation (SFC) 1 San Francisco Employee Compensation and Tax Stats (Income) 1 San Francisco Fire Department Calls for Service 1 Sandnet 1 Scam-Baiting Conversation (SBC) 1 ScamAdviser commercial feed 1 ScamAdviser 1 ScamDigger 1 ScamGuard 1 ScamSniffer - Web3 Scam Database 1 Scamper 1 ScanNet 1 Schubert Winterreise dataset 1 Science Feedback 1 SecBench.js 1 SecLists 1 Seclists.org security mailing list archive 1 Securify public interface 1 Security Behavior Observatory (SBO) 1 Self-Instruct 1 SemEval 2010 Task 8 1 SemEval ABSA benchmark datasets 1 SemEval Task 14 Benchmark dataset 1 SemEval discriminative attributes dataset 1 SemEval, AllSides-S, AllSides-L, Allsides.com, and U.S. political community posts 1 SemEval 1 SemMedDB 1 SemanticKITTI dataset 1 Semrush 1 SensiReplaced 1 Shadow-generated congestion traces 1 Shadowserver Foundation sandbox feed 1 Shadowserver's daily report 1 ShapeShift 1 Sharma et al. [78] publicly reported vulnerabilities 1 Sharma et al. [78] 1 Shopping scams 1 Shopsy 1 Shumei 1 Sightglass 1 Sigma Main Rule Repository 1 Sigma repository 1 Silent-Spring dataset 1 SimpleGeo database 1 Simulacra Aesthetic Captions (SAC) 1 Simulacra Aesthetic Captions 1 Singanamalla et al. government website dataset 1 Singapore taxi dataset 1 Sirinam et al. [32] 1 Sirinam et al. [6] dataset 1 Sirinam et al. dataset 1 Sirinam's dataset DS95 [5] 1 Sirinam's dataset DS95 1 Sites extracted from ACVL 1 SkillExplorer dataset from US marketplace 1 SkinCancer 1 SkinCon 1 Slowmist, Rekt News, ChainSec, and academic SoK papers 1 Slush 1 SmallBlue 1 Smallblue 1 Smart-bugs 1 SmartAppZoo dataset 1 SmartBugs Curated 1 SmartBugs Wild Dataset and public audit repositories 1 SmartBugs Wild Dataset 1 SmartBugs 1 SmartHomeBench 1 SmartInv benchmark and smart-contract CVEs 1 SmartThings Public 1 SmartThingsCommunity/SmartThingsPublic 1 Snapshot voting platform 1 SoK paper by Stafeev and Pellegrino 1 Social Blade 1 Sogou image search search log 1 Sogou pinyin input dictionaries 1 Sokoto Coventry Fingerprint Dataset (SOCOFing) 1 Sonar Forward DNS 1 Sorio et al. [46] 1 SorryBench 1 Soska and Christin [35] dataset 1 Soska and Christin dataset 1 Sougou NewsFeed logs 1 Sougou NewsFeed 1 Spam SMS 1 SpamIt back-end database 1 Speech Command 1 SpeechAccent 1 Speedchecker 1 Splunk Security Content 1 Spoofer Project 1 SpotLake 1 Spotify historical online experiments 1 Spotify 1 Stack Exchange Data Dump and Medium sitemap 1 Stack Exchange Data dump 1 Stack Exchange dataset 1 Stack Overflow Temporal Network 1 Stack Overflow 1 StackExchange archive site 1 Stanford Deliberative Democracy Lab 1 Stanford Dogs dataset 1 Stanford Large Network Dataset Collection and other sources 1 Stanford Sentiment Treebank v2 1 Stanford dog dataset 1 Stanford's SNAP dataset (foods) 1 Stanford's SNAP dataset (movies) 1 Stanford-Cars 1 State Grid Zhejiang Power Supply Co. Ltd. and Weather Radar 1 Static Wikidata graph 1 Street View Text (SVT) dataset 1 StrongReject, HellaSwag, BoolQ, ARC Easy, and other benchmark datasets 1 StrongReject 1 Students Performance (Students) 1 Study candidate generation and ownership analysis 1 StumbleUpon user-session dataset 1 StyleGAN 1 StyleGAN2 and synthetic face datasets 1 Sub-URMP 1 Subjective Databases 1 Sui Explorer 1 Supermarket expenditure dataset 1 Survey recruitment and data collection 1 SynthPAI 1 Synthea synthetic data 1 Synthetic, MoCap, ActRecTut, PAMAP2, UscHad, and UcrSeg 1 Synthetic 1 Sysomos MAP 1 Syverson et al.'s live Tor dataset 1 T-Drive 1 TACRED 1 TAFENG 1 TAIR query log 1 TAP dataset 1 TAQ data 1 TC-IQI dataset collected by [43] 1 TC-IQI dataset 1 TChecker 1 TED-LIUM 1 TEXBAT 1 TFLite and ncnn open-source commit histories 1 THCHS-30 1 THU-KDD19 1 THUIR1 1 THagupit 1 TIDIGITS corpus dataset 1 TIDIGITS speech corpus 1 TIDIGITS 1 TLD Authority 1 TLS-Docker-Library 1 TMWFset 1 TON_IoT (TON) 1 TOR-Exit dataset 1 TPC-H benchmark 1 TREC DL 2019 1 TREC Deep Learning 2019 and 2020 tracks 1 TREC Incident Streams 2021 training data 1 TREC MB 2014 1 TREC Web Track 2009 1 TREC Web Track 2009-2012 1 TREC-8 and TREC-2001 Question Answering Tracks 1 TREC-COVID and HealthCareMagic-100k-en 1 TREC-COVID 1 TRUE benchmark datasets 1 TUDataset and PyTorch Geometric 1 TUH EEG Data 1 TUM-Crypto 1 TV-Fool spectrum availability information 1 TWOS 1 Ta-feng 1 TabFormer, CreditCard, and IEEE-CIS 1 TabFormer 1 Table VI 1 Tacyt 1 TaoBao transaction data 1 Taobao display advertisement click-through rate prediction dataset 1 Taobao user search logs 1 Tatar et al. flip database 1 Tatar et al. public database of bit flips 1 Tax Stats (Income) 1 Taxi Beijing dataset 1 Taxi and Retirement datasets 1 Taxi 1 TeleGeography public submarine cable dataset 1 Telecomix leaked Blue Coat SG-9000 proxy logs 1 Telecomix 1 Telegeography 1 Telegram Export chat history API 1 Tencent Kandian Dataset 1 Tencent Map Service 1 Tencent QQ 1 Tencent advertisement platform 1 Tencent click-through rate prediction data 1 Tennessee Eastman process simulator 1 TensorFlow v2.15.0 source code 1 Tesla Model S firmware 1 Test262 and four major JavaScript engine repositories 1 Test262 and the ChakraCore, JavaScriptCore, SpiderMonkey, and V8 repositories 1 Texas Department of State Health Services Discharge Data 1 Texas Department of State Health Services 1 Texas PUDF data 1 Texas PUDF 1 Texas 1 Text Anonymization Benchmark (TAB), European Court of Human Rights cases 1 Text Anonymization Benchmark (TAB) 1 The New York Times annotated corpus 1 The Real Yellow Pages 1 The Scam Directory 1 The Stack 1 The Usable Privacy Policy Explore Website 1 Thyroid 1 Tian et al. study 1 TianGong-Qref, THUIR1, THU-KDD19, and NTCIR-WWW3 1 TianGong-Qref 1 Tianchi Taobao display advertisement click-through rate prediction dataset 1 Tier 1 network operator 1 Tier-1 ISP and large IXP traffic flow samples 1 TikTok, Champ, UBC Fashion, and TED Talks datasets 1 Tinghy.org 1 ToolBench 1 Top 500 1 TopiOCQA 1 Topology Zoo 1 TopologyZoo 1 Tor HS dataset 1 Tor consensuses 1 Tor network 1 Tor's blog and bug tracker 1 Tor-Obfuscation 1 TorNetTools-generated network 1 Torres et al. labeled honeypot dataset 1 Torres et al. wallet dataset 1 Trace1 1 TrackThis 1 Tracks 1 Trader Joe decentralized exchange dataset 1 Train trips dataset 1 Transport and Public Works Committee and Transurban statistics 1 Transport and Public Works Committee 1 Transport for London Oyster card trips 1 Transurban 1 TripAdvisor reviews 1 TripAdvisor 1 TriviaQA 1 Triviaqa 1 TrojAI rounds 2 and 3 1 Trust statement dataset 1 Tuenti daily active users graph 1 Tularosa Study analyzed subset 1 Tularosa Study 1 Turing 1 Tweets(Ghosh) 1 Tweets(Riloff) 1 TwinBreak 1 Twitch 1 Twitter15, Twitter16, and PHEME 1 Twitter15, Twitter16, and Pheme 1 TxPhishScope 1 U SC H UNT's dataset 1 U.S. 1990 Census Sample 1 U.S. Census PPMF 1 U.S. Department of Education EDFacts Data Files 1 U.S. Department of Education's Common Core of Data 1 U.S. Department of Justice press releases and PACER court documents 1 U.S. Space Surveillance Network (SSN) / space-track.org 1 U.S. Space Surveillance Network (SSN) at space-track.org 1 U.S.-based social network 1 UCB anonymized 2FA logs 1 UCB six-month 2FA login data for remembrance simulation 1 UCF-101 and 20BN-JESTER 1 UCF-101 1 UCSD Health and Proofpoint campaign records 1 UCSD Telescope data 1 UCSD-NT historical traces 1 UCSD-NT 1 UFC101 1 UGR16 1 UIUC anonymized 2FA logs 1 UK Data Archive 1 UK Metropolitan Police 1 UK Office of National Statistics 1 UK-LEX 1 UKBench and Holidays 1 UKBench 1 UMDAA-02 Touch Dataset 1 UMICH data set [9] 1 UMLS dataset 1 UNB Simulated Office-Space Traffic Dataset 1 UNIFUZZ 1 UNIV1 and P1-ARC traces 1 UNIV1 1 UNSW Dataset 1 UNSW IoT Analytics 1 UNSW Smart Home Traffic Dataset 1 UNSW 1 URLScan 1 US Census (1990) dataset 1 US Census Database; Canada Federal Census Tract in Alberta 1 US Census Income Dataset 1 US Census 1 US Social Security Administration 1 USA Census data repository 1 USC Internet surveys 1 USC/ISI ANT Datasets 1 USTC-TFC2016 dataset 1 USTC-TFC2016, ISCXTor2016, IDS2017&2018, and CrossNet2021 1 UTD-MHAD 1 UTKFace 1 Ubuntu 12.04 official software repositories 1 Ubuntu 16.04 LTS package collection 1 Ubuntu Desktop 16.04 1 Ubuntu Dialog Corpus (UDC) 1 Ubuntu Linux 18.04 software repositories 1 UcrSeg 1 UltraChat 1 UniBench 1 Unicorn Wget dataset 1 Union dataset 1 Uniqpass v11 1 United States General Services Administration 1 Universities worldwide 1 University of Michigan HTTPS Ecosystem Scans 1 University of Michigan's IPv4 scans 1 UnsafeBench annotated dataset 1 UnsafeDiff 1 UpbitHack 1 Ur et al. [31] 1 UscHad 1 VAST Challenge 2011, Mini Challenge 2 - Computer Networking Operations 1 VAST Challenge 2011 1 VBCDE and UnsafeDiff 1 VBCDE 1 VGG Flowers 1 VGG-Face 1 VISPR dataset 1 VNAT dataset 1 VR video 1 VS dataset 1 VUPEN Security Vulnerability Notification Service 1 VWBENCH 1 VX Heaven 1 VX-heavens collection 1 Van Wegberg et al. [24] parsed and analyzed data set 1 Vassio et al. TCP dataset 1 Venmo transaction data 1 VeriSign .com and .net TLD query data 1 Verisign DNZA data 1 Verisign DNZA files 1 Verisign root NXD WPAD dataset 1 ViaBTC, BTC.com, Slush, CoinWarz, and CoinDance 1 Victim spam reports 1 Vicuna benchmark 1 Vimeo-90K 1 Vimeo90K, UCF-101, Edinburgh DataShare, European Parliament proceedings, and audio-visual event dataset 1 Vimeo90K 1 Vine 1 VirtualTB 1 VirusSign 1 Visual Object Classes Challenge 2012 1 VizWiz dataset 1 Vogue US 1 Vosoughi et al. [29] dataset 1 Voxforge 1 Vuln-code DB 1 Vulnerability History Project 1 WAGO PFC firmware releases 1 WCET benchmark suite 1 WDVC-2016-Links 1 WHOIS database 1 WHOIS databases 1 WHOIS datasets and bulk WHOIS services 1 WHOIS history data 1 WIDE Project / AS 2500 anonymized network trace 1 WIDE Project anonymized network trace 1 WIDE backbone traffic traces 1 WIDER dataset 1 WVU dataset 1 Wagner's corpus 1 Wall Street Journal (WSJ) dataset 1 Walmart supply chain data 1 Walsh et al. [62] Vimeo streaming-traffic dataset 1 Walsh et al. [62] Vimeo streaming-traffic datasets 1 Wang and Goldberg data set 1 Wang et al. [116] 1 Wang et al. [77] and RmvDroid [2, 78] 1 Wang et al. data set 1 Wang et al.'s data set 1 Wang100 1 Wang9000 1 Warford et al. [148] open dataset 1 Warningbird feed 1 Wasabi Wallet 1 Water Quality Portal 1 Waterloo SPARQL Diversity Benchmark, DBpedia v.2015A, and LSQ query log 1 WaveFake and LibriSeVoc 1 WaveFake 1 WeChat Dataset 1 WeChat mini-programs 1 WeChat registration datasets 1 WeChat third-party miniapps 1 WeChat 1 WeHe data 1 WearBench dataset 1 Weaver & McKee [33] 1 Web Data Commons Microdata corpus 1 Web Historian 1 Web Platform Tests (WPT) 1 Web Spam Challenge 2007 data, sample 1 Web Spam Challenge 2007 data 1 Web page 1 WebCensus 1 WebCode2M test datasets 1 WebCode2M 1 WebKB dataset 1 WebMall benchmark 1 WebPageDump 1 WebSight and WebCode2M 1 WebSight v0.1 1 WebVid-10M 1 WebVoyager 1 Webis-Sentences-17 1 Weeplaces 1 Wepawet online service submissions 1 Wepawet service submissions 1 Wepawet service user submissions 1 Wepawet's database 1 Weplan Analytics 1 Westlaw 1 WhatIsMyIPAddress.com data 1 WhatIsMyIPAddress.com logs 1 Whisper datasets 1 Who Targets Me (WTM) 1 Who-TracksMe 1 WhoisXML 1 WiFi geolocation databases and APIs 1 WikiArt 1 WikiDump 1 WikiLens 1 WikiMIA and MIMIR 1 WikiMIA 1 WikiMovies 1 WikiQA 1 WikiTables 1 Wikidata Vandalism Corpus 2016 (WDVC-2016) 1 Wikidata query logs 1 Wikimedia REST AQS endpoints 1 Wikimedia dumps 1 Wikimedia pageview statistics 1 Wikispeedia 1 Wildfire Hazard Potential 1 Wilds Civil Comments 1 Windows Live ID sign-up trace 1 Winkel sales data 1 Winkel 1 Winter et al.'s DeFi dataset 1 Wishbone 1 Woo et al. [35] 1 World Bank 1 World Data Center for Geomagnetism, Kyoto — Dst Index 1 World Development Indicators 1 World Uyghur Congress dataset 1 WorldPop 1 Worldpop 1 X Community Notes dataset and Social Blade 1 X Community Notes dataset 1 XBlock (D1) 1 XBlock (D2) 1 XBlock (D3) 1 XBlock 1 XBlockEOS 1 XING Recsys Challenge 2016 dataset 1 XNU source code and XNU-6153.11.26 kernel cache 1 XRay datasets 1 Xiaodun 1 Xilinx Model Zoo 1 XueTangX 1 YAIR-LOG and YAIR-SYN 1 YAIR-TRAINING and YAIR-HUMANVAL 1 YJMob100K 1 Yahoo dataset 1 Yahoo development and test query logs 1 Yahoo query dataset 1 Yahoo query logs 1 Yahoo search logs 1 Yahoo search query logs 1 Yahoo user-transition dataset 1 Yahoo! Answers (Beauty & Style) 1 Yahoo! Answers (Health) 1 Yahoo! Answers (Pets) 1 Yahoo! Answers 1 Yahoo! OMG feed 1 Yahoo! SERP MouseTrack dataset 1 Yahoo! Voices breach data set 1 Yahoo! Voices dataset 1 Yahoo! Web Search query logs 1 Yahoo! password frequency corpus and previously released password-breach datasets 1 Yahoo! password frequency corpus 1 Yahoo! search traffic 1 Yahoo! 1 Yahoo!Answers 1 Yahoo 1 Yelp2018 1 Yext.com 1 YourThings Dataset 1 YourThings IoTFinder 1 YourThings Smart Home Traffic Dataset 1 YourThings, HomeSnitch, PingPong, Mon(IoT)r, UNSW, and Our datasets 1 ZA DNS telemetry 1 ZEUS real-world contract dataset 1 ZIZA dataset 1 ZKAP dataset and newly collected project circuits 1 ZMap ICMP Echo Request scan dataset 1 ZMap ICMP scans 1 ZMap Vulnerable Hosts 1 ZMap scans 1 ZMap's HTTPS survey database 1 Zannettou et al. [24] 1 Zap-Map 1 Zapret 1 Zhang et al. CRL dataset 1 Zhang et al. Heartbleed dataset 1 Zhang et al. Heartbleed datasets 1 Zhihu 1 Zhou and Gao dataset 1 Zigbee Cluster Specification 1 Zimbio.com 1 Ziza et al. DNS exfiltration dataset 1 Zone-H 1 Zoom API (Organization-wide API data) 1 [17] empirically validated domain pairs 1 [19], [32] 1 [32] 1 [5, 10, 18, 26] 1 a data-set of GPS traces of Uber black cars rides in San Francisco [32] 1 a user study conducted by researchers at the University of Massachusetts 1 academic and industry literature, guidelines, tool documentation, and CWE 1 access control matrices from three real organizations 1 active scans [40] 1 actual vehicle CAN trace 1 ad-network click logs 1 aggregate dataset shared with us by email-security-scans.org 1 aggregated HTTPS scan data 1 aggregated logs of WWW server activity 1 all available mainline web-application releases 1 all-the-package-repos 1 amiunique.org browser fingerprint dataset 1 amiunique.org 1 analyzed subset of curated MMMapp dataset 1 annotated news article pairs 1 anonymized Call Detail Records (CDR) for district Jhelum from one of the largest cellular operators in Pakistan 1 anonymized Call Detail Records (CDR) 1 anonymized browsing history traces 1 anonymized campus network traces 1 anonymized dataset from Ava 1 anonymized event logs and unpublished performance data from a prior comparative study 1 anonymized fitness tracker data of the co-authors 1 anonymized student assignment submissions 1 anonymous CA production logs 1 anonymous CA's production deployment logs 1 anonymous cooperating platform 1 anti-virus vendor telemetry program 1 antivirus company 1 archive.org/details/stackexchange 1 archived LBNL Telnet/Rlogin PCAP 1 archived Linux kernel UAF vulnerabilities 1 archived web event data 1 attack data compiled from comprehensive sources [4, 11, 12] 1 audience measurement provider's tracking database 1 audio dataset used by MILLIEAR 1 audio-visual event dataset 1 author-provided or public online datasets 1 authors of CRUSH 1 authors' athlete datasets 1 authors' collected app and library repository 1 authors' collected real-world IoT dataset 1 authors' longitudinal Zoom Marketplace dataset 1 baseline dataset, simulated two-to-one construction 1 bdrmap traceroute datasets 1 benchmark dataset from prior works 1 benchmark published by [42] 1 benign versions from crawled websites 1 binary file appearance logs and AV/IPS telemetry 1 blockchair.com 1 botnet C&C server database 1 breach data used in prior work 1 campus DNS trace 1 captured real-vehicle traffic replayed in the testbed 1 ccTLD registries' registration, DNS, and HTTP datasets 1 cellular operator dataset 1 censorship dataset published by Jin et al. 1 certificate data collected in [9] 1 circomlib, DarkForest, and ECDSA benchmark circuits 1 circuit dataset created from Syverson et al.'s live Tor dataset 1 city surveillance system and GPS sensors 1 city surveillance system 1 click dataset from a major Chinese search engine company 1 cluster trace dataset [18] 1 clusterdata-2019 1 code_instructions_120k_alpaca 1 coinbase transactions 1 collaborating mobile network operator's firewall feed 1 collected WebAssembly modules 1 collection built by Wen et al. [59] 1 collection of fitness firmware [52] 1 comScore Web Behavior Database 1 comScore search logs 1 combined FirmSolo and Greenhouse dataset 1 combined GPTStore.ai/OpenAI and BeeTrove dataset 1 combined TriviaQA, WikiMovies, and WebQuestions corpus 1 combined unsafe prompt datasets 1 comma2k19 1 commercial CDN access logs collected in Tokyo 1 commercial IP threat intelligence system 1 commercial and open threat-intelligence feeds 1 commercial anti-malware vendor 1 commercial platform datasets [51], [52] 1 commercial prompt markets including AIFrog and PromptBase 1 commercial web hosting company nightly backups 1 common vulnerability databases, vendor-specific security bulletins, and software bug databases 1 comparison dataset constructed from prior studies and GPTAid-detected bugs 1 compiled scam address sources 1 complete publicly leaked database dumps 1 comprehensive sources [4, 11, 12] 1 compromised image hosting server 1 conference websites and collected conference-paper corpus 1 confidential QCEW dataset 1 confirmed hijacker ASNs 1 consolidate.js repository and manually curated gadget sources 1 consolidate.js repository 1 contagio dump 1 continuous Internet-wide crawl of public URLs 1 coreutils test suite 1 country-diverted A/B test 1 crates.io 1 crawled data provided by the authors of AutoCog 1 credit 1 cross-platform dataset and official app stores 1 curated list of SGX-based blockchains and an SoK 1 current Chainalysis attribution snapshots 1 customly collected Java security patches 1 dAPTaset 1 daily historical search logs 1 daily sampled Bitswap CIDs 1 daily top-list archives 1 darknet marketplace archives and other research projects 1 darknet marketplace archives programs and other research projects 1 data collected from [8] 1 data feed obtained from an antivirus company 1 data provided in [8] 1 data set of download events collected by Kwon et al. 1 data set of download events, collected by Kwon et al. [26] 1 data sources in [14], [41], [52], [54], [72], [75], [78] 1 data used in [29] 1 database [13] 1 database of automatically parsed vendor repair emails 1 database of over 500,000 real-world regexes coming from an Internet-wide analysis of regexes collected from over 190,000 software projects 1 dataset [72] 1 dataset by Ferrarello et al. [13] 1 dataset collected as part of an x86 benchmarking suite for the x86 ISA [31] 1 dataset collected by Allan et al. [23] 1 dataset collected by a previous study 1 dataset collected in [45] 1 dataset consisting of 39585 prompts 1 dataset distributed by Bordes et al. 1 dataset distributed by Nickel et al. 1 dataset from SyzGen 1 dataset from [26] 1 dataset from [57] 1 dataset from a popular MOBA game, released by a well-known game company 1 dataset made available by Herrman et al. 1 dataset made available by Penn. State's SIIS lab 1 dataset obtained from authors of [5] 1 dataset of 208 bot programs available as source code 1 dataset of WO responses by Maass et al. [26] 1 dataset of emails collected by Englehardt et al. 1 dataset produced by Rahbarinia et al. 1 dataset proposed by Wei et al. 1 dataset provided by CISCO, coming from a Meraki location analytics plateform 1 dataset provided by Ferrarello et al. [13] 1 dataset published by [18] 1 dataset released by Wang et al. [57] 1 dataset similar to [35], based on pqm4 1 dataset used in [30] 1 dataset used in a recent study [81] 1 datasets from POWER, CarpetFuzz, and ConfigFuzz 1 datasets from six academic papers 1 datasets provided by Tang et al. [16] and Ye et al. [23] 1 datasets with traces collected from real-world UEs [31], [22] 1 derived from collected custom ROMs 1 desktop dataset (from [51]) 1 device privacy policies identified in the availability analysis 1 distribution feeder specification 1 domain registration records 1 donated peers files 1 downloaded stock ROMs 1 dynamic traffic analysis dataset [116] 1 e-commerce retailer product data 1 eDarkTrends 1 eICU 1 eRISK 1 edX 1 eight cryptocurrency blockchains downloaded from full nodes 1 email complaints from exit relay operators 1 email-security-scans.org 1 enterprise classification 1 enterprise network logs 1 enterprise-managed hosts for which a primary user can be identified 1 entscheidsuche.ch 1 epileptic 1 established malicious-package datasets and sampled benign packages 1 ethernodes.org 1 evaluated shared libraries 1 evaluation set of deepfake detectors [35, 38, 57] 1 example query list used for testing DNS server performance 1 existing dataset introduced by Karisani and Agichtein 1 existing real-world firmware image dataset 1 extended Yale Face database B 1 extracted firmware filesystems 1 extracted firmware images 1 fiber-to-the-home network in Cleveland, Ohio 1 field study 1 filter-list repositories and mirrors 1 filtered dual-stack websites 1 filtered result of our dataset 1 final curated dataset 1 final filtered dataset 1 final ransomware incident dataset 1 fingerprint.pet-portal.eu 1 firmware images collected by previous research 1 firmware images collected in the empirical study 1 firmware images 1 five human preference datasets 1 five large-scale real-world binary classification datasets 1 five live feeds of phishing and malware-hosting sites 1 five open-source software projects at specified commits 1 five production legal repositories 1 five recent studies [37, 41, 46, 65, 68] 1 four academic databases 1 four large European ISPs 1 four mainstream AI-company privacy policies 1 four open threat-intelligence feeds 1 four popular eye-tracking datasets 1 four publicly available recommendation datasets 1 four real-world datasets 1 four security-conference dataset 1 four selected PHP web applications and their versions 1 four transportation systems in Shenzhen 1 free and open-source PHP applications 1 free mail domains list 1 general elections committee 1 genuine application source 1 global BGP routing table 1 global financial company login dataset 1 google-10000-english 1 gpu-rodinia 1 ground truth data set employed by Cui et al. 1 ground truth list of leasing brokers 1 ground-truth datasets 1 gureKDD 1 healthskouts 1 held-out test split of the dataset 1 hidden-intermediary client websites 1 historical Stanford deliberation data 1 historical Tor network data 1 historical WHOIS data 1 historical WHOIS dataset 1 historical XLDH library versions 1 historical arbitrage transactions 1 historical corporate email dataset 1 historical dataset of Scheitle et al. 1 historical on-chain Tornado Cash transactions 1 historical scans obtained from the authors of [32] 1 historical versions of four filter lists 1 honeypot database 1 honeypot network emulating protocols vulnerable to reflected UDP attacks 1 honeypot network 1 hotel review corpus 1 http://artinvoice.hu/spams/ 1 http://untroubled.org/spam/ 1 human judgments on query-question pairs 1 iBench 1 iCliniq 1 iTunes reviews 1 implementation provided by [33] 1 in-the-wild prompt dataset described in [45] 1 in-the-wild prompt dataset 1 incident dataset 1 incident reports 1 independent research group dataset 1 individual service breaches and breach compilations 1 inflection list; simple dictionary; free Openwall list; paid Openwall list 1 initial weekly scan 1 internal Pinterest dataset 1 internal cloud dataset 1 internal cloud traces 1 internet_address_hitlist_it88w-20191127 1 inventory records, device configuration snapshots, and trouble ticket logs 1 ioXt certified-app list and Jin et al.'s 37k mobile-IoT-app dataset 1 ionosphere 1 is-bgp-safe-yet 1 java-user mailing list from the lucene project 1 k-NNset 1 kernel source trees and publicly released vulnerability PoCs 1 kernel source-code releases and FreeBSD master branch 1 known EEH bug dataset 1 known malicious applications 1 known malware repositories 1 known vulnerabilities derived by the authors’ 2013 methodology 1 kuaiRec 1 lab dataset 1 labeled dataset obtained from the AV company 1 large Central European ISP 1 large ISP in the United States 1 large ISP network 1 large anti-virus vendor's browser security product dataset 1 large anti-virus vendor's browser security product users 1 large mobile operator 1 large webmail provider 1 large, undisclosed livestreaming corporation 1 large-scale online platform logs and Goodreads public dataset 1 large-scale traceroute dataset 1 large-scale web malware detection system 1 last.fm 1 latest Linux stable version v5.10 with defconfig 1 latest vendor firmware 1 law enforcement observations from Gnutella p2p network 1 law enforcement observations from eMule p2p network 1 law-enforcement seizures 1 law-enforcement wiretap packet captures 1 leading cybersecurity company 1 leaked database 1 legally seized MaxiDed backend database 1 lmbench 1 longitudinal database of BSSID geolocations 1 mailsac.com email dataset 1 mailsac.com 1 main network operator in Spain traces 1 major European ISP 1 major IXPs and ISPs 1 major mobile network operator traffic dataset 1 major network operator 1 major web search engine query set 1 malicious JavaScript dataset 1 malware database 1 malware feed 1 malware repositories and intelligence feeds 1 manually curated dataset made available by Li et al. 1 manually curated giveaway scam dataset 1 measurement host DNS and HTTP logs 1 measurement studies of censors 1 meek Tor Browser traffic trace 1 meek usage statistics 1 merged L F WC and G REENHOUSE datasets 1 method presented in [15] 1 miniImageNet 1 mismanagement datasets 1 mnm.social 1 mobile app activity log 1 mobile application dataset 1 mobile application markets and malware datasets 1 mobile dataset (from [52]) 1 moderncrypto.org-public forums 1 monthly public dataset 1 multi-event bikeshare datasets 1 multiple whitehat mailing lists 1 myPersonality Dataset 1 network trace of HTTP connections captured on the border links of UNC-Chapel Hill 1 network traces collected and used in previous works 1 newly released single-tab dataset 1 nine PII-associated password datasets 1 nine different Service Providers 1 official Chrome extension directory 1 official OEM security-update sources 1 official Polygon zkEVM ROM implementation (fork.5) 1 official WASM test suite 1 official Wasm standard tests 1 official client source code and online documentation 1 official election videos and published artifacts 1 official provider datasets 1 official trees dataset from the municipality of Amsterdam 1 omniglot 1 on-chain attack transactions dataset from current research 1 one of the top ad networks 1 one-week raw event traces collected from the testbeds 1 onion service list offered by ahmia.fi 1 online exploit databases, exploit frameworks, and repositories 1 online payment enterprise transactions 1 open dataset [47] 1 open dataset of web browser attributes 1 open-source Android ROM source trees 1 open-source DP library code snapshots 1 open-source VRC benchmark 1 open-source cryptomining datasets [24], [23] 1 open-source datasets provided by Ahmed et al. [3] — Google Assistant 1 open-source datasets provided by Ahmed et al. [3] — Siri 1 open-source datasets provided by Ahmed et al. [3] 1 open-source normal cryptomining datasets [24], [23] 1 open-source project source code 1 operational water distribution plant in Sweden 1 operator's list of M2M approved devices 1 organization's ticketing system 1 original Contagio database 1 original training datasets 1 other applied machine learning studies 1 other researchers' datasets 1 our display advertising system 1 our honeypot 1 our honeypots 1 out-of-band hidden-service address collection method 1 padded timing data [30] 1 papers of SaTC and KARONTE 1 papers published at seven selected conferences 1 partial forum scrapes 1 partnering company reports and CISA #StopRansomware reports 1 passive TLS monitors 1 passive WHOIS dataset 1 password datasets analyzed by Wang and Wang [11] 1 password reuse datasets 1 password-lists and username-lists 1 pastebin.com, 4chan.org and 8ch.net 1 phishing email database provided by Org 1 phishunt.io and Cisco phishing-kit datasets 1 phpBB leak 1 phs001039.v1.p1 dbGAP dataset 1 pkg.go.dev 1 platform-level statistics from literature 1 plugin marketplaces 1 polblogs 1 post-attack forensics 1 pre-existing dataset from previous work 1 pre-existing set of 2000 social media clusters 1 pre-processed Supreme Court transcript dataset 1 previous RV fuzzing research papers 1 previous academic work [45] 1 previous academic work [55] 1 previous breach compilation [21] 1 previous crawl of the market 1 previous measurement study [9] 1 previous research [22], [29], [33], [43] 1 previous-work corpus of SUSS links 1 previously collected in [26] 1 previously published password datasets and online studies 1 prior Bitswap traces 1 prior authentication research by Woo et al. [35] 1 prior comparative study 1 prior firmware benchmarks 1 prior firmware fuzzing studies and newly added firmware binaries 1 prior study [13] 1 prior-work cloud-provider traceroute dataset 1 prior-work vulnerability evaluations 1 prior-work webpage snapshots 1 privacy policies dataset from Linden et al. 1 privacy-preserving TikTok data donation dataset 1 private CDN BGP dataset 1 private CDR dataset shared by Flowminder 1 probability-based web panel 1 proceedings of the European Parliament 1 production crawler logs 1 production credit card images 1 provider-collected webmail activity dataset D1 1 public 3D model database 1 public Ascon dataset [48] 1 public CVEs and exploits 1 public DARPA TRACE dataset 1 public EDA issue trackers 1 public LDAP certificate repository and certificate revocation lists 1 public PCAP datasets 1 public and synthetic scam-conversation datasets 1 public audit reports, vulnerability disclosures, and bug trackers 1 public ballot-level data and scanner memory-card datasets 1 public benchmark datasets 1 public dataset [29] 1 public dataset [37] 1 public dataset [41] 1 public dataset from prior work [34] 1 public dataset obtained from [48] 1 public dataset of other works [38] [53] [42] [36] 1 public datasets [27, 28] 1 public datasets [41] and [37] 1 public datasets [5, 10, 18, 26, 32] 1 public datasets and incident reports 1 public datasets and timestamped snapshots 1 public datasets, online captcha generators, and open-sourced captcha generators 1 public email datasets 1 public encrypted-traffic datasets 1 public exploit articles, write-ups, and disclosures 1 public exploit sources 1 public exploits from the Internet 1 public firmware dataset 1 public firmware datasets and DDWRT FTP collection 1 public gateway dataset 1 public internet-wide HTTPS/TLS scans 1 public large-scale NFT dataset [26] 1 public online repositories and physical devices 1 public recursive DNS resolvers 1 public repository [54] 1 public root-store source repositories, Docker images, and update files 1 public search engines, official bug track websites and kernel commit logs 1 public software release archives 1 public sources[32] 1 public stock Android firmware images 1 public technical-report, threat-actor, and news collections 1 public top-list daily snapshots 1 public user profiles and two graph samples 1 public vulnerability datasets from other works 1 public word list 1 publicdns.xyz 1 publicly accessible Internet Routing Registry dumps 1 publicly available Amazon.com product profile data 1 publicly available CRLs 1 publicly available Community Notes ratings 1 publicly available Instagram and Vine session-based datasets 1 publicly available Top 500 traces 1 publicly available WebHA datasets published by [29] 1 publicly available conference datasets and papers 1 publicly available data (Venmo transactions) 1 publicly available data consisting of 1.4 billion tweets related to the COVID-19 pandemic 1 publicly available data sets and models 1 publicly available dataset [49] 1 publicly available dataset from the target paper 1 publicly available datasets from HuggingFace 1 publicly available documentation and prior research 1 publicly available git repositories and bug reports 1 publicly available government and breach datasets 1 publicly available image-search and web-search datasets 1 publicly available keystroke dataset [49] 1 publicly available list of open resolvers 1 publicly available network-packet datasets 1 publicly available password datasets 1 publicly available previous effort 1 publicly available previous efforts 1 publicly available real-world energy consumption datasets 1 publicly available stock Android firmware images 1 publicly available survey responses 1 publicly available unofficial Shortcuts repositories 1 publicly available vendor firmware images 1 publicly available vendor firmware update packages 1 publicly disclosed hacking attacks 1 publicly disclosed research and databases 1 publicly documented historical incidents 1 publicly leaked backend databases and VDO scraped data 1 publicly leaked underground-forum SQL dumps 1 publicly shared gap-item data dump 1 publicly-released e-commerce dataset [24] 1 published IVI CVEs 1 published ROV-adoption measurements 1 published computer science literature 1 published conference papers 1 published employee payroll record 1 published firmware-corpus papers 1 published fuzzing papers from selected security and software-engineering venues 1 published literature 1 published security research papers 1 qanta 1 qbLink 1 real (on-chain) Tornado Cash contract 1 real ISP network traces 1 real application traces 1 real matchmaking gameplay footage 1 real network traffic dataset 1 real online auction fraud detection data set 1 real research cloud OpenStack logs 1 real research cloud dataset 1 real test data provided by [40] and [49] 1 real utility data 1 real world structural datasets 1 real-world GPS traces collected from Section 6 1 real-world GPS traces collected in Section 6 1 real-world IPFS network trace 1 real-world IoT user datasets [28] [16] 1 real-world ad-serving data from our display advertising system 1 real-world crash dumps and vendor malware collection 1 real-world dataset from a top-tier cloud service provider 1 real-world dataset introduced with [34] 1 real-world dataset on processes running on a set of Windows machines 1 real-world dataset published by [42] 1 real-world hateful meme dataset 1 real-world network traces 1 real-world privacy policies downloaded August 2020 1 recent peer-reviewed papers 1 recent submissions to a public malware analysis sandbox 1 recently disclosed JOI vulnerabilities 1 recorded CAN data from a 2010 Toyota Camry 1 released question-answering datasets 1 reported URLs 1 reported by users and open-source websites 1 republished UK media links 1 reshipping scam websites' databases and operational logs 1 residential and mobile proxy datasets 1 resolved target domains 1 retrospective survey responses 1 riswhoisdump 1 routing table dump snapshots (dhist) 1 running-system HTLC contracts 1 sVote 2.1 code and specifications 1 sample of posts from 662 users 1 sanitized password breach compilation 1 sanitized version of a large breach compilation [20] obtained from the authors of [63] 1 scientific and grey literature resources 1 scikit 1 scikit-learn's datasets API 1 scikit-learn 1 scimark2 1 seaphe.org/databases.php 1 search logs for query-click data 1 search logs of a popular search engine 1 search-redirection attacks list from a related measurement project 1 seasonality dataset 1 secrepo.com 1 security enterprise real-world dataset 1 security-company social-network login dataset D2 1 security-conference programs and proceedings 1 security-vendor reputation logs 1 seized company records 1 selected conference papers and benchmark datasets 1 self-oss-instruct-sc2-exec-filter-50k 1 semi-synthetic datasets created from user-conversion covariates 1 semi-synthetic datasets 1 serial hijacker dataset 1 set of 13,500 Android apps from the previous study 1 seven Chinese sites 1 seven English sites 1 seven observatories 1 several wordlists [49-52] 1 similar collection effort from 2016 1 six Pakistani ISP network traces 1 six breached password datasets 1 six datasets with vulnerable contracts 1 six password datasets from Chinese websites 1 six public network-traffic datasets 1 six real-world datasets 1 sixteen widely used benchmark datasets 1 skimdb.npmjs.com dependency list 1 small European telecom operator 1 smart city data 1 smart-home, smart-campus and smart-city abstractions dataset 1 sourced from [22] 1 sources of Section 3.1 1 spam datasets 1 spam emails from [50] 1 spam traps operated by major email providers 1 spam trigger word list 1 spambase 1 specialist bibliographic databases 1 stable open DNS resolvers 1 station coverage maps supplied by TV Fool 1 stats.grok.se 1 survey responses from email operators 1 synthetic corpus developed by the authors of [49] 1 synthetic corpus generated by the method in [15] 1 synthetic dataset generated by researchers [17] 1 synthetic datasets 1 synthetic face dataset [53] 1 synthetic latent Bernoulli model 1 synthetic 1 taxi and bike mobility datasets 1 teEther dataset 1 ten DDoS datasets from seven observatories 1 ten standard benchmark datasets 1 ten standard tasks (Table 1) 1 test subjects used in two close works, namely Ardilla [19] and CraxWeb [16] 1 tests that come with the Python interpreter 1 third-party GPT stores and OpenAI's official GPT store 1 third-party antispam partners 1 third-party application store 1 third-party threat intelligence company datasets 1 third-party threat intelligence company 1 third-party website 1 threat intelligence feeds 1 three annotated news corpora 1 three dynamic malware execution feeds 1 three existing 360-degree video head-movement datasets [22, 48, 89] 1 three existing GDPR privacy-policy datasets 1 three existing datasets of head movement traces for 360◦ videos [22, 48, 89] 1 three major Internet Exchange Points 1 three password datasets from English websites 1 three prior companion-app datasets 1 three prior datasets: Neupane et al., IoTSpotter, and IoTProfiler 1 three public forums 1 three public real-world datasets 1 three technical-report collections: TR#1, TR#2, and TR#3 1 three threat-actor collections: MISP, TA#2, and APTmap 1 tier-2 ISP flow traces 1 tintinweb verified-contract dataset 1 top 4 security-conference proceedings 1 top security venues and citation search 1 top-tier security and systems conference literature 1 topology zoo 1 torch_geometric package 1 traceroutes issued by the authors 1 traffic data provided by our collaborator 1 train-ticket testbed 1 training dataset from [5, 11, 51] 1 transaction volume data 1 transaction waiting-time datasets 1 transparent forwarders 1 twitch dataset [29] 1 two darknets 1 two publicly available WebHA datasets published by [29] 1 two university networks and tens of enterprise network 1 ultra sound relay 1 university password history database and public breach files 1 university standby backup email server 1 unrelated survey corpus 1 uops.info 1 updated WikiMIA 1 updated version of WikiMIA 1 user search logs on the Taobao platform 1 user study conducted by researchers at the University of Massachusetts 1 user telemetry 1 user-conversion dataset 1 van Wegberg et al. [46] dataset 1 vendor Android kernel source trees 1 vendor marketplaces 1 verified RTBF requesters derived from the 283 articles 1 verified blackhole communities identified in [36] 1 versioned open-source software repositories 1 videos from prior physical-adversarial-example papers 1 vulnerability dataset in [18] 1 vulnerability reports and patches 1 web categorization dataset 1 web search 1 web server logs of the social networking site 1 web traces collected from 619 real users 1 web-based platform 1 webmail email-sending dataset T 1 weekly enterprise-to-IP mapping archives 1 wild dataset 1 world's leading online payment enterprise 1 x509-limbo 1 x86 benchmarking suite for the x86 ISA 1 xmpp.net 1 ysoserial repository 1 ysoserial
7. Hand-audit of the residue
A 62.6%-of-strings residue cannot be characterised by a regex, so it was characterised by hand on a deterministic sample: node scripts/ds_residue_sample.mjs 60, a fixed LCG seeded at 20260828 over the sorted residue strings. 60 of 3,192 — a 1.9% sample, classified by one person (Claude) on 2026-08-28. Treat the shares as indicative, not as measurements; a second coder was not available and no agreement was computed.
Where the string alone was ambiguous, the paper's title and venue were read; nothing beyond the title was read, which is a limit of this audit.
| Class | Strings | Share of 60 |
|---|---|---|
| public source, no family | 19 | 31.7% |
| benchmark, out of scope | 18 | 30.0% |
| industry / internal | 10 | 16.7% |
| prior paper's dataset | 9 | 15.0% |
| too vague / not a dataset | 4 | 6.7% |
The classification in full, so the coding can be disputed:
| # | Class | Raw string |
|---|---|---|
| 1 | industry / internal | botnet C&C server database |
| 2 | prior paper's dataset | sourced from [22] |
| 3 | too vague / not a dataset | public encrypted-traffic datasets |
| 4 | benchmark, out of scope | CQ500 dataset |
| 5 | benchmark, out of scope | OLTP-Bench |
| 6 | public source, no family | ethernodes.org |
| 7 | industry / internal | Yahoo search query logs |
| 8 | public source, no family | GeoCov19 |
| 9 | benchmark, out of scope | The New York Times annotated corpus |
| 10 | industry / internal | Chrome user metrics and certificate-error telemetry |
| 11 | prior paper's dataset | certificate data collected in [9] |
| 12 | benchmark, out of scope | Schubert Winterreise dataset |
| 13 | benchmark, out of scope | THagupit |
| 14 | benchmark, out of scope | LSAC |
| 15 | public source, no family | Global-Ping-Statistics project |
| 16 | public source, no family | MDN Web Docs CSS feature-compatibility dataset |
| 17 | benchmark, out of scope | IAC-V2 |
| 18 | too vague / not a dataset | in-the-wild prompt dataset |
| 19 | too vague / not a dataset | six breached password datasets |
| 20 | benchmark, out of scope | BBC news dataset |
| 21 | public source, no family | Milan Social Pulse dataset / Telecom Italia Big Data Challenge |
| 22 | benchmark, out of scope | Aachen impulse response database and MIT IR Survey |
| 23 | industry / internal | GPS sensors equipped by public taxicabs |
| 24 | industry / internal | N ETWORK X publisher accounts |
| 25 | too vague / not a dataset | Google TTS library |
| 26 | public source, no family | Google VTS |
| 27 | public source, no family | GreatSchools |
| 28 | public source, no family | NIST SD09 |
| 29 | industry / internal | BEC-Guard-processed emails |
| 30 | industry / internal | HTTP logs of infected source websites |
| 31 | benchmark, out of scope | scikit-learn's datasets API |
| 32 | benchmark, out of scope | MoCap |
| 33 | prior paper's dataset | collection of fitness firmware [52] |
| 34 | prior paper's dataset | P&Q |
| 35 | benchmark, out of scope | Webis-Sentences-17 |
| 36 | benchmark, out of scope | MetaTool |
| 37 | public source, no family | Chicago Open Data; Minneapolis Open Data; Edmonton E-Scooter Share API |
| 38 | public source, no family | Linux 3.19 source tree |
| 39 | benchmark, out of scope | Smart-bugs |
| 40 | public source, no family | java-user mailing list from the lucene project |
| 41 | public source, no family | QCEW |
| 42 | prior paper's dataset | ERASAN dataset |
| 43 | prior paper's dataset | CRLs for public-facing SSL servers on the Internet |
| 44 | public source, no family | Global Routing Intelligence Platform (GRIP) |
| 45 | public source, no family | PPoNE Enforcement Actions |
| 46 | benchmark, out of scope | Multi-News |
| 47 | public source, no family | Linux kernel v5.12 |
| 48 | benchmark, out of scope | Spam SMS |
| 49 | public source, no family | U.S. Department of Education's Common Core of Data |
| 50 | industry / internal | commercial CDN access logs collected in Tokyo |
| 51 | public source, no family | FCC database of digital TV towers in the United States |
| 52 | prior paper's dataset | sanitized version of a large breach compilation [20] obtained from the authors of [63] |
| 53 | benchmark, out of scope | Indiana University X-ray Data (IU X-ray) dataset |
| 54 | prior paper's dataset | Phish-B |
| 55 | benchmark, out of scope | qanta |
| 56 | industry / internal | dataset from a popular MOBA game, released by a well-known game company |
| 57 | public source, no family | DEF CON Media Server |
| 58 | industry / internal | Bing sampled search query log |
| 59 | public source, no family | Debian archive |
| 60 | prior paper's dataset | Telegram Export chat history API |
What the content page takes from this, and nothing more: INDUSTRY + PRIOR = 19 of 60, so roughly a third of unplaced source strings name data a reader cannot simply download. That is the sentence on the page. It is not “a third of reused datasets are private” — the residue is not the whole name universe, and the families that are placed skew public by construction.
8. Quotes spot-checked
scripts/ds_quotecheck.mjs takes every evidence.quote behind a figure that names a specific dataset family (Censys, Shodan, CAIDA, Certificate Transparency, AndroZoo/app corpora, VirusTotal) plus every existing-dataset tuple whose data is ≥5 years older than its venue year — 439 candidates — and checks a deterministic 40 of them against data/fulltext/<year>/<venue>/<slug>/paper.cols.txt, whitespace collapsed, three ways.
checked 40 tuples (of 439 candidates), seed 20260828 exact (whitespace-collapsed) : 24 located via an 8-word run : 14 located via a 5-word run : 2 NOT located : 0 no paper.cols.txt on disk : 0
None failed. Separately, the four Censys snapshot-statement exemplars in What a snapshot statement looks like were each read in their source paper by hand, in context, to confirm the paper is doing what the page says it is doing — mechanical location is not support. Their extraction records, with the verbatim quotes and the fields the extraction filled, are below (node scripts/ds_exemplars.mjs):
- ds_exemplars-output.txt
### IMC/2018/is-the-web-ready-for-ocsp-must-staple good: producer, product, exact date, size temporal.dataset source=Censys span=2018-04-24..2018-04-24 snapshots=null cadence=null "We use the Censys snapshot of this dataset that was collected on April 24th, 2018" temporal.methodology source=Censys Alexa Top-1M TLS handshake scans span=2016-05..2018-04 snapshots=null cadence=monthly "we obtain the same TLS handshake scans of Alexa Top-1M domains from Censys [9] on a monthly basis going back to May 2016." population.dataset sourceList=Censys n=112841653 listVersion=snapshot collected April 24, 2018 "We use the Censys snapshot of this dataset that was collected on April 24th, 2018, which contains 489,580,002 certificates. ... we focus only on a set of 112,841,653 valid certificates" population.methodology sourceList=Alexa Top-1M certificates and CRL URLs n=1568 listVersion=null "among the unique 1,579 CRLs used by this set, we find that certificates that use 1,568 of the CRLs also support OCSP." population.methodology sourceList=CRLs and Censys certificate dataset n=728261 listVersion=null "From this process, we obtain 728,261 unexpired-and-revoked certificates that cover 1,193 CRLs" ### IMC/2016/towards-better-internet-citizenship-reducing-the-footprint-of-internet-wide-scan good: volume, scan count, window, cadence — spliced with a table in paper.cols.txt temporal.evaluation source=censys.io span=09/2015..03/2016 snapshots=7 cadence=monthly "we simulated TASS and an address-based hitlist approach using monthly snapshots of full IPv4 scans from censys.io [5] for the time period from 09/2015 to 03/2016 (7 snapshots)." population.dataset sourceList=censys.io data set n=28 listVersion=null "For our evaluation of TASS we use 4.1 TB of data derived from 28 full IPv4 scans obtained from censys.io [5]." ### USENIX/2017/measuring-https-adoption-on-the-web good: the query date temporal.methodology source=MAWI sample point F span=2014-01..2017-01 snapshots=null cadence=daily 15-minute snapshots "This data set includes one 15-minute snapshot of Internet traffic per day." population.methodology sourceList=Censys IPv4 hosts n=101052620 listVersion=queried February 13, 2017 "Censys exposes an Internet-wide view of servers. ... We queried Censys on February 13, 2017." population.methodology sourceList=MAWI sample point F n=null listVersion=null "This data set includes one 15-minute snapshot of Internet traffic per day, taken at a connection point between the WIDE backbone network and a transit provider." ### IMC/2017/large-scale-scanning-of-tcps-initial-window counter-example: no date, no snapshot temporal.methodology source=Censys span=null..null snapshots=null cadence=null "We analyzed TLS handshakes using the data provided at censys.io." population.methodology sourceList=Censys data n=36500000 listVersion=null "Figure 2 shows the complementary CCDF of server certificate chain length of 36.5 M hosts."
One of the four could not be quoted on the content page. The IMC 2016 sentence “we simulated TASS and an address-based hitlist approach using monthly snapshots of full IPv4 scans from censys.io [5] for the time period from 09/2015 to 03/2016 (7 snapshots)” is verbatim in the extraction, but in paper.cols.txt it is interleaved with a numeric table, so a reader who greps for it will not find it. The content page paraphrases it and says so in a footnote rather than publishing a quote that cannot be located — the corpus README's warning about spliced quotes, hitting in practice.
The corpus README's measured figures (57.9% of quotes exact, 37% via an 8-word run, 0.9% unlocatable) were measured on the previous run and have not been re-measured. The rates in the block above are for this 40-tuple sample only and are not a re-measurement of that.
9. External sources
Every external claim on the content page was fetched on 2026-08-28, most of them twice: once by a sub-agent tasked with the currency sweep, and again directly here with curl and a browser User-Agent, because the instruction to fetch rather than recall is only worth something if the fetch is checked.
| Source | Fetched | Result | Used on the page |
|---|---|---|---|
https://scans.io | 200 | Now the “Stanford Internet Research Data Repository”, Stanford ESRG | yes — the scans.io row |
https://sonardata.rapid7.com/about/ | 200 | “commercial access to data from Project Sonar”; “Sign In (existing accounts only)” | yes |
https://www.phishtank.com/register.php | 200 | “New user registration temporarily disabled.” | yes |
https://docs.censys.com/docs/research-access-to-censys-data | 200 | Research Access programme, three datasets, application by email | yes |
https://search.censys.io/ | 403 | Cloudflare interstitial (“Just a moment…”) with a browser User-Agent | yes — as a bot wall, not an outage |
https://help.shodan.io/the-basics/academic-upgrade | 200 | 100 query credits/month, 100 scan credits/month, 16 monitored IPs | yes |
https://androzoo.uni.lu/ | 200 | “Current number of APKs: 27,616,457” | yes — flagged on the page as a live counter |
https://www.openintel.nl/ | 200 | “308 million domains measured on a daily basis”; “13.6 trillion data points collected since the start in 2015” | yes |
https://api.pushshift.io/reddit/search/submission | 403 | {“detail”:“Not authenticated”} | yes |
https://www.caida.org/catalog/datasets/ | 200 after redirect | redirects to catalog.caida.org search UI | yes |
https://letsencrypt.org/2025/08/14/rfc-6962-logs-eol | 200 | read-only 2025-11-30, shutdown 2026-02-28, Static CT API | yes |
https://www.cos.io/osf-changes | 200 | no new projects from 2026-11-16, read-only from 2027-02-19, DOIs resolve indefinitely, Registries/Preprints unaffected | yes — the deposit warning |
https://docs.censys.com/docs/platform-api-transition-guide | 200 | v1/v2 → v3 mapping, no shutdown date published | yes, with that caveat stated |
Rejected, and why. These are the entries that matter most for the next run:
- “Rapid7 Project Sonar was sunset in February 2024.” This was the working hypothesis going in and it is wrong. No Rapid7 primary source says it. What is verifiable is that the service moved to
sonardata.rapid7.com, is commercial, and offers sign-in to existing accounts only. The page says that and not the date. - “Tor Metrics moved.” Also a working hypothesis, also refuted —
metrics.torproject.organswers and is the current home. Nothing about it went on the page. - Reddit's “Reddit for Researchers” terms.
reddit.comandreddithelp.comboth refuse automated clients, so the only available descriptions were secondary commentary. The page states the verifiable fact (the Pushshift API returns 403 unauthenticated) and says in the footnote that the replacement route's terms could not be verified. - VirusTotal's current public-API rate limits, and whether its terms constrain publishing aggregate label counts. Not stated on any primary page that could be fetched. Nothing was published about it; VirusTotal appears on the page only as a corpus-count row, and label quality is routed to website_classification.
- Per-dataset collection status for CAIDA Ark, ITDK and AS Relationships.
catalog.caida.orgis JS-rendered and did not yield a status table to a fetch. The page claims only that the catalogue moved, which was verified by following the redirect. - No SEO listicle, vendor comparison blog or “top 10 tools” page was used for anything. Where a primary source could not be reached, the claim was dropped rather than downgraded.
10. What could not be established
- Whether a reused dataset is still obtainable, at corpus scale. The 60-string hand-audit gestures at it; a systematic access check over every named source would answer it. On the content page as an open question.
- How much a snapshot choice moves a published result. No paper in this corpus re-runs an analysis over several snapshots of the same producer to measure the swing. archives has the analogous result for archives; the scan-corpus literature does not.
- Join keys. The extraction has no field for the key a paper joined on, so the Which join key section is practice and reasoning, not a corpus figure — and the page says so in its own text rather than dressing advice as a finding.
- Whether the reuse trend is real at the edges. 2025–2026 are provisional; the year table is published with the last bucket starred and the flatness claim rests on the four complete buckets.
- Whether the union's 57.8%-of-corpus share is stable. It inherits
studyTypesinstability and was not re-measured. Published as a ranking-grade figure with that caveat attached.
11. Judgement calls
- New page rather than broadening a neighbour — §2. A reasonable person could have extended automated_measurements instead; the argument against is that it is a router.
- Union published as the page population, with the core alongside — §5. Choosing A alone would have been defensible and narrower.
- The ML-benchmark families are counted and shown, not filtered out. They are 10.8% of the reuse population and out of this page's scope, but hiding them would make the head of the ranking inexplicable to anyone who re-ran the query.
- Ranking lists (Tranco, Alexa, CrUX) are counted as an existing-dataset family even though website_selection owns them. They are artefacts you query, and excluding them would have understated the family table; the page routes the reader there rather than restating.
griffioen2024_have(IMC 2024, Have you SYN me?) was surfaced by the probe and not cited. It is about who scans, not about querying scan data, and [1Durumeric, Zakir; Adrian, David; Stephens, Phillip; Wustrow, Eric; Halderman, J. Alex (2024): "Ten Years of ZMap", in: Proceedings of the ACM Internet Measurement Conference. (DOI)] already carries the scanning-ecosystem point. No bibliography entry was added for it.artifacts.linkswas initially counted as “any recorded link”, which gave 89.8% for the reuse population — a figure that contradicts the corpus-wide artifact rates and would have been published. It was corrected tolinks[].belongsToAuthors === true, the same definition corpus andreport_automated_measurements.mjsuse, giving 57.7%. The check that caught it was comparing the script'scrawledrow against the 61.1% already published on automated_measurements.- The Which join key section publishes advice with no figure behind it. Alternative was to cut it; it stayed because the item this page answers names the join key explicitly and a reader who skips it will get it wrong.
12. Review log
Four reviewers, all told explicitly that the author's context may not be exhaustive, and all handed the page text, the report script and its unedited output, and these notes. The three focused passes ran in parallel first; the generic pass ran last, after their findings were applied.
Pass A — figures vs script (Sonnet)
Re-ran the script, diffed it against the committed output, checked every number and denominator on the page, audited the script internals, swept –members for every published family, and reproduced four headline figures independently in Python from extractions.jsonl.
| Finding | Verdict | What was done |
|---|---|---|
The residue hand-audit table publishes 9 / 9 / 5 where ds_residue_audit.tsv tallies 10 / 9 / 4, and the prose says “roughly three in ten” | already fixed | The reviewer was reading a draft snapshot taken before the fix; the file it flagged already read 10 / 9 / 4. Recorded rather than dismissed, because the reviewer was right about the tsv being the source of truth and about the earlier draft being wrong. |
| “Two of every three papers … are not called that by the other two” is a generous rounding of 61.9% | accepted | Replaced with the figure itself: “61.9% of the papers that any one of these fields calls a re-analysis are not called that by both of the others.” |
| Every other number, cell, denominator and footnote figure matches the script | — | 14 distinct denominators checked; no denominator-swap found. |
Script internals: sentinel handling, paper-vs-tuple counting, the belongsToAuthors artifact definition, yearOf parsing, age-bucket partitioning (sums equal n exactly), per-family Set de-duplication | no bugs | Age buckets independently reproduced in Python: 239/579/275/131/85/20 and 172/466/120/20/1/0. |
| Fold misassignment sweep over ~26 published families | no bad matches | Specifically checked the regexes flagged as risky — \bcora\b, \badult\b, \bsteam\b, \bdf\b. All hits are legitimate (UCI Adult, the Cora citation network, the Steam platform, Deep-Fingerprinting trace sets). |
Pass B — citations and quotes (Sonnet)
| Finding | Verdict | What was done |
|---|---|---|
The Pushshift footnote claims Reddit's current terms “could not be verified” and that reddit.com refuses automated clients — both wrong; redditinc.com/policies/data-api-terms fetches fine | accepted | Re-fetched it here (HTTP 200, latest revision 2026-07-01) and rewrote the footnote to cite it, quote its “separate agreement with Reddit” clause for research beyond rate limits, and narrow the blocked-client claim to support.reddithelp.com. |
| “Shodan, FOFA and ZoomEye mix cloud and enterprise ranges” overstates [2Wu, Mengying; Hong, Geng; Chen, Jinsong; Liu, Qi; Tang, Shujun; Li, Youhao; Liu, Baojun; Duan, Haixin; Yang, Min (2025): "Revealing the Black Box of Device Search Engine: Scanning Assets, Strategies, and Ethical Consideration", in: Proceedings of the Network and Distributed System Security Symposium. (Link)] — only Shodan mixes those two; FOFA is cloud, ZoomEye consumer | accepted | Re-read the paper's §V-A. Rewrote the bullet with each engine's actual mix and the 67% / 72% China figures. |
| The Censys transition-guide footnote says the guide maps “v1/v2” endpoints; it only maps v2 | accepted | Footnote and body corrected to v2, with a note that v1 was retired earlier. |
| PhishTank returned 429 to the reviewer, not the 200 the footnote records | already hedged, hedge extended | Both the author's fetch (200 with a browser User-Agent) and the reviewer's (429, retry-after: 86372) are now in the footnote, with the Wayback confirmation of the string. |
| All 9 citekeys resolve, appear once, and are not duplicated under another key by DOI or title; every load-bearing paper quote verbatim; Huang et al.'s precision/recall framing and Sethuraman et al.'s “about a quarter” framing both fair | — | Confirmed. |
Pass C — external currency (Sonnet)
| Finding | Verdict | What was done |
|---|---|---|
| The CT row cites only the Let's Encrypt post; it never says RFC 6962 is formally “Obsoleted by RFC 9162”, and gives no URL for the Static CT API spec | accepted | Verified both here — datatracker.ietf.org/doc/rfc6962/ shows the obsoletion, c2sp.org/static-ct-api redirects to static-ct-api@v1.1.0. Row extended with both, and with the point that RFC 9162 (CT v2.0) is itself Experimental and barely deployed. |
| CRAWDAD has migrated to IEEE DataPort | rejected | CRAWDAD appears only inside a fold family label (“Traffic trace archive (MAWI, CRAWDAD, CIC, DARPA)”), which names what was folded, not what to use. The page makes no access claim about it. Adding a currency note there would imply the family labels are recommendations, which they are not. Worth adding if this page ever gains a directory section — it will not. |
| The Pushshift citation is about an endpoint under the domain, not the domain root | accepted | Footnote now names /reddit/search/submission and records the bare domain's 405/307. |
| Everything else verified verbatim and live | — | Censys (all four URLs), Shodan, scans.io, Rapid7, AndroZoo, OpenINTEL, CAIDA's 303 redirect, Let's Encrypt, OSF, and all named-but-not-tabulated services. |
Author's own late additions, after the focused passes
- The AndroZoo currency row said only “keys expire and are download-capped”.
https://androzoo.uni.lu/accesswas fetched (HTTP 200) and the two limits are now quoted with their numbers (6 months, 500,000 APKs), because “we analysed 2 million APKs” is a claim about several key periods and a reader should be able to see that. - The Methodology and limitations bullet claimed
population.samplingMethodis “firmer” thanstudyTypes. It is an enum, but it is not in the stability comparison indata/extract/README.md, so the claim had no basis. Rewritten to claim only what is measured:temporal.modeat 69%,studyTypesat 57%, nothing aboutsamplingMethod. - One of the four snapshot-statement exemplars (IMC 2016) was published as a quote with an ellipsis. Re-checking it against
paper.cols.txtshowed the sentence is interleaved with a numeric table there, so a reader grepping for the quoted string would not find it. Replaced with a paraphrase plus a footnote saying why; the verbatim extraction quote is in §8. - “It is the modal sentence” (about undated dataset references) was an unsupported superlative. Replaced with the figure that is supported: 43.3% of the 2,534 existing-dataset papers give neither a first nor a last date.
- A section on reusing another paper's released artifact was missing, even though the item this page answers names “last year's crawl” explicitly. Added, built on two figures the page already has (9 of 60 residue strings name a prior paper's dataset by citation; 57.7% artifact release) plus [3Demir, Nurullah; Große-Kampmann, Matteo; Urban, Tobias; Wressnegger, Christian; Holz, Thorsten; Pohlmann, Norbert (2022): "Reproducibility and Replicability of Web Measurement Studies", in: Proceedings of the ACM Web Conference. (DOI)]. The Demir citation was first written as “measured how much a repeated crawl of the same list differs from itself”, which is not what that paper did; corrected to its actual design (4.5M pages, 24 setups) and its own sentence.
- The dataset-family table originally showed 24 of the fold's 35 Internet/web/security families, cutting the tail silently — including a 34-paper family. Replaced with the complete table generated from
–wiki, plus a sentence naming the counts in the four scopes that are not tabulated, so nothing is dropped without a number.
Mechanical guards, after every fix
Run against the final page text, not against a draft:
node scripts/check_wrap.mjs pages/draft/design_existing_datasets.txt pages/draft/provenance_design_existing_datasets.txt node scripts/check_tables.mjs pages/draft/design_existing_datasets.txt pages/draft/provenance_design_existing_datasets.txt node scripts/check_page_numbers.mjs pages/draft/design_existing_datasets.txt scripts/report_existing_datasets-output.txt
check_wrap and check_tables pass on both pages. check_page_numbers reports 29 unaccounted figures, and all 29 were read by hand: every one is from a cited paper (Huang et al.'s 95 / 52.07 / 85.71 / 75.00 / 80.00, Wu et al.'s 1,407 / 49 / 72 / 24.69 / 19.17, Izhikevich et al.'s 443, Demir et al.'s 4.5, the IMC 2016 and IMC 2018 exemplars' 09, 03, 4.1 and 489,580,002), an external primary source (27,616,457 / 308 / 13.6 / 200 / 405 / 86,372 / 6962 / 2019), a hypothetical in the page's own prose (a 10,000-host validation sample), or plain arithmetic on a figure the report does print (61.9% = 100 − 38.1%). No corpus figure on the page is missing from the report. That is the only thing this guard can prove, and it is worth saying explicitly: it traces digits, so it cannot tell a right number from a wrong one, and it never sees a quoted phrase.
Pass D — generic (Fable)
The pass with no checklist, run last, over both the content page and this one. It read the disk versions including the late additions above. Eleven findings; ten accepted, one accepted-with-a-correction-to-an-earlier-pass, none rejected.
| Finding | Verdict | What was done |
|---|---|---|
[[Artifacts]] resolves to design:artifacts inside the design: namespace, not to the top-level artifacts page — three red links | accepted | All three changed to [[:artifacts|Artifacts]]. The reviewer probed the live wiki rather than assuming; sitemap.mjs does not model relative namespace resolution and would not have caught this. |
| This page's §2 says a cross-link “was added” to automated_measurements; at review time it had not been | accepted | The parent edit was made before this page was saved, so the past tense is now true. The finding is the sharpest one in the run: a provenance log recording work that had not happened is the exact failure this page exists to prevent. |
| The overlap table omits the base-rate row the script prints (all papers, 3,389/5,859 = 57.8%), so “more than half of scan papers reuse data” reads as a property of scanning when it is the literature's base rate | accepted | Row added, and the paragraph rewritten to say so outright. The genuinely scan-specific figure (429 of 930, 46.1%) is now named as the narrower one. |
| “Only 42.9% … barely better than the 43.0% corpus-wide rate” — 42.9 is below 43.0 | accepted | “indistinguishable from”. A number guard cannot catch a comparator pointing the wrong way. |
| “something like it is what 43.3% of existing-dataset papers write” recasts an extraction silence as a claim about what papers say | accepted | Rewritten to what the field measures: 43.3% have no first or last date recorded. |
| The Certificate Transparency currency row does instrument-level work that tls_certificates already does better and fresher | accepted, and it reverses part of Pass C | The RFC 9162 / Static CT API detail Pass C asked for was correct but belongs on the TLS page, which already carries it. The row is cut to the one fact this page needs — the RFC 6962 shutdown date — and routes. Recorded rather than quietly reconciled, because two reviewers disagreed and the later one was right. |
The listVersion table silently drops the script's snowball row (89 papers, 10.1%) — the same silent-cut defect the log claims to have fixed elsewhere | accepted | Row added. |
| The currency table has no written inclusion rule, so VirusTotal's and the vulnerability databases' absence looks arbitrary while out-of-scope Pushshift gets the longest entry | accepted | Rule now stated above the table: sources from the family table whose access route changed since ~2020, plus Pushshift as the cautionary out-of-scope case. |
The 19-of-60 “cannot go and get” conclusion leans on the PRIOR class, whose own definition includes datasets that are trivially downloadable once found | accepted | Split on the page: 10 of 60 unobtainable, a further 9 identifiable only by chasing a citation. The bold conclusion now rests on the class that supports it. |
| §1 of this page says “6 existing keys reused”; the late-added [3Demir, Nurullah; Große-Kampmann, Matteo; Urban, Tobias; Wressnegger, Christian; Holz, Thorsten; Pohlmann, Norbert (2022): "Reproducibility and Replicability of Web Measurement Studies", in: Proceedings of the ACM Web Conference. (DOI)] makes it 7, and Pass B's “all 9 citekeys” record predates it | accepted | Count corrected to 7 (10 citekeys total). The reviewer verified the Demir quote and figures itself; that verification is recorded here rather than left implied. |
“for those the query is the study” overreaches — the 1,563 is measured on temporal tuples only | accepted | Narrowed to “the paper's only collection of measurement data”. |
| [3Demir, Nurullah; Große-Kampmann, Matteo; Urban, Tobias; Wressnegger, Christian; Holz, Thorsten; Pohlmann, Norbert (2022): "Reproducibility and Replicability of Web Measurement Studies", in: Proceedings of the ACM Web Conference. (DOI)] is the read-first paper for the “last year's crawl” reader and was missing from What to read first | accepted | Row added. |
The same pass recorded the pages as sound on the things it was asked to be sceptical about: all four of the item's questions are answered, the join-key section earns its place despite having no corpus figure behind it, the boundaries to archives and website_selection hold, and no DokuWiki hazard was found (WRAP and file blocks balanced, %% parity clean, table cells pipe-safe).
13. The run
| Item | Value |
|---|---|
| Date | 2026-08-28 |
| Corpus at the time | data/extract/run1, 5,859 papers, 7 venues (CCS, IMC, NDSS, PETS, USENIX Security, TheWebConf, IEEE S&P), 2010–2026 |
| Main agent | Claude (Opus 5) — corpus queries, fold, report script, page text, provenance page |
| Sub-agents | one currency sweep (Sonnet) before writing; four reviewers after — figures-vs-script (Sonnet), citations-and-quotes (Sonnet), external-currency (Sonnet), generic (Fable) |
| Write path | node scripts/dw.mjs (JSON-RPC), every save with –if-rev |
| Bibliography | appended to a fresh export of the live page, not to a local copy; duplicate check by key, DOI and title before appending |
| Accidental exposure or mistakes caught in review | the artifacts.links definition bug in §11; four fold regex bugs in §6; two working hypotheses about external services refuted in §9. All caught before publication. |
14. Report script output, unedited
node scripts/report_existing_datasets.mjs, 2026-08-28. Every figure on the content page appears here.
- report_existing_datasets-output.txt
========================================================================== CONTRACT CHECKS (exit 1 on any mismatch) ========================================================================== ok corpus size 5859 (expected 5859) ok empirical 5118 (expected 5118) ok papers with a temporal tuple 5342 (expected 5342) ok papers with a population tuple 5712 (expected 5712) ok crawled population 1120 (expected 1120) ok scan-tagged papers 930 (expected 930) ok temporal.mode = existing-dataset 2534 (expected 2534) ok population.samplingMethod = pre-existing-dataset 2029 (expected 2029) ok studyTypes has existing-dataset-analysis 2615 (expected 2615) ========================================================================== 1. THREE FIELDS THAT MEAN "EXISTING DATASET", AND THEIR DISAGREEMENT ========================================================================== A temporal.mode = existing-dataset 2534 (of 5342 papers with any provenance tuple) B population.samplingMethod = pre-existing-dataset 2029 (of 5712 papers with any population tuple) C studyTypes contains existing-dataset-analysis 2615 (of 5859 papers) Slice Papers ---------------------------- ------ A only 252 B only 203 C only 437 A and B 1611 A and C 1963 B and C 1507 all three (the core) 1292 exactly one of three 892 union (the reuse population) 3389 union that is empirical: 2960 (87.3% of 3389) core as a share of the union: 38.1% ========================================================================== 2. "WE SCANNED" VS "WE QUERIED" ========================================================================== Population N Also in the reuse union Share studyTypes existing-dataset-analysis Share ----------------------------------- ---- ----------------------- ----- ------------------------------------ ----- scan-tagged (network-scan-or-probe) 930 518 55.7% 429 46.1% crawled population 1120 644 57.5% 548 48.9% all papers 5859 3389 57.8% 2615 44.6% reuse papers that record NO live-crawl / active-probing / passive-collection tuple: 1563 (46.1% of 3389) reuse papers that also collected something themselves: 1826 (53.9%) ========================================================================== 3. WHICH SNAPSHOT: WHAT A REUSE PAPER DATES, AND WHAT IT DOES NOT ========================================================================== Stated on the tuple existing-dataset papers (n=2534) Share live-crawl papers (n=1261) Share ----------------------------------- -------------------------------- ----- -------------------------- ----- Names the source at all 2480 97.9% 105 8.3% First date of the data 1353 53.4% 796 63.1% Last date of the data 1358 53.6% 791 62.7% How many snapshots 377 14.9% 386 30.6% Cadence / how a snapshot was chosen 364 14.4% 316 25.1% existing-dataset papers giving NEITHER a first nor a last date: 1097 (43.3% of 2534) ========================================================================== 3b. HOW OLD IS THE DATA: venue year minus the last date of the data ========================================================================== Age of the newest data, in years existing-dataset (n=1329) Share live-crawl (n=779) Share -------------------------------- ------------------------- ----- ------------------ ----- 0 239 18.0% 172 22.1% 1 579 43.6% 466 59.8% 2 275 20.7% 120 15.4% 3–4 131 9.9% 20 2.6% 5–9 85 6.4% 1 0.1% 10+ 20 1.5% 0 0.0% median age, existing-dataset: 1 live-crawl: 1 >= 3 years old: existing-dataset 236 (17.8%), live-crawl 21 (2.7%) dropped: spanEnd with no parsable year existing-dataset 28, live-crawl 12 dropped: spanEnd year AFTER the venue year (extraction error or early venue year) existing-dataset 1, live-crawl 0 ========================================================================== 4. WHICH VERSION: population.listVersion, BY SAMPLING METHOD ========================================================================== population.samplingMethod Papers Names a listVersion Share ------------------------- ------ ------------------- ----- pre-existing-dataset 2029 871 42.9% top-n 950 468 49.3% random 1002 277 27.6% purposive 2744 744 27.1% exhaustive 1230 702 57.1% convenience 1222 185 15.1% stratified 240 83 34.6% seed-and-crawl 328 108 32.9% snowball 89 9 10.1% any population tuple names a listVersion: 2454 of 5712 (43.0%) ========================================================================== 5. WHICH DATASETS THE FIELD ACTUALLY QUERIES (folded, paper-counted) ========================================================================== reuse population 3389 reuse papers naming at least one source 2919 (86.1%) distinct raw source strings across those papers 5103 raw strings occurring exactly once 4782 raw strings occurring in >= 5 papers 59 -- scope: internet -- Family Papers Share of 3389 Raw spellings folded ------------------------------------------------------------------------ ------ ------------- -------------------- App store / app corpus (AndroZoo, Play, F-Droid) 109 3.2% 54 Other RIPE / RIR data 93 2.7% 100 CAIDA 85 2.5% 109 Popularity ranking list 77 2.3% 61 Vulnerability database (NVD, CVE, KEV, Snyk) 76 2.2% 78 RouteViews 67 2.0% 60 Other passive/active DNS 56 1.7% 63 Traffic trace archive (MAWI, CRAWDAD, CIC, DARPA) 52 1.5% 73 VirusTotal 51 1.5% 33 Censys 51 1.5% 35 Threat feed / blocklist 48 1.4% 51 RIPE RIS 43 1.3% 40 Malware corpus (VirusShare, Drebin, Genome, EMBER, Koodous) 40 1.2% 40 Other public data service (OpenStreetMap, OpenSky, WiGLE, Google Trends) 34 1.0% 19 Common Crawl 30 0.9% 21 Bug tracker / fuzzing corpus (syzbot, OSS-Fuzz, Bugzilla) 29 0.9% 22 RIPE Atlas 28 0.8% 23 Certificate Transparency 28 0.8% 27 Tor Metrics / CollecTor 25 0.7% 17 Farsight DNSDB / SIE 23 0.7% 24 Rapid7 / scans.io 21 0.6% 23 Internet Archive / Wayback 17 0.5% 10 Censorship list (Citizen Lab, OONI) 17 0.5% 20 Website-fingerprinting trace set (Wang, AWF, DF, BigEnough) 17 0.5% 20 HTTP Archive 15 0.4% 4 OpenINTEL 14 0.4% 11 M-Lab 13 0.4% 16 BGPStream / BGPmon 13 0.4% 7 IPv6 Hitlist 13 0.4% 11 Shodan 9 0.3% 8 Filter list / tracker database 9 0.3% 11 iPlane / DIMES / mrinfo 5 0.1% 5 Address-space census (LANDER, Trinocular) 5 0.1% 4 PeeringDB 5 0.1% 4 Other scan search engine 3 0.1% 5 -- scope: proprietary -- Family Papers Share of 3389 Raw spellings folded ------------------------------------------------------- ------ ------------- -------------------- Industry / proprietary data (a partner gave it to them) 55 1.6% 70 -- scope: unnamed -- Family Papers Share of 3389 Raw spellings folded ------------------------------ ------ ------------- -------------------- Authors' own or unnamed source 79 2.3% 69 -- scope: adjacent -- Family Papers Share of 3389 Raw spellings folded ------------------------------------------------ ------ ------------- -------------------- Social / UGC platform dump 216 6.4% 266 Blockchain / chain explorer 99 2.9% 79 Code host / package registry (GitHub, npm, PyPI) 92 2.7% 87 Leaked credential corpus 39 1.2% 46 Scholarly / bibliographic 33 1.0% 39 Email corpus (Enron) 27 0.8% 19 Government / official statistics 25 0.7% 29 Privacy-policy corpus (OPP-115) 14 0.4% 5 Underground forum corpus (CrimeBB) 10 0.3% 4 -- scope: benchmark -- Family Papers Share of 3389 Raw spellings folded ---------------------------------- ------ ------------- -------------------- ML benchmark dataset 307 9.1% 363 Software / fuzzing benchmark suite 60 1.8% 51 reuse papers naming >=1 internet-measurement family 853 (25.2% of 3389) reuse papers naming >=1 benchmark family 367 (10.8% of 3389) ========================================================================== 6. RESIDUE: source strings the fold could not place ========================================================================== residue papers (>=1 unplaced string) 1896 (55.9% of 3389) residue distinct strings 3192 (62.6% of 5103 raw strings) Residue strings named by >= 2 papers (the part worth a family if anyone adds one): 3 Bing search logs 3 Android Security Bulletin 3 SamMobile 3 Purchase 3 GTT23 2 AOL query log 2 Amazon 2 AOL dataset 2 AmpPot 2 AmIUnique 2 Linux kernel git history 2 CodeGuard nightly backups 2 Lending Club loan data 2 Snort 2 Nym network 2 LSMDC 2 Twitter15 2 Twitter16 2 IoT Inspector 2 Harvard Sentences dataset 2 Keystroke100 Dataset 2 ODGen dataset 2 TREC 2 ChatGPT-Roles 2 SIQA 2 FUGIO dataset 2 UC Irvine Machine Learning Repository 2 PSKReporter 2 PII datasets 2 StrongREJECT Residue strings named by exactly one paper: 3162. Full list under --residue-all. ========================================================================== 7. OVER THE YEARS (2025-2026 provisional) ========================================================================== Window Papers Reuse union Share Core (all three fields) Share ---------- ------ ----------- ----- ----------------------- ----- 2010–2013 511 278 54.4% 96 18.8% 2014–2017 769 439 57.1% 178 23.1% 2018–2021 1439 850 59.1% 334 23.2% 2022–2024 1955 1127 57.6% 431 22.0% 2025–2026* 1185 695 58.6% 253 21.4% ========================================================================== 8. BY VENUE (share of that venue's own output) ========================================================================== Venue Papers Reuse union Share ------- ------ ----------- ----- CCS 990 509 51.4% IEEE-SP 767 379 49.4% IMC 638 448 70.2% NDSS 701 432 61.6% PETS 510 233 45.7% USENIX 1410 763 54.1% WWW 843 625 74.1% ========================================================================== 9. ARTIFACT RELEASE: DOES A REUSE PAPER PASS THE DATA ON? ========================================================================== Population N Authors-own artifact link Share artifacts.availability stated Share ----------------------- ---- ------------------------- ----- ----------------------------- ----- reuse union 3389 1954 57.7% 2023 59.7% core (all three fields) 1292 738 57.1% 762 59.0% crawled population 1120 684 61.1% 721 64.4% all papers 5859 3321 56.7% 3356 57.3% papers with no artifacts record at all (counted as "no" above): 320
Related
- existing_datasets — the content page this backs.
- corpus — the dataset, its funnel, its venue scope and its provisional years.
- archives — the neighbouring provenance page, for the archive half of the same problem.
