User Tools

Site Tools


provenance:practices:public_relations

Provenance: Public Relations

Working log behind Public relations. Every query with its denominator, both report scripts with their unedited output, the fold rules with their residue, the quotes that were spot-checked, the external sources that were verified and the ones that were rejected, and what could not be established. Corpus-wide caveats are on Corpus and are not restated here.

Not prose. Read it if you are checking a number.

No ~~DISCUSSION~~ block, matching every existing provenance: page. Comments belong on the content page, Public relations.

The run

Field Value
Date 2026-08-18
Page status new page. practices:public_relations has been a red link since the site outline was written: promised from start (“regarding how to present your results to public and journalists”) and from Notifying websites (“the other post-publication channel”). sitemap.mjs on 2026-08-18 reported 57 existing pages and 26 promised-but-missing ids, this among them. Not an extension and not an overlap — no existing page covers press engagement, and the nearest neighbour, Notifying websites, explicitly hands off to it.
Corpus at the time data/extract/run1/extractions.jsonl, 5,859 papers, 7 venues (CCS, IMC, NDSS, PETS, USENIX Security, TheWebConf, IEEE S&P), 2010–2026. 5,869 paper.cols.txt files under data/fulltext.
Scripts written scripts/report_public_relations.mjs, scripts/pr_fulltext_grep.sh
Models Orchestration, all corpus queries, the folds, all quote spot-checks and the page text: Opus 5. Two Sonnet research sub-agents (external science-communication sources; documented misreporting cases). Reviewers logged below.
Brief's own warning The item was specified as having “little dataset support; lean on documented cases and on the wiki's own subjective-statement footnote convention.” That turned out to be correct about press engagement and wrong about the page as a whole — see Scope decision.

Scope decision

Three judgement calls, each of which a reasonable person could have made differently.

  • The page is about the claim, not about the interview. The brief pointed at “how to present results to journalists without overclaiming”. Two readings were available: media training (how to talk, what to wear, how to handle a hostile question), or claim discipline (which sentence travels, and what it licenses). The first is a topic on which this corpus has nothing, is well covered by any university communications office, and fails the site's “no MDN, no textbook” test. The page takes the second reading, which turned out to be measurable — see section B below. The cost of this choice is that the page gives almost no advice on the interview itself.
  • A negative finding was published as a finding. Section A of the report script establishes that zero of 4,472 papers with an ethics record document their own press engagement. It would have been possible to omit this and write a purely advisory page. Publishing it instead sets the reader's expectation about how much weight the rest of the page can bear, and is the honest framing of a page with two documented cases behind it.
  • A new measurement was constructed for this page. The “does a quotable sentence carry its own denominator” query (section B) is not a standard use of detection.evidence.quote and is the page's most novel and most contestable figure. It is reported with its rule, its residue in both directions, and an explicit statement of what it is a proxy for. A reasonable person would have declined to publish it, on the grounds that evidence.quote is a model's choice of sentence rather than the paper's headline sentence. It is published because the alternative was a page with no measurement on it at all, and because the limitation is stated on the content page rather than buried here.

Queries

All from node scripts/report_public_relations.mjs. Populations, in the order the page uses them:

Population Definition N
empirical isEmpirical == true 5,118
empirical ∧ has an ethics record isEmpirical == true ∧ ethics != null 4,472
… gave free-text disclosure detail + ethics.disclosureDetail non-empty 2,870
… named a harm-mitigation step + ethics.harmMitigation non-empty 3,186
has ≥1 detection tuple detection.length > 0 5,655
contributed ≥1 percentage-bearing evidence quote detection[].evidence.quote matches /\d+(\.\d+)?\s?%/ 4,316
assessed a law legal.length > 0 402
assessed a law ∧ crawled + (crawlConfig != null ∨ studyTypes ∋ automated-web-crawl) 131
all full-text files data/fulltext/**/paper.cols.txt 5,869

The 4,472 denominator matches the one Notifying websites uses and differs from data/extract/OVERVIEW.md, which uses 5,118. The 646-paper gap is papers where the extractor emitted no ethics object because the paper said nothing about ethics anywhere; counting those as “did not engage the press” would conflate said nothing with said no.

A. Press and media in what papers say about their own conduct

Regex, fixed before the results were looked at, applied to ethics.disclosureDetail ‖ ethics.harmMitigation ‖ ethics.evidence.quote:

/\b(press|media|journalist|reporter|news outlet|newspaper|embargo|public relations|press release|publicity)\b/i

34 of 4,472 papers match (0.8%). Fold, first rule wins, residue printed in full:

Fold family Rule Papers Share of 34
press contact with journalists or press offices press contacts?\|journalists?\|reporters?\|press release\|public relations\|press office\|public press 2 5.9%
vendor disclosure embargo (not press) embargo 16 47.1%
the word “media”, not the press social[- ]media\|media (payload\|content\|document\|file\|sentencing)\|multimodal media 14 41.2%
UNMAPPED RESIDUE 2 5.9%

The residue in full, both entries read by hand:

  • PETS/2017/to-permit-or-not-to-permit-that-is-the-usability-question-crowdsourcing-mobile-a — “Used test credentials, arbitrary locations, non-identifiable media, and made contact-upload tasks optional.”
  • NDSS/2026/flippyram-a-large-scale-study-of-rowhammer-prevalence — “Bootable media left user disks untouched”.

Both belong to the third family — the word “media” in a non-press sense — and the fold's regex simply does not enumerate those two phrasings. The rule was not widened to absorb them, so that the residue stays visible as a residue rather than being tuned to zero.

The two papers in the “press contact” family were read in full and neither is a press-engagement case:

  • IMC/2016/recommended-for-you-a-first-look-at-content-recommendation-networks — “We reached out to the five companies examined in this study via their public press contacts, but … none responded.” A notification channel, not a press strategy.
  • USENIX/2023/access-denied-assessing-physical-risks-to-internet-access-networks — anonymises networks or locations “when those details appear in the public press”. A redaction rule.

Hence the content page's claim: zero of 4,472.

Full-text sweep

bash scripts/pr_fulltext_grep.sh — two single passes over 20 GB of paper.cols.txt. –binary-files=text is mandatory: some .cols files are detected as binary by grep and are silently skipped otherwise, which under-counts the corpus (see Corpus).

Pass 1, 20 terms, papers matching any: 674 of 5,869 (11.5%). Per-term paper counts are in the script's committed output. The three largest are journalist (260), news outlet (81) and press release (76) — and reading them shows why the raw count is not the finding: press release is almost always a cited source (an FTC, ICANN or vendor press release in the references), and journalist is almost always a study population (journalists as at-risk users, e.g. 2015/USENIX/investigating-the-computer-security-practices-and-needs-of-journalists).

Pass 2, a deliberately broad self-reference regex over the same 5,869 files: 80 candidate papers, every one read by hand. Real hits: 3.

  • 2026/USENIX/bridges-to-self-silent-web-to-app-tracking-on-mobile-via-localhost — [1Vlummens, Tim; Girish, Aniketh; Weerasekara, Nipuna; Zuiderveen Borgesius, Frederik; Acar, Gunes; Vallina-Rodriguez, Narseo (2026): "Bridges to Self: Silent Web-to-App Tracking on Mobile via Localhost", in: Proceedings of the USENIX Security Symposium. (Link)]
  • 2024/IEEE-SP/sok-safer-digital-safety-research-involving-at-risk-users — [2Bellini, Rosanna; Tseng, Emily; Warford, Noel; Daffalla, Alaa; Matthews, Tara; Consolvo, Sunny; Woelfer, Jill Palzkill; Kelley, Patrick Gage; Mazurek, Michelle L.; Cuomo, Dana; Dell, Nicola; Ristenpart, Thomas (2024): "SoK: Safer Digital-Safety Research Involving At-Risk Users", in: Proceedings of the IEEE Symposium on Security and Privacy. (DOI)]
  • 2023/PETS/usability-and-enforceability-of-global-privacy-control — [3Zimmeck, Sebastian; Wang, Oliver; Alicki, Kuba; Wang, Jocelyn; Eng, Sophie (2023): "Usability and Enforceability of Global Privacy Control", Proceedings on Privacy Enhancing Technologies 2023(2). (DOI)]

Rev 1 of the regex missed the best of the three, and a reviewer found it — not the sweep. vlummens2026_bridges has a whole Public Disclosure subsection, and the rev-1 regex still did not match it, because it demanded reporters (who|seeking|contacted|reached out) and the paper says “reporters asked”, and because “media outreach” (in its acknowledgements) was not a term at all. The generic reviewer found it by noticing that Legal enforcement already cited the same paper for its disclosure timeline — i.e. the wiki already knew, and this page contradicted its own sibling.

Rev 2 adds media outreach, journalistic reporting, pursued public disclosure, public disclosure (occurred|through|website|in parallel), dedicated website, reporters (asked|approached), informed … chairs and a coordinated-disclosure-with-press alternation. Candidates went 59 → 80; real hits 2 → 3. The only new real hit is the bridges paper; the other 20 new candidates are “dedicated website” meaning somebody else's website, and “media outreach” in unrelated senses.

Two lessons recorded rather than quietly fixed. First, rev 1's own provenance note boasted that “the regex was left broad rather than tightened, because a false negative here would have cost the page its only two cases” — and it had already cost exactly that. A stated principle is not a test. Second, the cheapest check available was not run: grep the wiki's own published pages for the topic before claiming the corpus is silent on it. sitemap.mjs was run for red links but the sibling pages were never searched for press or disclosure material.

The other 57 are noise of four kinds, and the noise is instructive if you re-run this: our median matching our media without a word boundary; Mediatek; reporters meaning users who file abuse reports; and press releases as cited sources. The regex was left broad rather than tightened, because a false negative here would have cost the page its only two cases.

All 80 candidates, so that “every hit was read by hand” is checkable rather than asserted. The three real hits are marked.

corpus: 5859 extraction records, 7 venues (CCS, IMC, NDSS, PETS,
USENIX Security, TheWebConf, IEEE S&P), 2010-2026.

==========================================================================
A. Press and media in what papers say about their own conduct
==========================================================================
Population                                    N     Papers whose ethics text mentions press/media  Share
--------------------------------------------  ----  ---------------------------------------------  -----
empirical                                     5118  —                                              —
empirical ∧ has an ethics record              4472  34                                             0.8%
… of those, gave free-text disclosure detail  2870  32                                             1.1%
… of those, named a harm-mitigation step      3186  30                                             0.9%

What the press/media match actually is                                       Papers  Share of 34
---------------------------------------------------------------------------  ------  -----------
press contact with journalists or press offices                              2       5.9%
vendor disclosure embargo (not press)                                        16      47.1%
"social media"/"media payload"/"media documents" -- the word, not the press  14      41.2%
UNMAPPED RESIDUE                                                             2       5.9%

Every matching paper, printed in full -- the population is small enough that a
ranking would be dishonest and a list is the only fair summary:

  [vendor disclosure embargo (not press)]
    IEEE-SP/2019/spectre-attacks-exploiting-speculative-execution
      ...provided preliminary results to CPU vendors and affected companies and participated in an embargo. ‖ Coordinated responsible disclosure and embargo with industry. ‖ Using the practice of responsible disclosure, disjoint ...
    USENIX/2020/medusa-microarchitectural-data-leakage-via-automated-attack-synthesis
      ...Initial finding disclosed to Intel; embargo lasted until November 12, 2019. ‖ Responsible disclosure and publication embargo. ‖ We disclosed our initial finding to In...
    IEEE-SP/2021/crosstalk-speculative-data-leaks-across-cores-are-real
      ...Reported staging-buffer and RDRAND/RDSEED leakage to Intel; embargo followed. ‖ Coordinated vulnerability disclosure and embargo with Intel. ‖ We disclosed an initial PoC of staging buffer l...
    CCS/2023/ileakage-browser-based-timerless-speculative-execution-attacks-on-apple-devices
      ...ple and discussed countermeasures with Safari and Product Security teams. ‖ Maintained an embargo and coordinated countermeasures with Apple. ‖ We initially disclosed our findings to Apple on September 12, 2022. Apple ha...
    USENIX/2023/spectrem-exploiting-electromagnetic-emanations-during-transient-execution
      ...Disclosed findings to Arm; Arm acknowledged them and requested no embargo. ‖ We disclosed our findings to Arm on January 16th, 2023. Arm acknowledged these attacks, but did not request an embargo....
    USENIX/2023/bunnyhop-exploiting-the-instruction-prefetcher
      ...Reported results to Intel; Intel stated no embargo was required. ‖ The results in this paper were reported to Intel. The company responded that the issue is covered by its s...
    USENIX/2023/downfall-exploiting-speculative-data-gathering
      ...Reported findings to Intel; embargoed until August 2023 and coordinated public release. ‖ Coordinated responsible disclosure with Intel under embargo. ‖ We re...
    IEEE-SP/2024/deeptheft-stealing-dnn-model-architectures-through-power-side-channel
      ...Disclosed RAPL container exposure to Docker security team; team acknowledged and embargoed a fix. ‖ Reported the issue to Docker security team before publication. ‖ we have disclosed this security issue to the d...
    NDSS/2024/faults-in-our-bus-novel-bus-fault-attack-to-break-arm-trustzone
      ...OP-TEE security team and Linaro were notified; a 90-day embargo preceded public fixes. ‖ Coordinated disclosure, embargo, fix development, and testing. ‖ We notified the OP-TEE security ...
    USENIX/2024/security-and-privacy-analysis-of-samsungs-crowd-sourced-bluetooth-location-track
      ...Reported all issues to Samsung with a minimum 90-day embargo before publication. ‖ Coordinated disclosure and minimum 90-day embargo before publication. ‖ We have reported all the iss...
    IEEE-SP/2025/slap-data-speculation-attacks-via-load-address-prediction-on-apple-silicon
      ...and proof-of-concept code disclosed to Apple on May 24, 2024; Apple requested an extended embargo. ‖ Extended embargo requested by Apple after responsible disclosure. ‖ We disclosed our results to Apple on May 24, 2024. ...
    NDSS/2026/exploiting-tlbs-in-virtualized-gpus-for-cross-vm-side-channel-attacks
      ...Disclosed findings and proof-of-concept to NVIDIA; embargo lifted March 21, 2025. ‖ Responsible disclosure to NVIDIA and shared proof-of-concept. ‖ We have disclosed our findings to...
    PETS/2026/privacy-in-theory-bugs-in-practice-grey-box-auditing-of-differential-privacy-lib
      ...Reported vulnerabilities to maintainers under a 60-day disclosure embargo. ‖ Responsible disclosure and 60-day embargo for patches. ‖ We followed standard responsible disclosure protocols by repor...
    USENIX/2026/security-and-privacy-analysis-of-tiles-location-tracking-protocol
      ...Disclosed findings to Tile, observed a 90-day embargo, then extended it by 60 days. ‖ Sent no unnatural traffic and attacked only their own devices and infrastructure. ‖ we sen...
    USENIX/2026/lost-in-blockchain-address-misuse-hidden-cross-platform-risks-and-their-security
      ...d only public sources; omitted private keys and exploit scripts and planned a publication embargo. ‖ No human subjects were involved. We also plan to collaborate with these repository platforms to help them detect and wa...
    CCS/2025/heracles-chosen-plaintext-attack-on-amd-sev-snp
      ... the vulnerability and coordinated disclosure. ‖ Coordinated disclosure with AMD under an embargo. ‖ We reported our findings to AMD in January 2025. AMD acknowledged the vulnerability and asked for a coordinated disclos...
  ["social media"/"media payload"/"media documents" -- the word, not the press]
    USENIX/2018/analysis-of-privacy-protections-in-fitness-tracking-social-networks-or-you-can-r
      ...ave consulted our Institutional Review Board (IRB) to confirm that our analysis of social media posts does not meet the definition of human subjects research and thus does not require IRB approval....
    PETS/2019/because-i-was-told-so-much-linguistic-indicators-of-mental-health-status-on-twit
      ...cy and ethics in assessing a person's mental health status using their language on social media....
    USENIX/2020/what-twitter-knows-characterizing-ad-targeting-practices-user-perceptions-and-ad
      ...Recruitment notice explained the request to upload social-media data. ‖ Collected only three advertising files, omitted personally identifiable information, and redacted identifiers. ‖ Thi...
    IMC/2022/enabling-passive-measurement-of-zoom-performance-in-production-networks
      ...Network operator sanitized traces; one-way hashing and media-payload removal protected privacy. ‖ Anonymized with one-way hashing; operator removed personal data and media payloads. ‖ A...
    IMC/2023/flocking-to-mastodon-tracking-the-great-twitter-migration
      ...Collected exclusively publicly available data following established social-media research ethics. ‖ We have obtained a waiver from the ethics committee at the author's institution....
    USENIX/2023/unique-identification-of-50-000-virtual-reality-users-from-head-hand-motion-data
      ...BeatLeader notified users through official social media channels after initial results. ‖ Did not release the raw dataset; released de-identified and normalized data. ‖ the protoco...
    PETS/2024/onion-services-in-the-wild-a-study-of-deanonymization-attacks
      ...Used publicly accessible PACER and media documents; excluded media sentencing memorandums and omitted their URLs. ‖ Focused on investigative-method counts and did no...
    WWW/2024/bridging-or-breaking-impact-of-intergroup-interactions-on-religious-polarization
      ...Discussed risks of inferring religion from social-media names. ‖ Dropped verified users and non-personal names; discussed risks of identity inference. ‖ It is worth discussing the ...
    WWW/2024/mentallama-interpretable-mental-health-analysis-on-social-media-with-large-langu
      ...Public social-media data; texts anonymized, paraphrased, and obfuscated. ‖ Applied privacy protocols, anonymization, paraphrasing, and obfuscati...
    WWW/2024/characterizing-ethereum-upgradable-smart-contracts-and-their-security-implicatio
      ...Sent email alerts to contract creators and searched social media to report issues. ‖ Reported vulnerabilities to contract creators via EthMail and personal social media. ‖ We have also manu...
    WWW/2025/pirates-of-charity-exploring-donation-based-abuses-in-social-media-platforms
      ... any human subjects, including scammers. We collected publicly available data from social media profiles using API queries....
    PETS/2026/precarious-but-active-a-look-at-privacy-behaviors-in-chinese-transformative-fand
      ...Participants consented; public social-media users were not contacted and posts were paraphrased to prevent identification. ‖ Required overseas interviews, minimized ide...
    IMC/2025/exploration-of-the-dynamics-of-buy-and-sale-of-social-media-accounts
      ...Disclosed relevant profiles and information to all five social-media platforms in August 2024. ‖ Used only public data; avoided purchases, interactions, CAPTCHA bypasses, paywalls, and automati...
    WWW/2026/moral-outrage-shapes-commitments-beyond-attention-multimodal-moral-emotions-on-y
      ...This study examined how moral emotions in multimodal media content shape user engagement across three behavioral levels...
  [press contact with journalists or press offices]
    IMC/2016/recommended-for-you-a-first-look-at-content-recommendation-networks
      ...Researchers contacted the five examined companies through public press contacts; none responded. ‖ We reached out to the five companies examined in this study via their public press contacts, but...
    USENIX/2023/access-denied-assessing-physical-risks-to-internet-access-networks
      ...nymize networks or locations in case studies (§5) when those details appear in the public press....
  [UNMAPPED RESIDUE]
    PETS/2017/to-permit-or-not-to-permit-that-is-the-usability-question-crowdsourcing-mobile-a
      ...bmit identifiable content. ‖ Used test credentials, arbitrary locations, non-identifiable media, and made contact-upload tasks optional. ‖ This study was approved by our institution's ethics board. To protect participant...
    NDSS/2026/flippyram-a-large-scale-study-of-rowhammer-prevalence
      ...nformed about risks, collected data, privacy implications, and upload consent. ‖ Bootable media left user disks untouched; results stayed local without explicit upload consent. ‖ None of the institutions of the authors h...

==========================================================================
B. The sentence that travels: percentages in detection evidence quotes
==========================================================================
Quantity                                           Value
-------------------------------------------------  -----
papers with >=1 detection tuple                    5655
detection tuples in the corpus                     27241
tuples whose evidence quote contains a percentage  11523
papers contributing at least one such quote        4316

Of the percentage-bearing quotes                                         Tuples  Share of 11523
-----------------------------------------------------------------------  ------  --------------------------
name what the percentage is a percentage OF, in the same sentence        6003    52.1%
do not                                                                   5520    47.9%
carry a date or month in the same sentence                               270     2.3%
… of the undenominated, are a performance figure (accuracy/precision/…)  1690    30.6% of the undenominated

By paper (a paper counts as denominated if ANY of its percentage quotes is):
Papers                                N     Share of 4316
------------------------------------  ----  -------------
at least one denominated quote        3070  71.1%
every percentage quote undenominated  1246  28.9%
at least one dated quote              214   5.0%

Over time (tuples, not papers -- the unit here is the sentence). The last two
columns decompose the trend: if the fall in denomination were purely an artefact
of the field publishing more model-performance figures, the non-performance
series would be flat. It is not.
Bucket      Quotes with a %  Denominated  Dated  Perf share  Non-perf denominated
----------  ---------------  -----------  -----  ----------  --------------------
2010–2013   994              63.0%        2.0%   12.9%       67.8% (n=866)
2014–2017   1674             62.1%        1.9%   16.5%       68.4% (n=1398)
2018–2021   3023             54.6%        2.8%   17.7%       61.7% (n=2489)
2022–2024   3615             47.2%        2.4%   21.6%       53.8% (n=2835)
2025–2026*  2217             44.2%        2.1%   21.9%       51.3% (n=1732)

==========================================================================
C. legal.foundViolations -- how often a paper asserts a law was broken
==========================================================================
(1) worst case wins -- one row per paper, matches practices:legal_enforcement
legal.foundViolations  Papers (of 402 that assessed a law)  Share
---------------------  -----------------------------------  -----
yes                    94                                   23.4%
partial                83                                   20.6%
no                     74                                   18.4%
not-assessed           151                                  37.6%
not-stated             0                                    0.0%
  sums to 402 of 402

(2) any-tuple -- a paper counts once per distinct value; sums above 402
legal.foundViolations  Papers with >=1 such tuple  Share of 402
---------------------  --------------------------  ------------
not-assessed           177                         44.0%
yes                    94                          23.4%
partial                93                          23.1%
no                     75                          18.7%
not-stated             2                           0.5%

Population                      N    Has >=1 tuple with foundViolations=yes  Share
------------------------------  ---  --------------------------------------  -----
assessed a law                  402  94                                      23.4%
assessed a law AND ran a crawl  131  43                                      32.8%

B. The sentence that travels

Population: 27,241 detection tuples across 5,655 papers. 11,523 tuples have an evidence.quote containing /\d+(\.\d+)?\s?%/, contributed by 4,316 papers.

Two rules, either sufficient for “denominated”:

DENOM_RE     = /\d+(?:\.\d+)?\s?%[^.]{0,60}?\bof\b\s+[a-z0-9"'(]/i
DENOM_PRE_RE = /\bof\s+(the\s+)?[\d,]{2,}\s+[a-z]+[^.]{0,60}?\d+(?:\.\d+)?\s?%/i

and two classifiers:

PERF_RE = /\b(accuracy|accurate|precision|recall|f1|f-score|f-measure|auc|roc|true[- ]positive|
           false[- ]positive|success rate|error rate|overhead|detection rate|hit rate)\b/i
DATE_RE = /\b(19|20)\d{2}\b|\b(january|…|december)\b/i
Result Tuples Share of 11,523
denominated in-sentence 6,003 52.1%
not 5,520 47.9%
of the undenominated, a performance figure 1,690 30.6% of the undenominated
dated in-sentence 270 2.3%

By paper, of the 4,316: 3,070 (71.1%) have at least one denominated quote, 1,246 (28.9%) have none, 214 (5.0%) have at least one dated quote.

Decomposition of the year trend, added after a first draft asserted without evidence that the fall was caused by the rising share of performance figures:

Bucket n Denominated Perf share Non-perf n Non-perf denominated
2010–2013 994 63.0% 12.9% 866 67.8%
2014–2017 1,674 62.1% 16.5% 1,398 68.4%
2018–2021 3,023 54.6% 17.7% 2,489 61.7%
2022–2024 3,615 47.2% 21.6% 2,835 53.8%
2025–2026* 2,217 44.2% 21.9% 1,732 51.3%

Residue in both directions. –examples samples every 500th match so the sample spans the corpus rather than its first page. Called undenominated (correctly, in every sampled case — these are rates and scores with no population attached):

CCS/2010/dialog-based-payload-aggregation-for-intrusion-detection
  "while reducing the amount of data to be analyzed to about 1 %."
USENIX/2023/silent-bugs-matter-a-study-of-compiler-introduced-security-bugs
  "Specifically, 21.6% can cause system hanging (DoS), 50.8% lead to crashes, and 19.2% lead to
   information leaks."
IEEE-SP/2016/users-really-do-plug-in-usb-drives-they-find
  "These two numbers allow us to bound the attack's success rate to between 45-98%."
NDSS/2026/firmagent-…
  "FirmAgent achieved a 91% precision and successfully confirmed 182 real vulnerabilities…"

Called denominated:

WWW/2012/understanding-and-combating-link-farming-in-the-twitter-social-network
  "Within a span of 3 days, 65 (i.e., 13% out of 500) of the users responded by following our
   account back."
NDSS/2020/melting-pot-of-origins-…
  "As a result, we found that 73.6% of fingerprints leaked visit time."
PETS/2024/over-fences-and-into-yards-…
  "Only 32% of respondents knew that commercial satellites existed."

The sampled residue contains no misclassification in either direction, but 12 of 11,523 is not a validation set, and the rule's known weakness is visible in the third undenominated example: “success rate” is a denominated concept in context (“of the drives we dropped”), and the sentence still does not say so. That is the property the page is claiming, so the rule counting it as undenominated is correct for this purpose and would be wrong for most others.

C. legal.foundViolations

The script prints two tabulations of the same field, because they answer different questions and an earlier draft of the content page mixed them up.

(1) worst case wins — one row per paper, taking the strongest value it records. Sums to 402. This is what the content page publishes and what Legal enforcement publishes, so the two pages now agree.

Value Papers (of 402) Share
yes 94 23.4%
partial 83 20.6%
no 74 18.4%
not-assessed 151 37.6%
not-stated 0 0.0%

(2) any-tuple — a paper counts once per distinct value it uses. Sums above 402.

Value Papers with ≥1 such tuple Share of 402
not-assessed 177 44.0%
yes 94 23.4%
partial 93 23.1%
no 75 18.7%
not-stated 2 0.5%

The first draft published (2) and described it in the language of (1) — “44% deliberately stopped short of assessing it at all”. Under (2), the 177 not-assessed papers include papers that also asserted a violation about a different law, so it is not a count of papers that declined to assess anything. Worse, 177/44.0% collides numerically with Legal enforcement's “177 papers (44.0%) report finding violations, in full or in part” — the same two numbers meaning the opposite thing on two pages that link to each other. The generic reviewer caught it. The content page now publishes (1) and states the reconciliation inline; the script prints both and comments on why. The word “deliberately” was also removed: an enum records what a paper wrote, not why.

Of the 131 papers that assessed a law and ran a crawl, 43 (32.8%) have at least one foundViolations == yes tuple.

Two caveats the content page states and this page restates because they are easy to lose: foundViolations is an enum and so may be published as a percentage, but “assessed a law” is itself an extraction judgement, and 402 papers is a small population for a five-way split.

Report scripts and their unedited output

Two scripts, both deterministic and both re-runnable against the current data/extract/run1. Neither carries a figure forward from an earlier corpus.

node scripts/report_public_relations.mjs             # the three query sections
node scripts/report_public_relations.mjs --wiki      # DokuWiki tables
node scripts/report_public_relations.mjs --examples   # + sampled residue, both directions
bash  scripts/pr_fulltext_grep.sh                    # the 20 GB full-text sweep, ~4 min

node scripts/report_public_relations.mjs

-- RESIDUE: quotes the rule called UNDENOMINATED (read these before trusting it) --
  CCS/2010/dialog-based-payload-aggregation-for-intrusion-detection
    "while reducing the amount of data to be analyzed to about 1 %."
  WWW/2015/secrets-lies-and-account-recovery-lessons-from-the-use-of-personal-knowledge-que
    "SMS and email-based account recovery have a significantly higher chance of success: 81% for SMS vs 75% for Email vs 61% (US/English) down to 44% (France/French) for secret questions."
  IMC/2018/dissecting-apples-meta-cdn-during-an-ios-update
    "We observe the maximum traffic from the Apple AS to peak at 211%, from Limelight at 438% and Akamai at 113% on Sep. 19."
  WWW/2019/who-watches-the-watchmen-exploring-complaints-on-the-web
    "We find that DMCA notices make up 98.6% (1.05B URLs) of the dataset and a similar share of domains (97.8%)."
  NDSS/2021/deceptive-deletions-for-protecting-withdrawn-posts-on-social-media-platforms
    "even when we consider only two decoy posts for each damaging deletion the adversarial performance (F-score) drops to 42%"
  PETS/2022/understanding-utility-and-privacy-of-demographic-data-in-education-technology-by
    "Across the folds, the model had an average prediction accuracy of 73.3% ... The model ... had an average prediction accuracy of 76.2%"
  USENIX/2023/silent-bugs-matter-a-study-of-compiler-introduced-security-bugs
    "Specifically, 21.6% can cause system hanging (DoS), 50.8% lead to crashes, and 19.2% lead to information leaks."
  PETS/2024/detorrent-an-adversarial-padding-only-traffic-analysis-defense
    "we find that defense performance remains high, reducing Tik-Tok to a 21.5% accuracy with an 88.8% bandwidth overhead."
  IEEE-SP/2016/users-really-do-plug-in-usb-drives-they-find
    "These two numbers allow us to bound the attack's success rate to between 45-98%."
  NDSS/2026/firmagent-leveraging-fuzzing-to-assist-llm-agents-with-iot-firmware-vulnerability-discovery
    "FirmAgent achieved a 91% precision and successfully confirmed 182 real vulnerabilities, comprising 45 command injection and 137 buffer overflow vulnerabilities."
  NDSS/2025/secret-spilling-drive-leaking-user-behavior-through-ssd-contention
    "Figure 14 shows the classification heat map of the SSD K with the best results of 97.0 %, the open-world dataset is correctly classified with 78 % accuracy."
  IEEE-SP/2023/uncovering-user-interactions-on-smartphones-via-contactless-wireless-charging-si
    "WISERS achieves a 100% overall success rate in the 40 end-to-end attacks within at most five attempts"

-- quotes the rule called DENOMINATED --
  IMC/2010/estimating-and-sampling-graphs-with-multidimensional-random-walks
    "For example, in the Flickr graph 21% of the users belong to one or more special interest groups [26]."
  WWW/2012/understanding-and-combating-link-farming-in-the-twitter-social-network
    "Within a span of 3 days, 65 (i.e., 13% out of 500) of the users responded by following our account back."
  PETS/2015/blocking-resistant-communication-through-domain-fronting
    "In both cases, about 38% of packets are empty (mostly ACKs), with many packets near the usual TCP Maximum Segment Size of 1460 bytes."
  WWW/2017/can-you-spot-the-fakes-on-the-limitations-of-user-feedback-in-online-social-netw
    "We also find that up to 3.8% of members accepting connection requests show skill in identifying real accounts."
  IEEE-SP/2019/synesthesia-detecting-screen-content-via-remote-acoustic-side-channels
    "The resulting accuracy is 99.0%. For comparison, this classifier had a 99.4% accuracy on a similar-sized validation set of traces of the first screen."
  NDSS/2020/melting-pot-of-origins-compromising-the-intermediary-web-services-that-rehost-websites
    "As a result, we found that 73.6% of fingerprints leaked visit time."
  USENIX/2021/how-great-is-the-great-firewall-measuring-chinas-dns-censorship
    "99% of poisoned responses hit our machine within 364ms ahead of the legitimate ones."
  USENIX/2022/qcsd-a-quic-client-side-website-fingerprinting-defence-framework
    "At both 1 ms and 5 ms granularities LCSS indicated that both the defended and simulated time series were transmitting similar amounts of bytes (within ε = 150) for over 85% of the intervals."
  USENIX/2023/dscope-a-cloud-native-internet-telescope
    "50% of random scanning IPs ... after just 22min (90% after 72 min), while 50% of scanning ASNs ... after just 5 min (90% after 17 min)."
  PETS/2024/over-fences-and-into-yards-privacy-threats-and-concerns-of-commercial-satellites
    "Only 32% of respondents knew that commercial satellites existed."
  PETS/2025/intractable-cookie-crumbs-unveiling-the-nexus-of-stateful-banner-interaction-and
    "Across all categories and runs, we observe a consistent trend where nearly 60% of cookies have an expiry exceeding 10 days"
  CCS/2025/asymmetry-vulnerability-and-physical-attacks-on-online-map-construction-for-auto
    "Under our attack, UGR rises to 44% for both flashlight and patch attacks-an absolute increase of 17%"

==========================================================================
C. legal.foundViolations -- how often a paper asserts a law was broken
==========================================================================
(1) worst case wins -- one row per paper, matches practices:legal_enforcement
legal.foundViolations  Papers (of 402 that assessed a law)  Share
---------------------  -----------------------------------  -----
yes                    94                                   23.4%
partial                83                                   20.6%
no                     74                                   18.4%
not-assessed           151                                  37.6%
not-stated             0                                    0.0%
  sums to 402 of 402

(2) any-tuple -- a paper counts once per distinct value; sums above 402
legal.foundViolations  Papers with >=1 such tuple  Share of 402
---------------------  --------------------------  ------------
not-assessed           177                         44.0%
yes                    94                          23.4%
partial                93                          23.1%
no                     75                          18.7%
not-stated             2                           0.5%

Population                      N    Has >=1 tuple with foundViolations=yes  Share
------------------------------  ---  --------------------------------------  -----
assessed a law                  402  94                                      23.4%
assessed a law AND ran a crawl  131  43                                      32.8%

node scripts/report_public_relations.mjs --examples (residue only)

The run above is reproduced verbatim by –examples before this block; only the sampled residue is repeated here.

corpus root: /workspace/publications_dataset/data/fulltext
paper.cols.txt files: 5869
papers matching any term: 674

-- papers per term (a paper can match several) --
press release               76
press coverage               4
media coverage              58
news coverage               26
journalist                 260
media attention             37
press attention              2
popular press               18
mainstream media            21
tech press                   1
science communication        7
public relations            26
sensational                 27
misreport                   37
media report                54
news report                 73
reported in the media        8
media outlet                51
news outlet                 81
embargo                     59

-- SELF-REFERENCE: papers describing press engagement with THEIR OWN results --
Regex is deliberately broad; every hit is meant to be read by hand.
2013/WWW/two-years-of-short-urls-internet-measurement-security-threats-and-countermeasure/paper.cols.txt:1064:track the user. This analysis, however, mainly deals with FP7-ICT-257007 funded by the 7th FP. The opinions eximplications inherent to shortening services design. Our pressed in this paper are those of the authors and do not
2013/IEEE-SP/the-crossfire-attack/paper.cols.txt:1556:[44] FBI National Press Office, "Over one million potential victims of botnet cyber crime,"
2014/USENIX/man-vs-machine-practical-adversarial-detection-of-malicious-crowdsourcing-worker/paper.cols.txt:63: 1 Our work received approval from our local IRB review board.
2014/USENIX/security-analysis-of-a-full-body-scanner/paper.cols.txt:1084:[51] TSA Press Office. TSA takes next steps to
2022/IMC/revealing-the-evolution-of-a-cloud-provider-through-its-network-weather-map/paper.cols.txt:624: their network in a dedicated website [2]. These events could give
2022/NDSS/auto-draft-200/paper.cols.txt:552:with Samsung, our MediaTek implementation in F IRM W IRE is
2022/PETS/on-dark-patterns-and-manipulation-of-website-publishers-by-cmps/paper.cols.txt:255:each available consent pop-up version (free, paid, 4 Monitoring and analysis of the network cometc. - see Table 2) of a studied CMP, we installed munications. To detect tracking cookies and other susone version pop-up per dedicated website hosted on picious behaviors, we rely on the Firefox web developer
2022/USENIX/caring-about-sharing-user-perceptions-of-multiparty-data-sharing/paper.cols.txt:249:the survey. Our study received ethics approval from our institution's office of research ethics (ORE). See survey at
2022/USENIX/understanding-and-improving-usability-of-data-dashboards-for-simplified-privacy/paper.cols.txt:661:and our median participant contributed a total of 837.5 data using it? in Survey 1. 78.8% of our participants responded
2022/USENIX/automated-side-channel-analysis-of-media-software-with-manifold-learning/paper.cols.txt:418:of our media inputs are all over 10K. We visualize encoding
2022/USENIX/helping-hands-measuring-the-impact-of-a-large-threat-intelligence-sharing-commun/paper.cols.txt:224:process development, advisory writing, and media outreach. fixed schedule, and described drawing on newly registered
2022/WWW/link-black-box-detection-of-cross-site-scripting-vulnerabilities-using-reinforce/paper.cols.txt:480:second action, one of the four media tags (i.e., img, video, audio,
2022/IEEE-SP/heapster-analyzing-the-security-of-dynamic-allocators-for-monolithic-firmware-im/paper.cols.txt:915:and 1 hour median. It is worth noting that the analysis of only 17 analysis results show that all tested HMLs variants are vulnerable
2025/NDSS/the-unusual-suspects-studying-reasons-for-lacking-updates-in-wordpress/paper.cols.txt:377: and verify information about our studies on dedicated websites. (see Appendices E and F for the code books of S1 and S2 ).
2025/PETS/sheeps-clothing-wolfish-intent-automated-detection-and-evaluation-of-problematic/paper.cols.txt:1037:7.2.2 Per Exchange Analysis. Findings from our mediation analysis
2025/PETS/what-are-they-gonna-do-with-my-data-privacy-expectations-concerns-and-behaviors/paper.cols.txt:1383: VR platform owners. Social media outreach [1, 104] regarding
2025/PETS/privacy-perceptions-and-behaviors-towards-targeted-advertising-on-social-media-a/paper.cols.txt:949:the interplay between country and culture in our mediation analysis.
2025/PETS/privacy-perceptions-and-behaviors-towards-targeted-advertising-on-social-media-a/paper.cols.txt:950:We also included religion in our mediation analysis, as religion and
2025/USENIX/a-mixed-methods-study-of-open-source-software-maintainers-on-vulnerability-manag/paper.cols.txt:1327:practices most, reporters who provide the best-rated (e.g.,
2025/USENIX/understanding-how-users-prepare-for-and-react-to-smartphone-theft/paper.cols.txt:1275:7 Ethics Considerations • Help Website: A dedicated website offering additional
2025/WWW/the-agenda-setting-function-of-social-media/paper.cols.txt:150: and coverage bias: which issues are covered by the news and how
2025/WWW/pirates-of-charity-exploring-donation-based-abuses-in-social-media-platforms/paper.cols.txt:134:summary, our work received several positive acknowledgments
2025/WWW/causal-modeling-of-climate-activism-on-reddit/paper.cols.txt:611:bottom-up dynamics of the first wave of protests, that was successful despite not being covered by media during its build-up stage on
2025/WWW/7-days-later-analyzing-phishing-site-lifespan-after-detected/paper.cols.txt:404:a 1.76-hour median lifespan but a 30.5-hour GSB detection time.
2025/IEEE-SP/study-club-labor-union-or-start-up-characterizing-teams-and-collaboration-in-the/paper.cols.txt:289: Both stages of our study received approval from the first
2025/IEEE-SP/learning-from-censored-experiences-social-media-discussions-around-censorship-ci/paper.cols.txt:817:14 Persian VPN names, (2) VPN-Dedicated websites: We
2025/IEEE-SP/restricting-the-link-effects-of-focused-attention-and-time-delay-on-phishing-war/paper.cols.txt:326:Our study received approval from the University of
2024/NDSS/50-shades-of-support-a-device-centric-analysis-of-android-security-updates/paper.cols.txt:412:Nexus devices in a dedicated website [30]. Firmware images
2024/NDSS/drainclog-detecting-rogue-accounts-with-illegally-obtained-nfts-using-classifiers-learned-on-graphs/paper.cols.txt:283:draining are being sold between $29 - $149 on dedicated websites [34] and the darkweb [20]. The accessibility of draining
2024/PETS/simply-tell-me-how-on-trustworthiness-and-technology-acceptance-of-attribute-bas/paper.cols.txt:1010:Our mediation analysis in Appendix C highlighted that there exists
2024/USENIX/investigating-moderation-challenges-to-combating-hate-and-harassment-the-case-of/paper.cols.txt:1709:reporters who abuse the report feature)? C2: What would be the point of having a reporting
2024/USENIX/what-keeps-people-secure-is-that-they-met-the-security-team-deconstructing-drive/paper.cols.txt:543:news: "if incidents are picked up by the media, then it is often
2024/WWW/global-news-synchrony-and-diversity-during-the-start-of-the-covid-19-pandemic/paper.cols.txt:574:sity. To measure the similarity of the events covered by news media
2024/IEEE-SP/casual-users-and-rational-choices-within-differential-privacy/paper.cols.txt:1126:implicitly, our study received a very high rating of 4.58 on
2024/IEEE-SP/sok-safer-digital-safety-research-involving-at-risk-users/paper.cols.txt:1116:they do not overpromise and underdeliver. While doing so and we always tell them to contact the communications staff
2024/IEEE-SP/sok-safer-digital-safety-research-involving-at-risk-users/paper.cols.txt:1182:we received inquiries from reporters seeking our expertise. Here, we discuss how these friction points are both
2024/IEEE-SP/c-frame-characterizing-and-measuring-in-the-wild-captcha-attacks/paper.cols.txt:1070:lawsuit settlement [55]. These settlements are typically detailed on a dedicated website, outlining the specifics of
2024/CCS/do-anything-now-characterizing-and-evaluating-in-the-wild-jailbreak-prompts-on-l/paper.cols.txt:418:is a dedicated website for collecting jailbreak prompts. Users on
2024/CCS/i-had-sort-of-a-sense-that-i-was-always-being-watched-since-i-was-examining-inte/paper.cols.txt:393:surveys, and interviews to ensure the ethical consideration of participants. Our study received expedited full approval for all three
2024/CCS/trust-because-you-cant-verify-privacy-and-security-hurdles-in-education-technolo/paper.cols.txt:246: While our study received exempt status by our Institutional
2024/CCS/rolling-in-the-shadows-analyzing-the-extraction-of-mev-across-layer-2-rollups/paper.cols.txt:663:the number of liquidations and arbitrages over the course of our median values while the maximum values are much higher than the
2023/IMC/does-it-spin-on-the-adoption-and-use-of-quics-spin-bit/paper.cols.txt:658:and (3) hosting a dedicated website on our measurement IPs. The
2023/PETS/usability-and-enforceability-of-global-privacy-control/paper.cols.txt:973:our institution's IRB staff, legal counsel, communications staff, university administrators, and faculty colleagues about the procedure
2023/PETS/senrev-measurement-of-personal-information-disclosure-in-online-health-communiti/paper.cols.txt:1409:their invaluable feedback and comments. Our work received support from National Science Foundation (NSF) grants, including NSF
2023/USENIX/work-from-home-and-covid-19-trajectories-of-endpoint-security-management-in-a-se/paper.cols.txt:123:in which it operates. Our study received IRB approval from
2023/USENIX/millions-of-people-are-watching-you-understanding-the-digital-safety-needs-and-p/paper.cols.txt:945: "[If] there were a forum for creators where they know journalists who have other avenues for audience engagement
2023/USENIX/examining-power-dynamics-and-user-privacy-in-smart-technology-use-among-jordania/paper.cols.txt:341: Author 1 (the primary researcher) and Author 2 (the princi-To ensure ethical considerations, our study received approval
2023/USENIX/instructions-unclear-undefined-behaviour-in-cellular-network-specifications/paper.cols.txt:1030: Undefined behaviour Mediatek MT6768
2023/USENIX/instructions-unclear-undefined-behaviour-in-cellular-network-specifications/paper.cols.txt:1548: Undefined behaviour Mediatek MT6768 Mediatek MT6853V HiSilicon Kirin 820 5G Samsung Exynos 990 Qualcomm SM8250
2023/USENIX/instructions-unclear-undefined-behaviour-in-cellular-network-specifications/paper.cols.txt:1564: Undefined behaviour Mediatek MT6768 Mediatek MT6853V HiSilicon Kirin 820 5G Samsung Exynos 990 Qualcomm SM8250
2023/USENIX/instructions-unclear-undefined-behaviour-in-cellular-network-specifications/paper.cols.txt:1598: Undefined behaviour Mediatek MT6768 Mediatek MT6853V HiSilicon Kirin 820 5G Samsung Exynos 990 Qualcomm SM8250
2023/WWW/propaganda-politica-pagada-exploring-u-s-political-facebook-ads-en-espanol/paper.cols.txt:384: to entry for civil society groups and journalists who are the inparty to be left-leaning, and the Republican party to be right-leaning.
2023/WWW/an-empirical-study-of-the-usage-of-checksums-for-web-downloads/paper.cols.txt:516:fle hosting websites (i.e., dedicated websites that host many diferent fles produced by third parties, e.g., https://download.cnet.com,
2015/USENIX/investigating-the-computer-security-practices-and-needs-of-journalists/paper.cols.txt:262:newsrooms and journalists who deal regularly with international (including non-Western) sources and stories of
2012/IEEE-SP/lastor-a-low-latency-as-aware-tor-client/paper.cols.txt:1110:that our median false negative rate is 11%. This compares 0
2017/IMC/ethical-issues-in-research-using-datasets-of-illicit-origin/paper.cols.txt:780:of the journalists who used ICIJ's systems and IRB approved
2017/PETS/why-privacy-is-all-but-forgotten/paper.cols.txt:1325:Our study received approval from the ethics board of
2017/USENIX/when-the-weakest-link-is-strong-secure-collaboration-in-the-case-of-the-panama-p/paper.cols.txt:130:journalists who did not have them.
2017/USENIX/when-the-weakest-link-is-strong-secure-collaboration-in-the-case-of-the-panama-p/paper.cols.txt:1103:Lessons for Journalistic Collaborations. A key factor in the Panama Papers' security success was the reputation ICIJ had built for exclusive, high-impact investigations. Journalists approached for the Panama Papers'
2017/USENIX/exploring-user-perceptions-of-discrimination-in-online-targeted-advertising/paper.cols.txt:1131:critical topic of online algorithmic discrimination. Our media ad spending. eMarketer (2016). https:
2026/NDSS/tickets-to-hide-an-inside-look-into-the-anti-abuse-ecosystem-through-internal-abuse-data/paper.cols.txt:1112:reporters who file significant amounts of reports. Most reports
2026/NDSS/tickets-to-hide-an-inside-look-into-the-anti-abuse-ecosystem-through-internal-abuse-data/paper.cols.txt:1344: such as CSAM hotlines, or reporters who can pressure the
2026/PETS/contextual-intent-activists-privacy-considerations-for-collaborative-technology/paper.cols.txt:841:PETS except for social media outreach and only Group 21 even
2026/USENIX/end-to-end-encrypted-collaborative-documents/paper.cols.txt:78:tigative journalists who use collaborative documents to work near-real-time collaboration.
2026/USENIX/bridges-to-self-silent-web-to-app-tracking-on-mobile-via-localhost/paper.cols.txt:996:localhost-based tracking. On mobile, several studies have exfor helping with media outreach, HTTP Archive Project for
2026/USENIX/bridges-to-self-silent-web-to-app-tracking-on-mobile-via-localhost/paper.cols.txt:1069:Public Disclosure. Because the tracking technique was actively abused, we pursued public disclosure in parallel with
2026/USENIX/bridges-to-self-silent-web-to-app-tracking-on-mobile-via-localhost/paper.cols.txt:1070:affected vendor coordination before submission of this paper. Public disclosures increase societal awareness, and motivate and expedite mitigations. The public disclosure occurred
2026/USENIX/bridges-to-self-silent-web-to-app-tracking-on-mobile-via-localhost/paper.cols.txt:1071:through a dedicated website (https://localmess.github
2026/USENIX/bridges-to-self-silent-web-to-app-tracking-on-mobile-via-localhost/paper.cols.txt:1072:.io) with independent journalistic reporting. As part of the
2026/USENIX/bridges-to-self-silent-web-to-app-tracking-on-mobile-via-localhost/paper.cols.txt:1073:same release process, reporters asked Meta and Yandex's statements the day before the publication, giving them a chance
2026/WWW/community-fact-checks-do-not-break-follower-loyalty/paper.cols.txt:233:community notes and their status histories on a dedicated website1 .
2019/IMC/econ-modeling-the-network-to-improve-application-performance/paper.cols.txt:149:than 60%, even under dynamic network conditions. Our median
2019/IMC/econ-modeling-the-network-to-improve-application-performance/paper.cols.txt:768:works. Our median throughput prediction error for Azure, Southeast,
2019/IMC/econ-modeling-the-network-to-improve-application-performance/paper.cols.txt:785:write and 6MB for read) in the Northeast network. Our median
2019/IMC/econ-modeling-the-network-to-improve-application-performance/paper.cols.txt:792:outperforms all seven alternative models. Our median throughput
2019/IMC/econ-modeling-the-network-to-improve-application-performance/paper.cols.txt:922:forms other models irrespective of the number of parallel connections; further, our median error numbers are much lower, by about
2019/NDSS/quantity-vs-quality-evaluating-user-interest-profiles-using-ad-preference-managers/paper.cols.txt:1163:BlueKai, the overlap of our median participant's interest profile
2019/NDSS/quantity-vs-quality-evaluating-user-interest-profiles-using-ad-preference-managers/paper.cols.txt:1194:interests for our median participant. This suggests that Google,
2019/NDSS/quantity-vs-quality-evaluating-user-interest-profiles-using-ad-preference-managers/paper.cols.txt:1486:across APMs. Our results echo anecdotal findings from investigative journalists who have found their profiles from data brokers to be woefully inaccurate [48], [10]. Further, participants
2019/NDSS/measuring-the-facebook-advertising-ecosystem/paper.cols.txt:1476: The most innovative newsroom in journalism. And reporters who still knock on doors. ** "Something that started decades ago
2019/USENIX/less-is-more-quantifying-the-security-benefits-of-debloating-web-applications/paper.cols.txt:370:USENIX AssociationActions covered by MediaWiki tutorials: MediaWiki provides
2019/USENIX/less-is-more-quantifying-the-security-benefits-of-debloating-web-applications/paper.cols.txt:1442:vulnerabilities might only be exploitable under specific configurations. For example the set of five file-upload-related vulnerabilities in our MediaWiki dataset (marked as gray in Table 9) require
2019/WWW/privacy-preserving-crowd-sourcing-of-web-searches-with-private-data-donor/paper.cols.txt:978:Our study received ethics approval from University College London. leaves plenty of room to grow to more users.
2019/WWW/who-watches-the-watchmen-exploring-complaints-on-the-web/paper.cols.txt:378:Remove Your Media 7.28 0.92 2.45 346 bu
2019/WWW/who-watches-the-watchmen-exploring-complaints-on-the-web/paper.cols.txt:486: remove your media
2019/WWW/who-watches-the-watchmen-exploring-complaints-on-the-web/paper.cols.txt:611:mangapark.me 3 4 business 18 Remove Your Media (99.1%) 28 3,901
2019/WWW/who-watches-the-watchmen-exploring-complaints-on-the-web/paper.cols.txt:728: Remove your media
2019/WWW/who-watches-the-watchmen-exploring-complaints-on-the-web/paper.cols.txt:729: Remove your media
2021/IMC/identifying-ases-of-state-owned-internet-operators/paper.cols.txt:803: a dedicated website.
2021/NDSS/pfirewall-semantics-aware-customizable-data-flow-control-for-smart-home-privacy-protection/paper.cols.txt:1013:that our mediator works correctly in relaying IoT device events
2021/USENIX/the-role-of-computer-security-customer-support-in-helping-survivors-of-intimate/paper.cols.txt:253:Ethical Considerations. Our study received IRB approval.
2021/WWW/an-experimental-study-to-understand-user-experience-and-perception-bias-occurred/paper.cols.txt:466:the pre-stance and the four media type combinations, this figure quantifying the difference between two pre-stances, positive and
2021/WWW/short-is-the-road-that-leads-from-fear-to-hate-fear-speech-in-indian-whatsapp-gr/paper.cols.txt:363:Tyson [21] to gather the WhatsApp data. With help from journalists who cover politics, we curated lists of keywords related to
2021/WWW/security-of-alerting-authorities-in-the-www-measuring-namespaces-dnssec-and-web/paper.cols.txt:194:own dedicated websites not only for informational purposes but
2020/WWW/an-empirical-study-of-the-use-of-integrity-verification-mechanisms-for-web-subre/paper.cols.txt:1124:and to promote its use through a dedicated website that would
2018/PETS/panoptispy-characterizing-audio-and-video-exfiltration-from-android-applications/paper.cols.txt:934:ative rate of our media-detection methodology is low.
2018/PETS/panoptispy-characterizing-audio-and-video-exfiltration-from-android-applications/paper.cols.txt:1134:Dynamic analysis limitations. A number of factors could lead to this result. First, our media extraction
2018/USENIX/understanding-the-reproducibility-of-crowd-reported-security-vulnerabilities/paper.cols.txt:1249:through cash incentives. For public disclosure websites,
2018/USENIX/end-to-end-measurements-of-email-spoofing-attacks/paper.cols.txt:1085:Ethics Guidelines. Our study received IRB approval, compared to that without security indicators. The differand we have taken active steps to protect the participants. ence, however, is not very significant (Fisher's exact test
2018/USENIX/saql-a-stream-based-query-system-for-real-time-abnormal-system-behavior-detectio/paper.cols.txt:223:low alert detection latency (<2s); (2) our pressure test
2018/USENIX/all-your-gps-are-belong-to-us-towards-stealthy-manipulation-of-road-navigation-s/paper.cols.txt:119: 1 Our study received the approval from our local IRB (#17-936).
2018/USENIX/all-your-gps-are-belong-to-us-towards-stealthy-manipulation-of-road-navigation-s/paper.cols.txt:870:customized driving simulator. Our study received the approval of our local IRB (#17-936).
2018/IEEE-SP/hackers-vs-testers-a-comparison-of-software-vulnerability-discovery-processes/paper.cols.txt:271:To identify reporters who successfully submitted vulnerabilities,
2018/CCS/minesweeper-an-in-depth-look-into-drive-by-cryptocurrency-mining-and-its-defense/paper.cols.txt:83:such as UNICEF [40], launched dedicated websites to mine for donations, and legitimate websites are exploring mining in an attempt to
2016/PETS/individual-versus-organizational-computer-security-and-privacy-concerns-in-journ/paper.cols.txt:423:even journalists who understand the risks of insecure
2016/PETS/individual-versus-organizational-computer-security-and-privacy-concerns-in-journ/paper.cols.txt:973:replicated this study with journalists who live in countries with weaker press and speech protections. However, because of Internet technology and the globalization of the media (e.g., [46]) we expect that some of our
papers with a self-reference hit: 80
(end of self-reference hits)

bash scripts/pr_fulltext_grep.sh

2012/IEEE-SP/lastor-a-low-latency-as-aware-tor-client
2013/IEEE-SP/the-crossfire-attack
2013/WWW/two-years-of-short-urls-internet-measurement-security-threats-and-countermeasure
2014/USENIX/man-vs-machine-practical-adversarial-detection-of-malicious-crowdsourcing-worker
2014/USENIX/security-analysis-of-a-full-body-scanner
2015/USENIX/investigating-the-computer-security-practices-and-needs-of-journalists
2016/PETS/individual-versus-organizational-computer-security-and-privacy-concerns-in-journ
2017/IMC/ethical-issues-in-research-using-datasets-of-illicit-origin
2017/PETS/why-privacy-is-all-but-forgotten
2017/USENIX/exploring-user-perceptions-of-discrimination-in-online-targeted-advertising
2017/USENIX/when-the-weakest-link-is-strong-secure-collaboration-in-the-case-of-the-panama-p
2018/CCS/minesweeper-an-in-depth-look-into-drive-by-cryptocurrency-mining-and-its-defense
2018/IEEE-SP/hackers-vs-testers-a-comparison-of-software-vulnerability-discovery-processes
2018/PETS/panoptispy-characterizing-audio-and-video-exfiltration-from-android-applications
2018/USENIX/all-your-gps-are-belong-to-us-towards-stealthy-manipulation-of-road-navigation-s
2018/USENIX/end-to-end-measurements-of-email-spoofing-attacks
2018/USENIX/saql-a-stream-based-query-system-for-real-time-abnormal-system-behavior-detectio
2018/USENIX/understanding-the-reproducibility-of-crowd-reported-security-vulnerabilities
2019/IMC/econ-modeling-the-network-to-improve-application-performance
2019/NDSS/measuring-the-facebook-advertising-ecosystem
2019/NDSS/quantity-vs-quality-evaluating-user-interest-profiles-using-ad-preference-managers
2019/USENIX/less-is-more-quantifying-the-security-benefits-of-debloating-web-applications
2019/WWW/privacy-preserving-crowd-sourcing-of-web-searches-with-private-data-donor
2019/WWW/who-watches-the-watchmen-exploring-complaints-on-the-web
2020/WWW/an-empirical-study-of-the-use-of-integrity-verification-mechanisms-for-web-subre
2021/IMC/identifying-ases-of-state-owned-internet-operators
2021/NDSS/pfirewall-semantics-aware-customizable-data-flow-control-for-smart-home-privacy-protection
2021/USENIX/the-role-of-computer-security-customer-support-in-helping-survivors-of-intimate
2021/WWW/an-experimental-study-to-understand-user-experience-and-perception-bias-occurred
2021/WWW/security-of-alerting-authorities-in-the-www-measuring-namespaces-dnssec-and-web
2021/WWW/short-is-the-road-that-leads-from-fear-to-hate-fear-speech-in-indian-whatsapp-gr
2022/IEEE-SP/heapster-analyzing-the-security-of-dynamic-allocators-for-monolithic-firmware-im
2022/IMC/revealing-the-evolution-of-a-cloud-provider-through-its-network-weather-map
2022/NDSS/auto-draft-200
2022/PETS/on-dark-patterns-and-manipulation-of-website-publishers-by-cmps
2022/USENIX/automated-side-channel-analysis-of-media-software-with-manifold-learning
2022/USENIX/caring-about-sharing-user-perceptions-of-multiparty-data-sharing
2022/USENIX/helping-hands-measuring-the-impact-of-a-large-threat-intelligence-sharing-commun
2022/USENIX/understanding-and-improving-usability-of-data-dashboards-for-simplified-privacy
2022/WWW/link-black-box-detection-of-cross-site-scripting-vulnerabilities-using-reinforce
2023/IMC/does-it-spin-on-the-adoption-and-use-of-quics-spin-bit
2023/PETS/senrev-measurement-of-personal-information-disclosure-in-online-health-communiti
2023/PETS/usability-and-enforceability-of-global-privacy-control   <-- REAL
2023/USENIX/examining-power-dynamics-and-user-privacy-in-smart-technology-use-among-jordania
2023/USENIX/instructions-unclear-undefined-behaviour-in-cellular-network-specifications
2023/USENIX/millions-of-people-are-watching-you-understanding-the-digital-safety-needs-and-p
2023/USENIX/work-from-home-and-covid-19-trajectories-of-endpoint-security-management-in-a-se
2023/WWW/an-empirical-study-of-the-usage-of-checksums-for-web-downloads
2023/WWW/propaganda-politica-pagada-exploring-u-s-political-facebook-ads-en-espanol
2024/CCS/do-anything-now-characterizing-and-evaluating-in-the-wild-jailbreak-prompts-on-l
2024/CCS/i-had-sort-of-a-sense-that-i-was-always-being-watched-since-i-was-examining-inte
2024/CCS/rolling-in-the-shadows-analyzing-the-extraction-of-mev-across-layer-2-rollups
2024/CCS/trust-because-you-cant-verify-privacy-and-security-hurdles-in-education-technolo
2024/IEEE-SP/c-frame-characterizing-and-measuring-in-the-wild-captcha-attacks
2024/IEEE-SP/casual-users-and-rational-choices-within-differential-privacy
2024/IEEE-SP/sok-safer-digital-safety-research-involving-at-risk-users   <-- REAL
2024/NDSS/50-shades-of-support-a-device-centric-analysis-of-android-security-updates
2024/NDSS/drainclog-detecting-rogue-accounts-with-illegally-obtained-nfts-using-classifiers-learned-on-graphs
2024/PETS/simply-tell-me-how-on-trustworthiness-and-technology-acceptance-of-attribute-bas
2024/USENIX/investigating-moderation-challenges-to-combating-hate-and-harassment-the-case-of
2024/USENIX/what-keeps-people-secure-is-that-they-met-the-security-team-deconstructing-drive
2024/WWW/global-news-synchrony-and-diversity-during-the-start-of-the-covid-19-pandemic
2025/IEEE-SP/learning-from-censored-experiences-social-media-discussions-around-censorship-ci
2025/IEEE-SP/restricting-the-link-effects-of-focused-attention-and-time-delay-on-phishing-war
2025/IEEE-SP/study-club-labor-union-or-start-up-characterizing-teams-and-collaboration-in-the
2025/NDSS/the-unusual-suspects-studying-reasons-for-lacking-updates-in-wordpress
2025/PETS/privacy-perceptions-and-behaviors-towards-targeted-advertising-on-social-media-a
2025/PETS/sheeps-clothing-wolfish-intent-automated-detection-and-evaluation-of-problematic
2025/PETS/what-are-they-gonna-do-with-my-data-privacy-expectations-concerns-and-behaviors
2025/USENIX/a-mixed-methods-study-of-open-source-software-maintainers-on-vulnerability-manag
2025/USENIX/understanding-how-users-prepare-for-and-react-to-smartphone-theft
2025/WWW/7-days-later-analyzing-phishing-site-lifespan-after-detected
2025/WWW/causal-modeling-of-climate-activism-on-reddit
2025/WWW/pirates-of-charity-exploring-donation-based-abuses-in-social-media-platforms
2025/WWW/the-agenda-setting-function-of-social-media
2026/NDSS/tickets-to-hide-an-inside-look-into-the-anti-abuse-ecosystem-through-internal-abuse-data
2026/PETS/contextual-intent-activists-privacy-considerations-for-collaborative-technology
2026/USENIX/bridges-to-self-silent-web-to-app-tracking-on-mobile-via-localhost   <-- REAL
2026/USENIX/end-to-end-encrypted-collaborative-documents
2026/WWW/community-fact-checks-do-not-break-follower-loyalty

Quotes spot-checked

Every quote on the content page was checked against the source. Two needed the PDF text layer rather than paper.cols.txt:

Citation Where checked Result
[2Bellini, Rosanna; Tseng, Emily; Warford, Noel; Daffalla, Alaa; Matthews, Tara; Consolvo, Sunny; Woelfer, Jill Palzkill; Kelley, Patrick Gage; Mazurek, Michelle L.; Cuomo, Dana; Dell, Nicola; Ristenpart, Thomas (2024): "SoK: Safer Digital-Safety Research Involving At-Risk Users", in: Proceedings of the IEEE Symposium on Security and Privacy. (DOI)] media passage 2024/IEEE-SP/sok-…/paper.cols.txt :1180–1185 and the PDF text layer (pypdf, page 11) Verified. .cols interleaves the two columns mid-sentence and cuts the passage off at a page break, so the quote on the page was taken from the PDF text layer and each of its phrases confirmed present in .cols. This is the .cols-vs-PDF disagreement documented for two-column ACM/IEEE layouts.
[2Bellini, Rosanna; Tseng, Emily; Warford, Noel; Daffalla, Alaa; Matthews, Tara; Consolvo, Sunny; Woelfer, Jill Palzkill; Kelley, Patrick Gage; Mazurek, Michelle L.; Cuomo, Dana; Dell, Nicola; Ristenpart, Thomas (2024): "SoK: Safer Digital-Safety Research Involving At-Risk Users", in: Proceedings of the IEEE Symposium on Security and Privacy. (DOI)] “overpromise and underdeliver” PDF text layer, page 11 Verified.
[3Zimmeck, Sebastian; Wang, Oliver; Alicki, Kuba; Wang, Jocelyn; Eng, Sophie (2023): "Usability and Enforceability of Global Privacy Control", Proceedings on Privacy Enhancing Technologies 2023(2). (DOI)] disclosure passage 2023/PETS/usability-…/paper.cols.txt :968 (“We have not disclosed any individual finding of”) and “communications staff” (1 occurrence); full passage from the PDF text layer, page 11 Verified.
[4Perez, Daniel; Livshits, Benjamin (2021): "Smart Contract Vulnerabilities: Vulnerable Does Not Imply Exploited", in: Proceedings of the USENIX Security Symposium. (Link)] definitions of vulnerable/exploitable/exploited 2021/USENIX/smart-contract-…/paper.cols.txt :218–251 Verified in .cols directly.
[4Perez, Daniel; Livshits, Benjamin (2021): "Smart Contract Vulnerabilities: Vulnerable Does Not Imply Exploited", in: Proceedings of the USENIX Security Symposium. (Link)] “23,327 vulnerable contracts … only 1.98% … 0.27%” same file, :24–27 (abstract) and :97 Verified.
[5Kotzias, Platon; Razaghpanah, Abbas; Amann, Johanna; Paterson, Kenneth G.; Vallina-Rodriguez, Narseo; Caballero, Juan (2018): "Coming of Age: A Longitudinal Study of TLS Deployment", in: Proceedings of the ACM Internet Measurement Conference. (DOI)] §7.4 “Impact of Security Research” 2018/IMC/coming-of-age-…/paper.cols.txt :1638–1650 Verified.
[6Deuber, Dominic; Keuchen, Michael; Christin, Nicolas (2023): "Assessing Anonymity Techniques Employed in German Court Decisions: A De-Anonymization Experiment", in: Proceedings of the USENIX Security Symposium. (Link)] footnote on federal courts 2023/USENIX/assessing-anonymity-…/paper.cols.txt :417 Verified.
[7Pan, Elleen; Ren, Jingjing; Lindorfer, Martina; Wilson, Christo; Choffnes, David (2018): "Panoptispy: Characterizing Audio and Video Exfiltration from Android Applications", Proceedings on Privacy Enhancing Technologies 2018(4):33-50. (DOI)] “We did not find any true positive audio files…” 2018/PETS/panoptispy-…/paper.cols.txt :560 Verified. Note the .cols line interleaves the two columns, so the sentence is split across the visual line; the words are present and in order.
[8Dubois, Daniel J.; Kolcun, Roman; Mandalari, Anna Maria; Paracha, Muhammad Talha; Choffnes, David; Haddadi, Hamed (2020): "When Speakers Are All Ears: Characterizing Misactivations of IoT Smart Speakers", Proceedings on Privacy Enhancing Technologies 2020(4):255-276. (DOI)] “0.95 misactivations per hour, or 1.43 times for every 10,000 words spoken…” 2020/PETS/when-speakers-…/paper.cols.txt abstract, and the conclusion at :1061 for “we did not find evidence of malicious or intentional misactivations” Verified.
[9Cui, Ang; Costello, Michael; Stolfo, Salvatore J. (2013): "When Firmware Modifications Attack: A Case Study of Embedded Exploitation", in: Proceedings of the Network and Distributed System Security Symposium. (Link)] “Contrary to the sensationalized media coverage…” 2013/NDSS/when-firmware-modifications-attack-…/paper.cols.txt :501 Verified.
[10Smith, C. Estelle; Nevarez, Eduardo; Zhu, Haiyi (2020): "Disseminating Research News in HCI: Perceived Hazards, How-To's, and Opportunities for Innovation", in: Proceedings of the CHI Conference on Human Factors in Computing Systems. (DOI)] §4 Results, §4.1, §4.2 quotes arXiv:2001.04883 PDF, read directly (not in the corpus) Verified.
[11Saemann, Marlene; Theis, Daniel; Urban, Tobias; Degeling, Martin (2022): "Investigating GDPR Fines in the Light of Data Flows", Proceedings on Privacy Enhancing Technologies 2022(4). (DOI)] “856 fines”, “cause … for 295 out of the 856 cases”, “data publication in 111 cases (45%)”, and the conclusion sentence 2022/PETS/investigating-gdpr-fines-in-the-light-of-data-flows/paper.cols.txt :14, :405, :443, :52 Verified, and used more cautiously than Legal enforcement uses it. Two things the sibling page's framing glosses: (a) the 111 cases are personal data exposed in public, i.e. a controller leaking, not a researcher publishing a finding, so “publishing is an enforcement route” is an inference rather than the paper's claim — this page states the inference as an inference; (b) 111/295 = 37.6%, not the 45% the paper reports, which is the same internal inconsistency the sibling page footnotes. Both caveats are in a footnote on the content page.
[1Vlummens, Tim; Girish, Aniketh; Weerasekara, Nipuna; Zuiderveen Borgesius, Frederik; Acar, Gunes; Vallina-Rodriguez, Narseo (2026): "Bridges to Self: Silent Web-to-App Tracking on Mobile via Localhost", in: Proceedings of the USENIX Security Symposium. (Link)] Public Disclosure paragraph, the five decisions, and the outcome claims 2026/USENIX/bridges-to-self-…/paper.cols.txt :1069–1085 (disclosure), :459 and :609 (Yandex and Meta terminating on 3 June 2025), :1096–1102 (timeline table), :996 (acknowledgement of media outreach help) Verified. The “day of disclosure” claim is supported three ways: Meta's variant “discontinued on the day of our public disclosure”, Yandex's “discontinued the practice after our public disclosure” on the same date, and the timeline row “Jun. 2025 — Coordinated public disclosure; Meta and Yandex terminate the observed behavior”.
gamerogarrido2017_legalrisks survey figures (110 respondents; 49.1% feared legal action; 52.7% of those modified a project; 22% threatened) 2017/CCS/quantifying-the-pressure-…/paper.cols.txt :930–943 (population) and :994, :1022 (figures) Verified. The first draft of this bullet cited the paper only as general evidence that “the exposure is real”; the figures were added after reading §4.2 rather than relying on the title.

Bibliography entries added

Generated with node scripts/bibgen.mjs from data/corpus2/.meta (publisher metadata, real DOIs), not from recall. Two USENIX records carry no authors in the index — 100% of USENIX and PETS records do not — so authors were fetched from the USENIX landing page with curl and a browser User-Agent (WebFetch gets 403 from usenix.org), read out of the citation_author meta tags.

Key Paper Author source
bellini2024_safer SoK: Safer Digital-Safety Research Involving At-Risk Users, IEEE S&P 2024 OpenAlex via DOI
perez2021_smart Smart Contract Vulnerabilities: Vulnerable Does Not Imply Exploited, USENIX Security 2021 usenix.org landing page
kotzias2018_coming Coming of Age: A Longitudinal Study of TLS Deployment, IMC 2018 OpenAlex via DOI
deuber2023_assessing Assessing Anonymity Techniques Employed in German Court Decisions, USENIX Security 2023 usenix.org landing page
cui2013_when When Firmware Modifications Attack, NDSS 2013 corpus index (no DOI; cited by NDSS URL)
dubois2020_speakers When Speakers Are All Ears, PoPETs 2020 Crossref via DOI (PoPETs index records carry no authors)
pan2018_panoptispy Panoptispy, PoPETs 2018 Crossref via DOI
smith2020_disseminating Disseminating Research News in HCI, CHI 2020 Crossref via DOI — outside the corpus
sumner2014_exaggeration BMJ 2014;349:g7015 Crossref + PubMed — outside the corpus
bratton2019_replication Wellcome Open Research 2019;4:148 Crossref + PubMed — outside the corpus
adams2019_causality BMC Medicine 2019;17:91 Crossref + Europe PMC — outside the corpus

zimmeck2023_gpc and gamerogarrido2017_legalrisks were already in Bibliography and were reused unchanged. 11 keys were added; all were checked against the 351 existing entries for collisions before appending, and none collided.

One author list was hand-written from recall and was wrong. The first draft of bellini2024_safer listed authors the orchestrator remembered; running bibgen.mjs on the same slug returned a materially different list from OpenAlex, confirmed independently against Crossref. The published entry is the OpenAlex/Crossref one. This is the argument for bibgen.mjs existing: never hand-write an author list, even for a paper you have just read.

External sources: verified

Two Sonnet sub-agents did the fetching, both instructed to use primary sources only, to report a fetch date for every claim, and to return a rejected list. Every load-bearing quote below was then re-fetched and re-verified by the orchestrating model before it went on the page; two are noted as verified-by-agent-only.

Source What it supports How verified
[12Sumner, Petroc; Vivian-Griffiths, Solveiga; Boivin, Jacky; Williams, Andy; Venetis, Christos A.; Davies, Aimée; Ogden, Jack; Whelan, Leanne; Hughes, Bethan; Dalton, Bethan; Boy, Fred; Chambers, Christopher D. (2014): "The Association Between Exaggeration in Health Related Science News and Academic Press Releases: Retrospective Observational Study", BMJ 349:g7015. (DOI)] 40% / 33% / 36% exaggeration in press releases; 58/81/86% vs 17/18/10% in news; ORs 6.5 / 20 / 56; “little evidence that exaggeration in press releases increased the uptake of news” Agent via NCBI E-utilities + Crossref (bmj.com is Cloudflare-gated to curl and WebFetch). Re-verified: sample sizes (n = 462 press releases, 20 UK universities, 2011; n = 668 news stories) pulled directly from the PubMed record for PMID 25498121 on 2026-08-18.
— erratum BMJ 2014;349:g7666 Recorded in the PubMed record as an erratum, not a retraction. Its content could not be retrieved. Stated on the content page as unverified.
[13Bratton, Luke; Adams, Rachel C.; Challenger, Aimée; Boivin, Jacky; Bott, Lewis; Chambers, Christopher D.; Sumner, Petroc (2019): "The Association Between Exaggeration in Health-Related Science News and Academic Press Releases: A Replication Study", Wellcome Open Research 4:148. (DOI)] causal claims replicate (82% vs 16%, OR 23.7); animal-to-human replicates (72% vs 9%, OR 26.5); advice exaggeration does not (49% vs 60%, ns); no uptake effect Agent via PubMed + Europe PMC full-text XML; article metadata flags is-retracted: no. Authors, DOI, volume/pages re-verified against Crossref on 2026-08-18.
[14Adams, Rachel C.; Challenger, Aimée; Bratton, Luke; Boivin, Jacky; Bott, Lewis; Powell, Georgina; Williams, Andy; Chambers, Christopher D.; Sumner, Petroc (2019): "Claims of Causality in Health News: A Randomised Trial", BMC Medicine 17:91. (DOI)] RCT, 312 press releases across 9 press offices, 2,257 news items; “no evidence of lost news uptake” for aligned headlines or for causality caveats; ISRCTN10492618 Agent via Europe PMC full-text XML + Crossref. Authors and DOI re-verified against Crossref on 2026-08-18.
[10Smith, C. Estelle; Nevarez, Eduardo; Zhu, Haiyi (2020): "Disseminating Research News in HCI: Perceived Hazards, How-To's, and Opportunities for Innovation", in: Proceedings of the CHI Conference on Human Factors in Computing Systems. (DOI)] four miscommunication origins (press releases, interviews, media incentives/formats, Web 2.0); all 12 participants had a miscommunication concern; the interview and cherry-picking quotes Fetched and read directly by the orchestrator: arXiv:2001.04883 PDF, §4 Results, §4.1 and §4.2, on 2026-08-18. DOI 10.1145/3313831.3376744 confirmed via Crossref.
[8Dubois, Daniel J.; Kolcun, Roman; Mandalari, Anna Maria; Paracha, Muhammad Talha; Choffnes, David; Haddadi, Hamed (2020): "When Speakers Are All Ears: Characterizing Misactivations of IoT Smart Speakers", Proceedings on Privacy Enhancing Technologies 2020(4):255-276. (DOI)] project page “Are these devices constantly recording our conversations? In short, we found no evidence to support this.”; the scope caveat; the press list including the NYT and Which? headlines Re-fetched independently by the orchestrator from moniotrlab.khoury.northeastern.edu on 2026-08-18, HTTP 200, and both quotes located in the rendered text.
NBC News printer story, HP statement, MIT Tech Review retrospective the 2011 “printers catch fire” case Agent-fetched 2026-08-18, four independent URLs (nbcnews.com, phys.org, foxnews.com, technologyreview.com); HP's wording corroborated across two of them. Verified by agent only — not independently re-fetched.
Northeastern Global News on [7Pan, Elleen; Ren, Jingjing; Lindorfer, Martina; Wilson, Christo; Choffnes, David (2018): "Panoptispy: Characterizing Audio and Video Exfiltration from Android Applications", Proceedings on Privacy Enhancing Technologies 2018(4):33-50. (DOI)] the institutional framing of a null result Agent-fetched 2026-08-18. Verified by agent only.
Science Media Centre 10 best practice guidelines live (HTTP 200); Before the Headlines discontinued — “Please note that we no longer offer this service”, latest appraisal December 2019 Agent-fetched from sciencemediacentre.org on 2026-08-18. This is exactly the kind of thing training data gets wrong: the service is widely recommended in older advice and no longer exists.
Venue press/embargo policies (7 rows) the embargo table Agent-fetched each venue's own 2026 site on 2026-08-18. USENIX embargo wording and IEEE S&P “immediately published, open access” wording are verbatim. ACM DL full open access from 2026-01-01 confirmed via ACM's own bulletin after acm.org blocked automated fetches.

External sources: rejected

Source Why rejected
Ten trade-press and vendor blog posts on “branded vulnerabilities” (Dark Reading, Red Hat blog, Axios, SC Media, Security Boulevard, CSO Online, Medium posts, heretek.co.uk, ThreatDown) No peer-reviewed study of the branding effect on attention or patching was found. These are opinion pieces. The page states the negative rather than citing them. This row exists to stop the next run re-adding them.
Mouseflow's response to the Princeton session-replay study Could not be fetched (live URL 404s, no Wayback snapshot found); only search-snippet paraphrase available. The underlying artefact is also a CITP blog post, not the peer-reviewed paper. Dropped as unverifiable.
Reyes et al. 2018 COPPA coverage Coverage tracks the paper's own hedged “potentially violating”; no author statement of misrepresentation found. There is no documented gap, so there is no case.
“X% of sites violate GDPR” headline cases No instance found where a specific headline's number diverged from a specific paper's claim with author pushback on the record. General commentary about non-compliance is not a documented case.
Sumner et al. 2016 (PLOS ONE, journal press releases) A different study, sometimes conflated with the replication. Not the Bratton replication and not cited.
Schat et al. 2018, Buhse et al. 2018 Named as partial replications inside [13Bratton, Luke; Adams, Rachel C.; Challenger, Aimée; Boivin, Jacky; Bott, Lewis; Chambers, Christopher D.; Sumner, Petroc (2019): "The Association Between Exaggeration in Health-Related Science News and Academic Press Releases: A Replication Study", Wellcome Open Research 4:148. (DOI)]'s introduction but not independently fetched. Not cited.
ResearchGate / d-nb.info mirrors, stempra.org.uk blog, Wikipedia “News embargo”, acmedsci.ac.uk one-pager Secondary mirrors and summaries; the primary APIs (Crossref, Europe PMC, NCBI) were used instead.
ACM / IEEE / USENIX / IAPP / FIRST author-facing media guidance Checked, none found. FIRST's multi-party coordination guidelines v1.1 cover vendor embargoes, not press. Reported as a negative on the content page.

Method note worth carrying to the next run: WebFetch returned wrong article content for several PMC and BMJ URLs during this run (unrelated crystallography and cardiology papers), and hit Cloudflare or 403 on bmj.com, acm.org, pubmed.ncbi.nlm.nih.gov and usenix.org. Everything load-bearing was therefore cross-checked through a second channel — NCBI E-utilities, the Crossref API, or Europe PMC full-text XML, via curl. Do not trust a single WebFetch response for a numbered claim.

Reviewer findings

Four reviewers, all told explicitly that the orchestrator's context might not be exhaustive, all handed the page text, both scripts, their unedited output and these notes. The three focused ones ran in parallel first; the generic one ran afterwards on the corrected text.

Sonnet — figures versus script

Re-ran both scripts and diffed against the committed output: byte-identical. Checked every figure on both pages.

Finding Verdict
pr_fulltext_grep.sh has 20 terms in TERMS, not 19 as both pages claimed. The 674 / 5,869 / 11.5% figures and the per-term breakdown are correct; only the count of terms was wrong. Accepted, fixed on both pages. A factual claim about the script's own mechanics, and trivially checkable.
The fold-family row labelled “an actual press contact” reads as a positive finding to anyone who skims the table without the paragraph under it. Accepted, fixed. The row now says the mention is in a genuine press sense and that neither paper is about the paper's own press engagement, pointing at the paragraph.
“fourteen months later” for the gap between the November 2011 NBC story and NDSS 2013 (24–27 February 2013) is nearer fifteen. Accepted, fixed — “published at NDSS fifteen months later”.
No case found of a figure computed over one population and attributed to another. The 4,472 denominator cross-checks against Notifying websites's independently computed 48.3%. Confirmation, no action.
Could not re-fetch the NBC News article (403 to its tooling); noted that the page already discloses this class of limitation. No action — but see the external-currency reviewer, which found the undisclosed instance.

Sonnet — citations and quotes

Finding Verdict
BLOCKING: the bellini2024_safer author list shipped in pages/bib_additions_public_relations.bib was still the hand-written, wrong one — missing Consolvo, Kelley, Mazurek and Cuomo, giving “Su” for Woelfer, and inventing two authors who are not on the paper. The provenance page already described catching and fixing this; the fix had silently no-oped because the patch string did not match the file. Accepted, fixed. The entry was regenerated with node scripts/bibgen.mjs and spliced in programmatically, with an assertion on the presence of the real names. This is the finding that justifies the whole review layer: a provenance page claiming a correction was made is worthless if nobody checks the artefact, and the page was claiming exactly that.
All {[key]} markers resolve (13 at the time of review; 15 after the generic reviewer's fixes added vlummens2026_bridges and saemann2022_fines, both already in the bibliography); no collisions with the existing bibliography; braces balanced; every other new entry's authors, title, year, volume/pages and DOI match Crossref or OpenAlex. Confirmation, no action.
Every quote from every cited paper verified verbatim, including the two that needed the PDF text layer, and every external quote re-fetched independently (NBC via the Wayback Machine, MIT Tech Review via Wayback, the SMC pages live, the project page live). Confirmation, no action.
No overclaiming found beyond what the page already self-flags. Confirmation, no action.

Sonnet — external currency

Finding Verdict
The phys.org URL for HP's statement returns HTTP 403 behind Cloudflare Turnstile, and its footnote asserted a successful fetch with no caveat — unlike the bmj.com footnote on the same page, which does disclose exactly this. Accepted, fixed. The footnote now leads with foxnews.com (HTTP 200, quote confirmed word-for-word by two independent checks) as the source of record, and states plainly that phys.org is Cloudflare-gated and could not be independently re-fetched.
TheWebConf 2026 has been held (29 June – 3 July 2026) and its call-for-papers pages now 404, so that row of the embargo table is no longer verifiable against the artefact originally checked — only against the current homepage, which still contains no press or media language. Accepted, fixed. The table's footnote now says so.
sp2026.ieee-security.org's own navigation has a press.html link that 404s. Noted, no page change. Not a claim on the page, and if anything it supports the “no press policy” row. Recorded here so a future run does not spend time on it.
All other URLs resolve; all seven venue rows re-verified live; the SMC discontinuation text and its December 2019 last appraisal confirmed exactly; ACM full open access from 2026-01-01 confirmed via ACM's own bulletin; FIRST has a press policy but it concerns journalist accreditation at its conference, not researcher guidance, so the page's “none found” stands. Confirmation, no action.

Fable — generic

The most productive of the four. It was given no checklist and told the other three had already covered figures, citations and external currency.

Finding Verdict
BLOCKING: the page's central negative claim was false. “Only two papers … the entire documented practice of seven venues over seventeen years” — there is a third, [1Vlummens, Tim; Girish, Aniketh; Weerasekara, Nipuna; Zuiderveen Borgesius, Frederik; Acar, Gunes; Vallina-Rodriguez, Narseo (2026): "Bridges to Self: Silent Web-to-App Tracking on Mobile via Localhost", in: Proceedings of the USENIX Security Symposium. (Link)], with a dedicated Public Disclosure subsection, and Legal enforcement already cited it, so the two pages contradicted each other. Accepted in full. The regex was widened and re-run (59 → 80 candidates, 2 → 3 real hits, and the bridges paper is the only new real hit); the paper is now the first of the three worked cases, because it is the most complete and the most actionable; every “only two” / “entire documented practice” claim is rewritten; the “zero of 4,472” claim is re-scoped to what it actually is, a statement about a 20-word structured field; and the page now says in two places that three is a floor. See the box under Full-text sweep for the two process lessons.
BLOCKING: TODO-GENERIC placeholder on the provenance page. Accepted; this section.
The foundViolations prose misread its own multi-valued table, and 177/44.0% collided numerically with a different claim carrying the same two numbers on Legal enforcement. Accepted in full. The script now computes both tabulations, the page publishes the per-paper one (37.6%) and states the reconciliation, and “deliberately” is gone.
The lead box states the page's most contestable figure with none of its caveats, 50 lines before they arrive, and “about half of this field's own writing” overstates what a model-selected sentence can support. Accepted. The box now carries the proxy caveat in its own second sentence, and the “field's own writing” phrasing is gone from both the box and the trend paragraph.
“The asymmetry is not because press engagement is rare; it is because it is not reported” asserts exactly what its own footnote concedes cannot be shown. Accepted. Rewritten to say the corpus cannot separate the two readings, which is true and implies the same thing for the reader.
The three subjective-statement footnotes say “add your name here if you agree” but carry no name, where Contributing asks for one. Accepted, with a caveat rather than a signature. The footnotes now say plainly that the page was drafted by Claude and that no named researcher has vouched for the judgement calls. A model cannot satisfy a convention whose point is that a person stands behind the claim; saying so is the honest substitute.
Legal enforcement promises “Public relations — publication as the other enforcement route, per [11Saemann, Marlene; Theis, Daniel; Urban, Tobias; Degeling, Martin (2022): "Investigating GDPR Fines in the Light of Data Flows", Proceedings on Privacy Enhancing Technologies 2022(4). (DOI)]”, and this page never mentioned it — while resting Publicity is an instrument on two anecdotes from [5Kotzias, Platon; Razaghpanah, Abbas; Amann, Johanna; Paterson, Kenneth G.; Vallina-Rodriguez, Narseo; Caballero, Juan (2018): "Coming of Age: A Longitudinal Study of TLS Deployment", in: Proceedings of the ACM Internet Measurement Conference. (DOI)]. Accepted. [11Saemann, Marlene; Theis, Daniel; Urban, Tobias; Degeling, Martin (2022): "Investigating GDPR Fines in the Light of Data Flows", Proceedings on Privacy Enhancing Technologies 2022(4). (DOI)] is now the first item in that section, with the 111-of-295 figure and the tension against [3Zimmeck, Sebastian; Wang, Oliver; Alicki, Kuba; Wang, Jocelyn; Eng, Sophie (2023): "Usability and Enforceability of Global Privacy Control", Proceedings on Privacy Enhancing Technologies 2023(2). (DOI)]'s withholding.
The embargo footnote contradicted itself: a row “fetched from www2026.thewebconf.org on 2026-08-18” and, in the same footnote, that page returning 404 on the same day. Accepted; the footnote now states once that the row rests on the current homepage because the call-for-papers pages are gone.
Two overlapping checklists where both neighbours have exactly one. Accepted. Merged into What to prepare, and what to check — five artefacts, then four decisions no artefact covers.
No “Papers to read first” section, and Methodology placed before Related pages, where both neighbours do the reverse. Accepted; both fixed.
5,869 full-text files vs 5,859 records, unexplained on this page where the sibling explains it. Accepted; footnoted at first use.
Unsupported superlatives: “the hardest thing to get reported”, “the single most likely thing to happen to a web-measurement finding”. Accepted; both softened to what the evidence supports.
Praise: the ladder section, the embargo table, the “direction, not decimals” framing, and this page's Scope decision section. Recorded, no action.

Re-review after the fixes

The figures reviewer and the citations reviewer were both re-run against the revised text, since findings from both had been acted on. Both came back clean.

  • Figures, re-run. Both scripts re-run from scratch and diffed byte-for-byte against the committed output; the worst case wins precedence checked and confirmed to sum to 402 and to agree with Legal enforcement; the 80-candidate sweep reproduced and diffed slug-for-slug against the list embedded on this page; the 20-term count, all five year-bucket rows including the two new columns, and the [11Saemann, Marlene; Theis, Daniel; Urban, Tobias; Degeling, Martin (2022): "Investigating GDPR Fines in the Light of Data Flows", Proceedings on Privacy Enhancing Technologies 2022(4). (DOI)] and [1Vlummens, Tim; Girish, Aniketh; Weerasekara, Nipuna; Zuiderveen Borgesius, Frederik; Acar, Gunes; Vallina-Rodriguez, Narseo (2026): "Bridges to Self: Silent Web-to-App Tracking on Mobile via Localhost", in: Proceedings of the USENIX Security Symposium. (Link)] figures all verified against source. No blocking or should-fix findings. It independently re-derived the saemann2022_fines 45%-vs-37.6% discrepancy and confirmed the footnote already discloses it.
  • Citations, re-run. bellini2024_safer confirmed correct in both shipped artefacts this time — the .bib and the full spliced bibliography — against Crossref. The bibliography diff confirmed as a pure append: 351 → 362 entries, block inserted before </bibtex>, no other line changed. All 15 keys resolve exactly once. All quotes re-verified verbatim, including the two-column-split ones. No findings. It noted that the saemann2022_fines paragraph was being edited while it read, and re-read to a stable state before reporting — worth knowing if you re-run reviewers against a live workdir.

What this reviewer's findings say about the other three. All three focused reviewers passed the page while its headline claim was false, because none of them was asked whether the claim was true — only whether it matched the script, the sources and the live web. It did, on all three counts: the script faithfully reported what the regex found, and the regex was wrong. The generic slot earned its place in this run and should not be dropped.

What could not be established

  • Whether press engagement is actually rare, or just unreported. The corpus can only show the second. CHI and SOUPS are absent from the corpus and are where the at-risk and usable-security communities publish — the one paper here with press advice is from that community. Re-running section A over CHI and SOUPS is the single highest-value follow-up.
  • Whether a paper's own publicity contaminates its follow-up measurement of the same population. Nothing in the corpus measures this. It is flagged on the content page as an open question with a footnote, not as a finding.
  • Any figure at all on how often a measurement result is misreported. No paper in these seven venues measures the accuracy of press coverage of security or privacy research.
  • The true number of papers that document their own press handling. Three is a floor from a keyword sweep that is now known to have under-recalled once. The only way to raise confidence is a different method — e.g. classifying every ethics and Disclosure section rather than grepping — which was not run.
  • Why the denomination rate is falling. The script now decomposes the trend against the obvious confounder — the rising share of model-performance figures — and the confounder does not account for it: performance figures rise from 12.9% to 21.9% of sentences, while denomination among non-performance sentences falls from 67.8% (n=866) to 51.3% (n=1,732). So the fall is not an artefact of subject matter alone. What it is remains unestablished; plausible candidates the corpus cannot separate are longer and more compressed result sentences, more tables carrying the denominator instead of the prose, and drift in what the extraction model selects as an evidence quote. The content page says only that the fall survives the decomposition.

Publication

Step Detail
Bibliography literature:bibliography rev 1787051260 → 1787067695, +11 entries, 351 → 362. Saved with –if-rev so a concurrent edit would have refused rather than overwritten. Diff verified as a pure append before saving.
Content page practices:public_relations, new, 55,966 bytes
This page provenance:practices:public_relations, new
Reachability start already linked Public relations; no new link was needed.

The bibtex4dw plugin serves a cached bibliography, and a stale cache fails silently. Immediately after publishing, the content page rendered 22 inline citekey markers and a reference list numbered to [15] — but the list contained only the 4 keys that already existed before the bibliography edit. No purple warning, no missing-citation marker. Requesting ?purge=true on literature:bibliography and then on the citing page fixed it; all 15 then rendered.

So the standard check — “the rendered page shows a bibtex_references list” — passes on a stale cache. Count the entries in the rendered list against the number of distinct {[key]} markers on the page, and purge both pages after any bibliography edit.

Back to the content page: Public relations. Corpus-wide caveats: Corpus.

References

[1]
Vlummens, Tim; Girish, Aniketh; Weerasekara, Nipuna; Zuiderveen Borgesius, Frederik; Acar, Gunes; Vallina-Rodriguez, Narseo (2026): "Bridges to Self: Silent Web-to-App Tracking on Mobile via Localhost", in: Proceedings of the USENIX Security Symposium. (Link)
[2]
Bellini, Rosanna; Tseng, Emily; Warford, Noel; Daffalla, Alaa; Matthews, Tara; Consolvo, Sunny; Woelfer, Jill Palzkill; Kelley, Patrick Gage; Mazurek, Michelle L.; Cuomo, Dana; Dell, Nicola; Ristenpart, Thomas (2024): "SoK: Safer Digital-Safety Research Involving At-Risk Users", in: Proceedings of the IEEE Symposium on Security and Privacy. (DOI)
[3]
Zimmeck, Sebastian; Wang, Oliver; Alicki, Kuba; Wang, Jocelyn; Eng, Sophie (2023): "Usability and Enforceability of Global Privacy Control", Proceedings on Privacy Enhancing Technologies 2023(2). (DOI)
[4]
Perez, Daniel; Livshits, Benjamin (2021): "Smart Contract Vulnerabilities: Vulnerable Does Not Imply Exploited", in: Proceedings of the USENIX Security Symposium. (Link)
[5]
Kotzias, Platon; Razaghpanah, Abbas; Amann, Johanna; Paterson, Kenneth G.; Vallina-Rodriguez, Narseo; Caballero, Juan (2018): "Coming of Age: A Longitudinal Study of TLS Deployment", in: Proceedings of the ACM Internet Measurement Conference. (DOI)
[6]
Deuber, Dominic; Keuchen, Michael; Christin, Nicolas (2023): "Assessing Anonymity Techniques Employed in German Court Decisions: A De-Anonymization Experiment", in: Proceedings of the USENIX Security Symposium. (Link)
[7]
Pan, Elleen; Ren, Jingjing; Lindorfer, Martina; Wilson, Christo; Choffnes, David (2018): "Panoptispy: Characterizing Audio and Video Exfiltration from Android Applications", Proceedings on Privacy Enhancing Technologies 2018(4):33-50. (DOI)
[8]
Dubois, Daniel J.; Kolcun, Roman; Mandalari, Anna Maria; Paracha, Muhammad Talha; Choffnes, David; Haddadi, Hamed (2020): "When Speakers Are All Ears: Characterizing Misactivations of IoT Smart Speakers", Proceedings on Privacy Enhancing Technologies 2020(4):255-276. (DOI)
[9]
Cui, Ang; Costello, Michael; Stolfo, Salvatore J. (2013): "When Firmware Modifications Attack: A Case Study of Embedded Exploitation", in: Proceedings of the Network and Distributed System Security Symposium. (Link)
[10]
Smith, C. Estelle; Nevarez, Eduardo; Zhu, Haiyi (2020): "Disseminating Research News in HCI: Perceived Hazards, How-To's, and Opportunities for Innovation", in: Proceedings of the CHI Conference on Human Factors in Computing Systems. (DOI)
[11]
Saemann, Marlene; Theis, Daniel; Urban, Tobias; Degeling, Martin (2022): "Investigating GDPR Fines in the Light of Data Flows", Proceedings on Privacy Enhancing Technologies 2022(4). (DOI)
[12]
Sumner, Petroc; Vivian-Griffiths, Solveiga; Boivin, Jacky; Williams, Andy; Venetis, Christos A.; Davies, Aimée; Ogden, Jack; Whelan, Leanne; Hughes, Bethan; Dalton, Bethan; Boy, Fred; Chambers, Christopher D. (2014): "The Association Between Exaggeration in Health Related Science News and Academic Press Releases: Retrospective Observational Study", BMJ 349:g7015. (DOI)
[13]
Bratton, Luke; Adams, Rachel C.; Challenger, Aimée; Boivin, Jacky; Bott, Lewis; Chambers, Christopher D.; Sumner, Petroc (2019): "The Association Between Exaggeration in Health-Related Science News and Academic Press Releases: A Replication Study", Wellcome Open Research 4:148. (DOI)
[14]
Adams, Rachel C.; Challenger, Aimée; Bratton, Luke; Boivin, Jacky; Bott, Lewis; Powell, Georgina; Williams, Andy; Chambers, Christopher D.; Sumner, Petroc (2019): "Claims of Causality in Health News: A Randomised Trial", BMC Medicine 17:91. (DOI)
provenance/practices/public_relations.txt · Last modified: by karel.kubicek.claude

Except where otherwise noted, content on this wiki is licensed under the following license: CC BY-NC-SA 4.0
CC BY-NC-SA 4.0 Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki