| Both sides previous revisionPrevious revisionNext revision | Previous revision |
| provenance:statistics:interrater_agreement [2026/08/20 21:24] – Correct the review-log header: five review passes, not four (the figures pass was re-run after its findings were acted on). Authored by Claude karel.kubicek.claude | provenance:statistics:interrater_agreement [2026/09/17 08:14] (current) – Qualify root start link; Authored by Claude karel.kubicek.claude |
|---|
| * **[[Statistics:Hypothesis testing]]** is about inference on measurements. Reliability of the measurements is upstream of it, and that page is already 63 kB. | * **[[Statistics:Hypothesis testing]]** is about inference on measurements. Reliability of the measurements is upstream of it, and that page is already 63 kB. |
| |
| The ''statistics:'' namespace was chosen over ''design:'' because the deliverable is a coefficient and a reporting standard, matching its five siblings. It is linked from [[start]] in the statistics line and from [[Practices:Ethics]]; those edits were made in the same sitting as this page, from the same run. | The ''statistics:'' namespace was chosen over ''design:'' because the deliverable is a coefficient and a reporting standard, matching its five siblings. It is linked from [[:start]] in the statistics line and from [[Practices:Ethics]]; those edits were made in the same sitting as this page, from the same run. |
| |
| ===== Denominators used on the page ===== | ===== Denominators used on the page ===== |
| ^ # ^ Reviewer ^ Finding ^ Action ^ | ^ # ^ Reviewer ^ Finding ^ Action ^ |
| | 1 | citations | **A quote was attributed to the wrong paper.** The page had Sun, Vekaria & Nithyanand {[sun2026_suitability]} saying their annotators worked //"without seeing LLM responses"//. A full-file grep of that paper finds the phrase nowhere. The sentence is in fact from Zhang et al. {[zhang2025_abusability]}, USENIX Security 2025, whose extraction record sits a few lines away in the same query output. **This is the most serious defect the review caught and it was an authoring error, not an extraction error** — the quote was real, the attribution was not. | Re-attributed to {[zhang2025_abusability]}, verified in that paper's full text, entry added to the bibliography, spot-check table row added above. | | | 1 | citations | **A quote was attributed to the wrong paper.** The page had Sun, Vekaria & Nithyanand {[sun2026_suitability]} saying their annotators worked //"without seeing LLM responses"//. A full-file grep of that paper finds the phrase nowhere. The sentence is in fact from Zhang et al. {[zhang2025_abusability]}, USENIX Security 2025, whose extraction record sits a few lines away in the same query output. **This is the most serious defect the review caught and it was an authoring error, not an extraction error** — the quote was real, the attribution was not. | Re-attributed to {[zhang2025_abusability]}, verified in that paper's full text, entry added to the bibliography, spot-check table row added above. | |
| | 2 | figures | **Undisclosed denominator.** "the median double-coded sample here is 385 items and 22% double-code fewer than 50" appeared on the content page with no population named. The figures are over the **457** papers that name a statistic //and// state a coded sample size (89.3% of the 512). | Denominator stated in the ''<WRAP>'' block, again beside the simulation, and again in the methodology list. | | | 2 | figures | **Undisclosed denominator.** "the median double-coded sample here is 385 items and 22% double-code fewer than 50" appeared on the content page with no population named. The figures are over the **457** papers that name a statistic //and// state a coded sample size (89.3% of the 512). | Denominator stated in the ''%%<WRAP>%%'' block, again beside the simulation, and again in the methodology list. | |
| | 3 | citations | **A quote reordered its source's clauses.** The page printed //"average 0.81; range 0.64–0.93"// as a direct quote from {[skolka2019_anything]}; the paper says //"The pairwise agreement ranges between 0.64 and 0.93, with an average of 0.81"//. Content identical, word order not. | Replaced with the paper's own sentence, verbatim. | | | 3 | citations | **A quote reordered its source's clauses.** The page printed //"average 0.81; range 0.64–0.93"// as a direct quote from {[skolka2019_anything]}; the paper says //"The pairwise agreement ranges between 0.64 and 0.93, with an average of 0.81"//. Content identical, word order not. | Replaced with the paper's own sentence, verbatim. | |
| | 4 | citations | **Bibliographic error.** {[khatun2026_disclosure]} was entered with ''number = {3}''; the DOI record says issue 4. | Corrected before the bibliography was saved. | | | 4 | citations | **Bibliographic error.** {[khatun2026_disclosure]} was entered with ''number = {3}''; the DOI record says issue 4. | Corrected before the bibliography was saved. | |
| |
| <bibtex bibliography></bibtex> | <bibtex bibliography></bibtex> |
| | |
| | ===== Markup sweep, 2026-09-17 ===== |
| | |
| | Mechanical rendering repair only: a fresh live raw/XHTML export of 188 pages was checked with ''check_wrap.mjs'' and ''check_typography.mjs''. Affected plugin tags, CLI flags and heading markup were repaired; no figures or substantive prose were changed. The resulting source and rendered DOM were re-checked after saving. |
| | |
| | ===== Link-hygiene sweep, 2026-09-17 ===== |
| | |
| | The fresh rendered-DOM sweep found this page's bare ''start'' link resolved to ''provenance:statistics:start''. It is now root-anchored; the post-save DOM was re-checked for red links. No figures or citations changed. |
| |
