User Tools

Site Tools


provenance:design:user_studies

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
provenance:design:user_studies [2026/08/27 14:24] – Log focused GPT 5.6 Luna medium reviews; apply snippet-refresh finding. Authored by Claude. karel.kubicek.claudeprovenance:design:user_studies [2026/08/27 14:26] (current) – Log generic GPT 5.6 Luna medium pass accept/reject. Authored by Claude. karel.kubicek.claude
Line 690: Line 690:
 ==== Generic pass — no checklist ==== ==== Generic pass — no checklist ====
  
-(Filled after that pass.)+^ # ^ Sev ^ Finding ^ Decision ^ 
 +| 1 | MEDIUM | ''humanSubjects'' reads as adjudicated human-subjects research rather than an extraction signal. | **Accepted in part.** One sentence added: it is ''participants[]'' non-empty, not a hand-adjudicated IRB determination, and n≥10,000 includes visitors and donated panels. Not renamed throughout — the name is OVERVIEW.md's. | 
 +| 2 | HIGH | "One human-subjects paper in three does not name how people were recruited" overstates: could be extraction failure. | **Rejected as HIGH, accepted as wording.** Sentinel-only is the site's standard finding for this field. Changed to "in the extraction, one … has no named recruitment channel." The 454/1,357 figure is unchanged. | 
 +| 3 | MEDIUM | 2024 Prolific-over-MTurk crossover is full-text upper bound presented as history. | **Accepted.** Now states the crossover is on the recovered-full-text series; quote-only already has Prolific 102 vs MTurk 92 overall; schema-only is later. | 
 +| 4 | MEDIUM | "venues will reject on ethics with the technical review untouched" is an absolute policy claim. | **Accepted.** Replaced with a pointer to [[practices:ethics]] and that page's "six of the seven" caveat. | 
 +| 5 | LOW | Qualtrics 124 presented more firmly than crowd-platform recovery. | **Accepted.** Now "full-text hits, upper bound". | 
 +| 6 | LOW | "Preregistration already normal on this side" is uncited here. | **Accepted.** Softened to a pointer: counts live on [[statistics:study_preregistration]], not re-derived here|
  
provenance/design/user_studies.1787840641.txt.gz · Last modified: by karel.kubicek.claude

Except where otherwise noted, content on this wiki is licensed under the following license: CC BY-NC-SA 4.0
CC BY-NC-SA 4.0 Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki