| Both sides previous revisionPrevious revisionNext revision | Previous revision |
| provenance:design:user_studies [2026/08/27 14:24] – Log focused GPT 5.6 Luna medium reviews; apply snippet-refresh finding. Authored by Claude. karel.kubicek.claude | provenance:design:user_studies [2026/09/17 07:23] (current) – Markup rendering sweep: wrap escapes, CLI flag typography, and heading quotes. Authored by Claude. karel.kubicek.claude |
|---|
| ==== COMP_FAMILIES ==== | ==== COMP_FAMILIES ==== |
| |
| Single-label, ordered unpaid → course-credit → raffle → hourly → gift-card → stated-amount. Unmapped compensation strings: **139 tuples**. Sentinel written into the field: 1 tuple. Papers with no compensation string: 611. Pass ''--residue'' after the crowd list; compensation residue is printed when that flag is on (same flag, later section). Not listed here in full — 139 free-text strings, reproducible. | Single-label, ordered unpaid → course-credit → raffle → hourly → gift-card → stated-amount. Unmapped compensation strings: **139 tuples**. Sentinel written into the field: 1 tuple. Papers with no compensation string: 611. Pass ''%%--residue%%'' after the crowd list; compensation residue is printed when that flag is on (same flag, later section). Not listed here in full — 139 free-text strings, reproducible. |
| |
| ==== LARGE_N ==== | ==== LARGE_N ==== |
| ==== Generic pass — no checklist ==== | ==== Generic pass — no checklist ==== |
| |
| (Filled after that pass.) | ^ # ^ Sev ^ Finding ^ Decision ^ |
| | | 1 | MEDIUM | ''humanSubjects'' reads as adjudicated human-subjects research rather than an extraction signal. | **Accepted in part.** One sentence added: it is ''participants[]'' non-empty, not a hand-adjudicated IRB determination, and n≥10,000 includes visitors and donated panels. Not renamed throughout — the name is OVERVIEW.md's. | |
| | | 2 | HIGH | "One human-subjects paper in three does not name how people were recruited" overstates: could be extraction failure. | **Rejected as HIGH, accepted as wording.** Sentinel-only is the site's standard finding for this field. Changed to "in the extraction, one … has no named recruitment channel." The 454/1,357 figure is unchanged. | |
| | | 3 | MEDIUM | 2024 Prolific-over-MTurk crossover is full-text upper bound presented as history. | **Accepted.** Now states the crossover is on the recovered-full-text series; quote-only already has Prolific 102 vs MTurk 92 overall; schema-only is later. | |
| | | 4 | MEDIUM | "venues will reject on ethics with the technical review untouched" is an absolute policy claim. | **Accepted.** Replaced with a pointer to [[practices:ethics]] and that page's "six of the seven" caveat. | |
| | | 5 | LOW | Qualtrics 124 presented more firmly than crowd-platform recovery. | **Accepted.** Now "full-text hits, upper bound". | |
| | | 6 | LOW | "Preregistration already normal on this side" is uncited here. | **Accepted.** Softened to a pointer: counts live on [[statistics:study_preregistration]], not re-derived here. | |
| | |
| | ===== Markup sweep, 2026-09-17 ===== |
| | |
| | Mechanical rendering repair only: a fresh live raw/XHTML export of 188 pages was checked with ''check_wrap.mjs'' and ''check_typography.mjs''. Affected plugin tags, CLI flags and heading markup were repaired; no figures or substantive prose were changed. The resulting source and rendered DOM were re-checked after saving. |
| |