https://measuretheweb.org/ 2026-05-06T11:59:07+00:00 https://measuretheweb.org/ https://measuretheweb.org/_media/wiki/dokuwiki.svg text/html 2025-01-03T17:41:24+00:00 Anonymous (anonymous@undisclosed.example.com) https://measuretheweb.org/programming/crux?rev=1735926084&do=diff Chrome User Experience Report (CrUX) The Chrome User Experience Report (also known as the Chrome UX Report, or CrUX for short) is a dataset that reflects how real-world Chrome users experience popular destinations on the web. CrUX data is collected from real browsers around the world, based on certain browser options which determine text/html 2025-03-19T08:51:51+00:00 Anonymous (anonymous@undisclosed.example.com) https://measuretheweb.org/programming/interaction?rev=1742374311&do=diff Interaction with website This page only contains notes Topics to cover (in separate pages): * Input into website forms * Interacting with consent * Stateful and stateless crawling * Urban et al. studied crawling only index pages vs crawling multiple subpages of a website, showing significant increase in third-party requests and cookies when you browse also subpages. From 10 visited subpages is increase small. text/html 2025-04-18T16:49:29+00:00 Anonymous (anonymous@undisclosed.example.com) https://measuretheweb.org/programming/multilingual_support?rev=1744994969&do=diff Multilingual Support Much of the web research focuses on English websites, often resonating with the target group of English-written publications. However, this focus causes our research field to neglect other target audiences, especially those where security and privacy issues may have larger implications than in the Western world. This limitation in research scope was also identified by Mhaidli et al. in Sec. 4.4.2 of text/html 2025-02-18T15:27:18+00:00 Anonymous (anonymous@undisclosed.example.com) https://measuretheweb.org/programming/registration?rev=1739892438&do=diff Automating Login and Registration to Websites WiP: brainstorming below. Automated Login Shepherd by Jonker et al. (2020) SSO How to use it for large scale web measurements, references to: * Dimova et al. (2023) * Ghasamisharif et al. (2018) text/html 2026-03-24T09:34:11+00:00 Anonymous (anonymous@undisclosed.example.com) https://measuretheweb.org/programming/similarweb?rev=1774344851&do=diff While official API use is paid, Similarweb offers a browser extension, which uses an internal API to retrieve data. Methodology for Code Reproduction To update the scraper logic when Similarweb changes their verification, follow these steps: * Install the extension in a Chromium-based browser. text/html 2025-03-19T08:56:12+00:00 Anonymous (anonymous@undisclosed.example.com) https://measuretheweb.org/programming/stateful_stateless?rev=1742374572&do=diff Stateful and Stateless Crawling This page only contains notes Key message: * Majority of web measurements studies use stateless crawls, as it is easy to associate events with the single browsed visited website. Also, stateless crawls do not depend on crawling order and are easier to parallelize.