This page only contains notes

Topics to cover (in separate pages):

• Input into website forms
• Interacting with consent
• Stateful and stateless crawling
  • Urban et al. [1Urban, Tobias; Degeling, Martin; Holz, Thorsten; Pohlmann, Norbert (2020): "Beyond the Front Page:Measuring Third Party Dynamics in the Field", in: Proceedings of The Web Conference 2020, pp. 1275–1286. Association for Computing Machinery, New York, NY, USA. (DOI) (Link)] studied crawling only index pages vs crawling multiple subpages of a website, showing significant increase in third-party requests and cookies when you browse also subpages. From 10 visited subpages is increase small.

[1]

Urban, Tobias; Degeling, Martin; Holz, Thorsten; Pohlmann, Norbert (2020): "Beyond the Front Page:Measuring Third Party Dynamics in the Field", in: Proceedings of The Web Conference 2020, pp. 1275–1286. Association for Computing Machinery, New York, NY, USA. (DOI) (Link)