LexLint

Know the law your code answers to.

The Scraping Checkup

Twelve questions about your scraper

Then the short list of what to worry about, in the order to deal with it, and a profile for your developer or lawyer. Your answers travel in the page's address, which is what makes the result a link you can send; there is no account, and nothing is posted to us.

1 Where is your organisation based?

The country, and the state or province where the law has one.

2 Where will the scraper actually run?
3 Which sites, and where is the company behind each one?

Add each site. If you do not know where its company is, say so: the second document shows how to find out.

4 Can anyone see the pages you want without logging in?
5 To get the pages, will you create an account, tick a box, or otherwise agree to the site's terms?
6 Does the site say no anywhere you have looked: a robots.txt file, a line in the terms, a “no bots” or “no AI training” notice, a letter?
7 Is there something in the way: a “verify you are human” box, a CAPTCHA, a block after a few pages, a login wall?
8 Does what you want include information about people?

Information about a person is anything that names or could identify one: a name, an email address, a phone number, a post, a profile, a photo. A price list or a timetable is not.

9 What will you do with it?
10 Is an AI model or agent doing the collecting or the reading? Whose, and where is that provider based?
11 Will the data leave the country it was collected in?
12 Has anyone from the site told you to stop, or blocked you before?

Legal information, not legal advice. This result lists the obvious problems for the answers you gave. It does not find all of them, and it does not clear a project; that is a question for a lawyer.

About this documentUpdated ShowHide

Sean McDermott, Co-Founder and CEO, UnGovr

Written by Sean McDermott (with AI assistance) using the LexLint law library, which supplied every legal instrument, status and date on these pages, and the handbook and insight documents on lexlint.io that carry the depth behind each one.

Every law named here links to its summary page on lexlint.io, translated to English (if needed) and restructured to a standard format for human and code use. Every case links to the court's or the regulator's own record where one could be reached.

© 2026 UnGovr, publishing as LexLint. The text and the figures are licensed under Creative Commons Attribution-ShareAlike 4.0: share and adapt them, including commercially, with credit to LexLint (UnGovr) and under the same licence. Please contact LexLint at hello@ungovr.org to discuss other terms. Logos and wordmarks belong to their owners.

Corpus figures as of .