The Scraping Checkup

Up to twelve questions about your scraper

Nine ask everyone; three more appear only when an earlier answer makes them matter. Then the short list of what to worry about, in the order to deal with it, and a profile for your engineer or lawyer. Your answers travel in the page's address, which is what makes the result a link you can send; there is no account, and nothing is posted to us.

1 Where is your organization based?

The country, and the state or province where the law has one.

2 Where will the scraper actually run?
3 Which sites, and where is the company behind each one?

One site is enough to start; add more if there are more. If you do not know where a site's company is, say so: the second document shows how to find out.

4 Can anyone see the pages you want without logging in?
5 To get the pages, will you create an account, tick a box, or otherwise agree to the site's terms?
6 Does the site say no anywhere you have looked: a robots.txt file, a line in the terms, a “no bots” or “no AI training” notice, a letter?
7 Is there something in the way: a “verify you are human” box, a CAPTCHA, a block after a few pages, a login wall?
8 Does what you want include information about people?

Information about a person is anything that names or could identify one: a name, an email address, a phone number, a post, a profile, a photo. A price list or a timetable is not.

9 What will you do with it?
10 Is an AI model or agent doing the collecting or the reading? Whose, and where is that provider based?
11 Will the data leave the country it was collected in?
12 Has anyone from the site told you to stop, or blocked you before?

Legal information, not legal advice. This result lists the obvious problems for the answers you gave. It does not find all of them, and it does not clear a project; that is a question for a lawyer.

Updated About this documentShowHide

Sean McDermott, Co-Founder and CEO, UnGovr

Written by Sean McDermott (with AI assistance) using the LexLint law library, which supplied every legal instrument, status and date on these pages, and the handbook and the brief's own long reads that carry the depth behind each one.

Every law named here links to its summary page on lexlint.io, translated to English (if needed) and restructured to a standard format for human and code use. Every case links to the court's or the regulator's own record where one could be reached.

© 2026 UnGovr, publishing as LexLint. The text and the figures are licensed under Creative Commons Attribution-ShareAlike 4.0: share and adapt them, including commercially, with credit to LexLint (UnGovr) and under the same license. Please contact LexLint at hello@ungovr.org to discuss other terms. Logos and wordmarks belong to their owners.

Law library as of .