Skip to content
CRCartReady
Menu

Scanner

What we fetch, and how to opt out

Scans run when someone asks for one, or when a Monitor subscription is due. We do not crawl the web looking for stores.

User agent: CartReadyScanner/1.0 (+https://cartreadyaudit.com/scanner)

Limits: 8 free scans per network address each hour, at most two requests a second to a host, a 15 second timeout, a 5 MB body cap, and no more than five redirects. Free scans stop at 15 fetches. Paid scans stop at 80.

We resolve DNS and refuse loopback, private, link-local, and metadata addresses. The connection is checked again so a public name cannot switch to an internal address. Only HTTPS is fetched. If you enter HTTP, we try the HTTPS URL.

robots.txt is respected for CartReadyScanner. If robots.txt disallows a shopping crawler such as OAI-SearchBot, we do not send that request. The check is marked blocked instead.

To opt out, email ops@threepaths.co with the subject "Scanner opt-out" and the hostname. We add it to the block list. An opt-out stops new scans and pauses an active monitor for that host.

Stores in regulated categories such as firearms, cannabis, tobacco, alcohol, adult goods, and supplements can still receive a free score. CartReady does not sell the paid report or Fix Pack for those scans.