PurityBot crawler
Information for site owners about PurityBot.
Overview
PurityBot crawls public web pages to build Purili's search index. The crawler follows normal web links and stores page text for search results.
Blocking
To opt out, block PurityBot in your robots.txt file or contact us with the domain you want excluded.
User-agent: PurityBot Disallow: /
Contact
For crawler complaints or opt-out requests, email hello@puri.li.