ConstantUpliftBot
ConstantUpliftBot is the web crawler for ConstantUplift, an AI website guide from ConstantGraph Limited. It was called WayfinderBot during development. If you've seen either name in your server logs, this page explains what it does and how to stop it.
How to recognise it
It identifies itself with this user agent:
ConstantUpliftBot/0.1 (+https://constantuplift.com/bot)
What it does
- It reads publicly available pages to learn how a website is laid out: its pages, headings, questions and answers, and forms.
- It follows
robots.txt, includingCrawl-delay, and requests at most one page per second from a site. - It may open accordions and tabs on a page to read the text inside them.
- It never submits forms, logs in, buys anything or clicks anything that changes data on your site.
- It doesn't download images, videos or fonts.
It crawls only the websites of businesses that have added them to ConstantUplift, plus a few sites for testing.
How to stop it
Add this to your site's robots.txt file:
User-agent: ConstantUpliftBot Disallow: /
Rules for WayfinderBot no longer apply: use the new name. ConstantUpliftBot reads robots.txt again before each crawl, so the
change applies from its next visit.
Contact
For questions or problems, email hello@constantuplift.com and include your website address.