For website owners
ChiefBoardBot
Did you see ChiefBoardBot/1.0 in your server logs? That is ChiefBoard's research assistant. Here is what it does.
- Only at the request of the site owner
- ChiefBoardBot visits a website only when a ChiefBoard customer has first confirmed that they own the domain and starts the research on their own company. It does not crawl the web.
- Company information only
- It reads public information about the business, such as services, locations or business structure. Information about individuals is not evaluated; email addresses and phone numbers are removed first.
- A few pages, one pass
- For each research run it requests only a few pages of the same domain, within fixed time limits, and then stops.
- Respects robots.txt
- Before every visit it reads the robots.txt of the website. If it cannot be read or it disallows access, the bot requests no page.
Blocking it
These lines in your website's robots.txt are enough:
User-agent: ChiefBoardBot Disallow: /
Questions or a problem with the bot? Write to lucas@trychiefboard.com.