GoAvoBot reads company websites, politely
GoAvoBot is the crawler of GoAvo, an event and audience platform. When an organiser asks, it reads a few pages of a company's own website to learn simple facts about the company, so the organiser can see why that company fits their event.
It always says who it is:
GoAvoBot/1.0 (+https://goavo.ai/bot)What it reads
Only a company's own official website: the home page, and at most one page each under /about, /contact and /press. HTML only, no scripts run, at most 2 MB a page, never anything behind a login.
What it keeps
Facts about the company that it can quote word for word from the page: its stage, what it makes, its city, the technology it builds with, and a shared company inbox such as hello@ if the page publishes one. Each fact keeps the page address and the date it was read, and is deleted after 180 days.
What it never keeps
Personal phone numbers, personal or guessed email addresses, follower counts, social media handles or photos. It never reads LinkedIn, Luma, Crunchbase or other sites whose terms forbid automated reading.
How politely
It obeys robots.txt for the GoAvoBot name and for *, and checks it again every day. It asks any one site for at most one page every two seconds, and only when an organiser asked, never on a schedule.
To keep GoAvoBot out
Add these two lines to your robots.txt. GoAvoBot will stop within a day:
User-agent: GoAvoBot Disallow: /
To ask what GoAvo holds about your company, or to have it removed, write to support@goavo.ai. We answer site owners directly.