LeadMindBot
LeadMindBot is the crawler behind LeadMind's Website Intelligence. When a business appears in one of our customers' lead lists and has a public website, we read a handful of that site's pages to confirm public contact details (email, phone, WhatsApp, social profiles) and to note which tools the site uses (online booking, live chat, platform, marketing tags). Nothing behind a login is ever requested.
How it behaves
- Identifies itself:
User-Agent: LeadMindBot/0.2 (+https://www.leadmindai.app/bot). - Obeys
robots.txt(includingCrawl-delay) and never retries a page a site refused. - Fetches at most 6 HTML pages per site, one request at a time per site, within a 45-second budget, and returns no more than once every 30 days.
- Sends no cookies or credentials, does not execute scripts, does not bypass CAPTCHAs, WAFs, logins or paywalls.
- Stores only extracted facts with the page URL they came from; page HTML is never kept.
Keep us out
Add this to your robots.txt and LeadMindBot will not request any page of your site:
User-agent: LeadMindBot Disallow: /
To have your business's public contact details removed from LeadMind entirely, use the data removal request; identifiers you submit are added to a suppression list so they are never stored again.