Official crawler information
BeseamBot
BeseamBot is Beseam's website audit crawler. It visits public ecommerce pages to inspect crawlability, structured data, links, rendered page evidence, and technical signals that can affect product discovery and store experience.
User-Agent
BeseamBot/1.0 (+https://beseam.com/bot)What it accesses
Public storefront pages, sitemaps, public commerce discovery endpoints, and the page resources needed to inspect rendered storefront content. BeseamBot does not sign in, submit forms, or attempt to bypass authentication.
Why it visits
Beseam uses crawl evidence for store audits and monitoring. A crawl may cover a merchant storefront or a publicly accessible competitor storefront when it is part of a Beseam analysis workflow.
Operator
Beseam operates BeseamBot. This page at beseam.com is the canonical public description linked directly from the crawler User-Agent.
Polite crawling
Built to respect the storefront.
robots.txt
BeseamBot honors rules addressed to User-agent: BeseamBot and does not fetch pages that those rules disallow.
Request pacing
The default crawl starts at no more than one top-level request per second per host. A robots.txt Crawl-delay can slow it further.
Rate limits
HTTP 429 responses trigger backoff. BeseamBot honors Retry-After and reduces crawl pressure rather than immediately retrying at the same rate.
Browser rendering
When JavaScript rendering is required, BeseamBot blocks unnecessary images, media, and fonts to reduce load while keeping the page evidence needed for an audit.
Control access
Use standard robots.txt rules.
Site operators can block BeseamBot completely, restrict selected paths, or request a slower crawl using standard robots directives.
Block BeseamBot
User-agent: BeseamBot Disallow: /
Ask for a slower crawl
User-agent: BeseamBot Crawl-delay: 5
Questions about BeseamBot traffic?
If you see traffic you do not expect, include the affected domain and approximate time so we can investigate the crawl.