AI crawler · Amazon · Search engine

Amzn-SearchBot: what it is, its user agent, and how to block it

Amzn-SearchBot is Amazon's search crawler. Indexes pages for search in Amazon products such as Alexa. Not used to train generative AI. In our 13 October 2026 study, 118 of 2,332 live top sites with readable robots.txt rules (5.1%) disallow Amzn-SearchBot. Part of the AI crawler list.

What Amzn-SearchBot does

Operator: Amazon. Job: Search engine. Obeys robots.txt.

“Automated crawling from these listed user agents respects the Robots Exclusion Protocol, honoring the user-agent and the allow/disallow directives.”

Amazon's Amzn-SearchBot documentation Published IP ranges (JSON)

Amzn-SearchBot user agent

robots.txt token: Amzn-SearchBot (matched case-insensitively).

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amzn-SearchBot/0.1) Chrome/W.X.Y.Z Safari/537.36

Amazon gives this as an example.

robots.txt: allow or block Amzn-SearchBot

Allow

User-agent: Amzn-SearchBot
Allow: /

Block

User-agent: Amzn-SearchBot
Disallow: /

Affects AI answers and citations. Blocking it removes your pages from Amazon's search index, and from the AI answers Amazon builds on that index.

Once a group names Amzn-SearchBot, it ignores your User-agent: * rules, so copy any paths you still want blocked into it.

How many top sites block Amzn-SearchBot

Disallow Amzn-SearchBot in robots.txt

5.1%

118 of 2,332 sites

In our 13 October 2026 study, 118 of 2,332 live top sites with readable robots.txt rules (5.1%) disallow Amzn-SearchBot.

Sample: Tranco top 5,000, tested once on 13 October 2026 from one Indian fixed-line connection. The robots.txt share counts live sites (home page 2xx) whose rules we could read, as on the AI visibility hub. Method and CSV in the study.

Check your own site

The AI crawler checker reads your robots.txt the way Amzn-SearchBot does and tests what your firewall returns. To write the rules, use the AI robots.txt generator.

Check your page: free, about 20 seconds, no sign-in

What it checks

robots.txt for Amzn-SearchBot: Finds the group Amzn-SearchBot obeys under RFC 9309 and the rule that decides your page.
What your CDN lets through: Requests the page as OAI-SearchBot, PerplexityBot and Claude-SearchBot and compares the answers with a browser request.
Content without JavaScript: AI crawlers don't run JavaScript. The audit checks how much of the page is in the raw HTML.

Free to run. Pay only for the fixes you want.

Free

Free account

Your score without signing in; with a free account, every check's result and the full fix for the top 1 issues.

★ Starter

$9 / ₹499 once

Every issue with its exact fix for one site, PDF/Markdown/JSON exports, re-audit for 30 days. Nothing renews.

Pro

$29 / ₹1,499 / month

Full reports on every site, weekly alerts when AI access breaks, competitor compare.

Agencies: white-label widget, branded reports and lead capture on Agency.

Questions

What is Amzn-SearchBot?+

Amzn-SearchBot is Amazon's search crawler. Indexes pages for search in Amazon products such as Alexa. Not used to train generative AI.

What is Amzn-SearchBot's user agent?+

Amazon documents it as: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amzn-SearchBot/0.1) Chrome/W.X.Y.Z Safari/537.36. Match on the token Amzn-SearchBot, since version numbers change.

How do I block Amzn-SearchBot?+

Add "User-agent: Amzn-SearchBot" followed by "Disallow: /" to your robots.txt. Obeys robots.txt, per Amazon.

Does blocking Amzn-SearchBot affect AI search citations?+

Blocking it removes your pages from Amazon's search index, and from the AI answers Amazon builds on that index.

How many websites block Amzn-SearchBot?+