Do Indian government sites ranked 1329–9625 block AI crawlers?

Do Indian government sites ranked 1329–9625 block AI crawlers? Here is the AI crawler access each one's robots.txt gave on 20 October 2026: 42 sites from our India AI crawler index, which reads robots.txt only. A site whose robots.txt lets the search crawlers in can still turn them away at its CDN or firewall, which this index doesn't test; open a site's page and run a live audit to check that. Each line links to the site's full page, with the verdict for all 31 crawlers we track and how often other sites in the same segment block each one.

• rajasthan.gov.in #1,329: no readable robots.txt rules
• gst.gov.in #1,358: no readable robots.txt rules
• karnataka.gov.in #1,382: robots.txt lets the ChatGPT, Claude and Perplexity search crawlers in
• incometax.gov.in #1,413: no readable robots.txt rules
• uidai.gov.in #1,447: robots.txt lets the ChatGPT, Claude and Perplexity search crawlers in
• eci.gov.in #1,516: robots.txt lets the ChatGPT, Claude and Perplexity search crawlers in
• wb.gov.in #1,517: robots.txt lets the ChatGPT, Claude and Perplexity search crawlers in
• epfindia.gov.in #1,523: robots.txt lets the ChatGPT, Claude and Perplexity search crawlers in
• up.gov.in #1,560: no readable robots.txt rules
• indianrail.gov.in #1,568: robots.txt lets the ChatGPT, Claude and Perplexity search crawlers in
• parivahan.gov.in #1,583: no readable robots.txt rules
• dord.gov.in #1,731: robots.txt lets the ChatGPT, Claude and Perplexity search crawlers in
• digitallocker.gov.in #1,741: no readable robots.txt rules
• csc.gov.in #1,755: no readable robots.txt rules
• census.gov.in #1,787: no readable robots.txt rules
• egramswaraj.gov.in #1,807: no readable robots.txt rules
• telangana.gov.in #5,768: robots.txt lets the ChatGPT, Claude and Perplexity search crawlers in
• maharashtra.gov.in #6,182: robots.txt lets the ChatGPT, Claude and Perplexity search crawlers in
• tn.gov.in #6,197: no readable robots.txt rules
• mca.gov.in #6,487: no readable robots.txt rules
• mohfw.gov.in #6,931: robots.txt lets the ChatGPT, Claude and Perplexity search crawlers in
• jharkhand.gov.in #7,291: robots.txt lets the ChatGPT, Claude and Perplexity search crawlers in
• delhi.gov.in #7,301: no readable robots.txt rules
• education.gov.in #7,355: robots.txt lets the ChatGPT, Claude and Perplexity search crawlers in
• indiapost.gov.in #7,599: robots.txt lets the ChatGPT, Claude and Perplexity search crawlers in
• mponline.gov.in #7,851: no readable robots.txt rules
• esic.gov.in #8,010: no readable robots.txt rules
• digilocker.gov.in #8,046: no readable robots.txt rules
• gem.gov.in #8,230: robots.txt lets the ChatGPT, Claude and Perplexity search crawlers in
• swayam.gov.in #8,331: robots.txt lets the ChatGPT, Claude and Perplexity search crawlers in
• cybercrime.gov.in #8,417: no readable robots.txt rules
• scholarships.gov.in #8,564: no readable robots.txt rules
• pib.gov.in #8,620: no readable robots.txt rules
• ap.gov.in #9,082: robots.txt lets the ChatGPT, Claude and Perplexity search crawlers in
• lsgkerala.gov.in #9,107: robots.txt lets the ChatGPT, Claude and Perplexity search crawlers in
• nha.gov.in #9,284: robots.txt blocks ChatGPT, Claude and Perplexity
• udyamregistration.gov.in #9,310: no readable robots.txt rules
• pgportal.gov.in #9,381: no readable robots.txt rules
• haryana.gov.in #9,398: robots.txt lets the ChatGPT, Claude and Perplexity search crawlers in
• wcd.gov.in #9,512: robots.txt lets the ChatGPT, Claude and Perplexity search crawlers in
• udiseplus.gov.in #9,602: no readable robots.txt rules
• mybharat.gov.in #9,625: robots.txt lets the ChatGPT, Claude and Perplexity search crawlers in