Free Trial

Claritybot

Version 9.0

If you're on this page, its most likely that you found it referenced within a user-agent string recorded in your logs. Here are some FAQ's and Key Facts:

 

What is Claritybot? 

Claritybot is how seoClarity’s page and site audit crawler identifies itself.  

 

What does Claritybot do? 

Claritybot crawls and audits pages for technical issues and analyze content.  

 

Why is Claritybot crawling my site? 

Crawls by Claritybot are triggered on demand by clients of seoClarity to analyze pages for technical and content issues. In addition, clients have the ability to define specific pages to crawl on a daily basis in an automated manner. 

Claritybot only crawls sites and pages requested by clients. Clients can control the speed of the crawl, the crawl delay between requesting pages and more. 

 

Blocking Claritybot From Crawling Your Site 

 Claritybot obeys instructions within the robots.txt file on your site. Simply add the following instructions in there to block crawling by Claritybot 

 

WARNING:

If you’re a client of seoClarity, blocking Claritybot would prevent SiteClarity Crawls, Daily Managed Page Crawls and other automated analysis of content and technical issues. Make sure to setup an alternate custom user-agent string if you block Claritybot. Contact your Client Success Manager or support@seoclarity.net for more information.  

 

Blocking Claritybot with your robots.txt file looks a like this: 

User-agent: claritybot

Disallow: / 

 

Key Facts

 

Category: Marketing / Search Engine Optimization 


Does it Obey Robots.txt: Yes 


Does it Obey Crawl Delay: Yes 

 

Desktop User-Agent String:  

Mozilla/5.0 (compatible; ClarityBot/9.0; +https://www.seoclarity.net/bot.html)

 

Mobile User-Agent String:

 Mozilla/5.0 (Linux; Android 9; SM-G960F Build/PPR1.180610.011; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/74.0.3729.157 Mobile Safari/537.36 (compatible; ClarityBot/9.0; +https://www.seoclarity.net/bot.html)

 

IP address range: Dynamic 

 

 

Need Support? 

If you find Claritybot is misbehaving or don’t know who specifically may have requested a crawl of your page or website, please reach out to support@seoclarity.net.