Unsolved Replicate rogerbot error for server/hosting provider
-
Anyone got any ideas how to get a server/hosting provider who is preventing rogerbot from crawling and me not been able to set up a campaign to duplicate the error on there end?
The server/hosting provider is crazydomains dot com
My clients robots.txt
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
User-agent: rogerbotDisallow:
Sitemap: https://www. something
-
Hi guys. I decided to try this site https://nocramming.com/testingmom-review to prepare my child for testing before entering a new school, and the results have exceeded my expectations. TestingMom provides an extensive selection of materials and exercises to help children improve their academic skills and develop problem-solving strategies. My child has improved quickly with this resource and I am very grateful to the TestingMom team for their work
-
Moving-Web-SEO-AucklandMoving-Web-SEO-Auckland
if you facing any error in your hosting kindly contact the https://www.leasedlayer.com/ I would like to recommend this company because I have hosted my company site with this service provider I am running my site in a smooth way and their customer support is marvelous
-
@tom-capper
Thanks Tom was more about server settings outside of robots.txt for hosting providers.
Managed to get them to remove rogerbot blocking on ALL there servers as they first stated that it was well known as a malicious robot hence the block???
Until I made them aware.... cough cough -
There are a bunch of third party tools that would allow you to validate robots.txt against a given user agent.
For example:
- https://technicalseo.com/tools/robots-txt/ (includes Moz user agents in dropdown)
- https://www.realrobotstxt.com/ (allows you to copy/paste a test robots file)
Without the hosting provider having a Moz account & campaign of their own, this is probably the easiest way to get them to replicate the error.
Tom
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved How to check the Domain Age?
Check the Domain Age on THE SEO TOOLS KING
Moz Tools | | seotoolsking
Get Free seo tools only on THE SEO TOOLS KING4 -
Unsolved Search volume as a factor in search visibility
Is search volume a factor in calculating visibility in Moz? Is search volume a factor is or it just keyword rankings?
Moz Tools | | davidevans_seo0 -
Unsolved How to check the DA history?
Hello everyone!
Moz Tools | | ZeonAley
I want to know how to check the DA history of my website Inkjet Wholesale. Because I don't have any idea about Moz that how to use it. If anyone knows about DA's history check on Moz, please let me know.0 -
Unsolved Domain analysis issues
Hello, Moz pro dont do domain analysis of number of websites while other software can easily do.
Moz Tools | | asadholyghost
my website domain analysis cant be done. here is my URL0 -
Unsolved domain authority has not changed
Hello, can you help me? The domain authority has not changed for months, and in fact, the ranking has come down. But my links have increased a lot but have remained the same
Moz Tools | | semrtaz
this is my domain 😧 https://nezafatnews.ir/1 -
Unsolved Why Moz shutdown on seprate website ?
My moz shutdown on some website like my website -
Moz Tools | | yuvrajsindhal
https://shotsblastingmachine.com/0 -
Unsolved error in crawling
hello moz . my site is papion shopping but when i start to add it an error appears that it cant gather any data in moz!! what can i do>???
Moz Tools | | valigholami13860
