Crawl Issue
-
Hi,
We have 3 campaigns running for our websites in different territories. All was going well until April 11th when Moz reported that our .com site (sendmode.com) could not be crawled. I get this error "Your page redirects or links to a page that is outside of the scope of your campaign settings ..."
I've been through the site a number of times but have been unable to get to the root of the problem. Robots.txt and 301's look fine.
Is there any way I can find out which page is causing the issue?
John
-
No problem
-
Thanks so much for the response Eli. Will have a look at that last page.
-
Hey John,
Thanks for reaching out to us!
Please could you write into us at help@moz.com so we can look into your Campaign and get to the bottom of this?
P.S. The way to see which page our crawler is stopping at would be to head to the 'All Crawled Pages' section of your Campaign (under Site crawl) and export the CSV. You will be able to see the order in which our crawler has crawled your site, and the last page is the page we have stopped at.
Looking forward to hearing from you,
Eli
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved 403 crawl error
Hi, Moz( Also reported by GSC)have reported 403 crawl error on some of my pages. The pages are actually working fine when loaded and no visible issue at all. My web developer told me that some times error issues are reported on a working pages and there is nothing to worry about.
Product Support | | ghrisa65
My question is, will the 403 error have bad consequences on my SEO/Page ranking etc. These are some of the pages that have been reported with 403 error but loading fine: https://www.medistaff24.co.uk/hourly-home-care-in-evesham/ https://www.medistaff24.co.uk/contact-us/0 -
Crawl still in process for 3 days. Not sure why the site isn't being crawled
I added a new site to the crawl, but it seems to be stalled. It was supposed to crawl Feb 19, but it is still in process Feb 22. It tried to crawl the site and there was a robots.txt issue, but that issue was resolved way before the 19th. Not sure what is going on. this is for the clear lake campaign.
Product Support | | dpsoftware0 -
My site crawl has been in progress since last week
Hi there, I've been waiting on my site crawl to complete since Friday (it's Tuesday now), but it still has the 'in progress' notification at the top. Is it normal for it to take over 3 days? Or is there something holding it up?
Product Support | | VAPartners0 -
How to block Rogerbot From Crawling UTM URLs
I am trying to block roger from crawling some UTM urls we have created, but having no luck. My robots.txt file looks like: User-agent: rogerbot Disallow: /?utm_source* This does not seem to be working. Any ideas?
Product Support | | Firestarter-SEO0 -
Rogerbot not crawling our site
Has anyone else had issues with Roger crawling your site in the last few weeks? It shows only 2 pages crawled. I was able to crawl the site using Screaming Frog with no problem and we are not specifically blocking Roger via robots.txt or any other method. Has anyone encountered this issue? Any suggestions?
Product Support | | cckapow0 -
Issues with Page Grader Tool and competitor KW Rankings
I'm having two very frustrating issues with Moz: The page grader tool is not 'connecting' the correct keyword with the correct URL. For instance, if I want to rank for Dallas Motorcycle Accident Lawyer and create page of optimized content at Dallas.Zdfirm.com/Motorcycle-Accident, Moz doesn't grade THAT page. It grades Dallas.ZDFirm.com which to no surprise rates as an F. This is happening with both web sites on this account so much that the page grader tool is not delivering any value. My competitors keywords are not tracking properly. They are showing for "not in the top 50" for keywords that they are on the first page for. Again, this is for both domains on this account. Thanks, Brian
Product Support | | ZDAdmin0 -
Moz crawls
Hi all! I'm running two separate campaign crawls at the moment that I'm having a few issues with. The first is http://www.muchbetteradventures.com/. I'm tracking this at root to try an pick any problems with a previous version of the site, which is on the v1.muchbetteradventures subdomain. However, I'm only seeing 100 or so pages as being crawled in Moz, compared to thousands in Google. There's no access blocked alerts in Moz either. The second is http://www.sothebys.com/. I started this crawl at root a few days ago and no pages at all have been processed. Very odd! Any advice would be much appreciated.
Product Support | | neooptic0 -
Is anyone else seeing that their keyword rankings are pending even though they've been in the campaign for quite some time? Is this a known issue?
Is anyone else seeing that their keyword rankings are pending even though they've been in the campaign for quite some time? Is this a known issue?
Product Support | | IrishTimes0