Crawl Issue
-
Hi,
We have 3 campaigns running for our websites in different territories. All was going well until April 11th when Moz reported that our .com site (sendmode.com) could not be crawled. I get this error "Your page redirects or links to a page that is outside of the scope of your campaign settings ..."
I've been through the site a number of times but have been unable to get to the root of the problem. Robots.txt and 301's look fine.
Is there any way I can find out which page is causing the issue?
John
-
No problem
-
Thanks so much for the response Eli. Will have a look at that last page.
-
Hey John,
Thanks for reaching out to us!
Please could you write into us at help@moz.com so we can look into your Campaign and get to the bottom of this?
P.S. The way to see which page our crawler is stopping at would be to head to the 'All Crawled Pages' section of your Campaign (under Site crawl) and export the CSV. You will be able to see the order in which our crawler has crawled your site, and the last page is the page we have stopped at.
Looking forward to hearing from you,
Eli
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Crawling only the Home of my website
Hello,
Product Support | | Azurius
I don't understand why MOZ crawl only the homepage of our webiste https://www.modelos-de-curriculum.com We add the website correctly, and we asked for crawling all the pages. But the tool find only the homepage. Why? We are testing the tool before to suscribe. But we need to be sure that the tool is working for our website. If you can please help us.0 -
Solved Why is MOZ crawl taking so long?
I began my site crawl on November 3rd and now it is November 7th and it is still "in progress". Why is this happening?
Product Support | | CarisaS_Wenda0 -
Crawl error robots.txt
Hello, when trying to access the site crawl to be able to analyze our page, the following error appears: **Moz was unable to crawl your site on Nov 15, 2017. **Our crawler was banned by a page on your site, either through your robots.txt, the X-Robots-Tag HTTP header, or the meta robots tag. Update these tags to allow your page and the rest of your site to be crawled. If this error is found on any page on your site, it prevents our crawler (and some search engines) from crawling the rest of your site. Typically errors like this should be investigated and fixed by the site webmaster. Can help us? Thanks!
Product Support | | Mandiram0 -
Meta Refresh Issues
Hi, Can you give me more insight to what might be causing a Meta Refresh? I’m seeing this is where most of my redirect issues are coming from, but I’m not sure how to go about fixing them. Thanks!
Product Support | | VanessaBurton18f0 -
Haven't received an update on site crawl issues more than a week
Hello, my account has be scheduled to have the next updated report on 1st March. However, up till now, the latest data I have for our site crawl issues is made on 21st Feb. May I know if there is any issue related to this? Any way that i can draw the data for this week?
Product Support | | Robylin10 -
MOZ is having a redirect loop issue?
Hey guys, Is anyone else having an issue with this? I leave MOZ analytics open all day and it times out after a while. When you refresh your page when it has timed out, it goes into a redirect loop. It also doesnt let you log back in before you first log out (even though your session has already timed out). Not the greatest UX and I thought I should see if anyone else is having the same issue. Let me know your thoughts!
Product Support | | JoshGaskin0 -
Crawl Limit Question
I'm a little confused as to how the crawl limit works. Since there seems to be a 10K per week max, the crawl limit can't be per week, so what is the time period? Also, does that include crawling sites entered as competitors? Right now I'm at 14/25 sites and most of them are under 1,000 pages so I'm not sure how I hit that limit (other than a one-time spike of 28,000 in November).
Product Support | | David_Moceri0
