The Site Explorer crawl shows errors for files/folders that do not exist.
-
I'm fairly certain there is ultimately something amiss on our server but the Site Explorer report on my website (www.kpmginstitutes.com) is showing thousands of folders that do not exist.
Example: For my "About Us" page (www.kpmginstitutes.com/about-us.aspx), the report shows a link: www.kpmginstitutes.com/rss/industries/404-institute/404-institute/about-us.aspx.
We do have "rss", "industries", "404-institute" folders but they are parallel in the architecture, not sequential as indicated in the error url.
Has anyone else seen these types of error in your Site Explorer reports?
-
Hi David - I'm looking at the top pages report and don't see those (but only browsed through a few pages, so they could be further down). I suspect what's happening is some sort of misconstructed redirects or links to those pages. If you use the PRO Web App's crawling functionality, you can create a campaign for kpmginstitutes.com and see not only where those errors happen, but download a CSV and get the sources of the 404s, too.
You might also find this information in Google Webmaster Tools.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why Only Our Homepage Can Be Crawled Showing a Redirect Message as the Meta Title
Hello Everyone, So recently when we checked our domain using a Moz Crawl Test and Screaming Frog only the homepage comes up and the meta title says “You are being redirected to…”. We have several pages that used to come up and when submitting them to GSC no issues come up. The robots.txt file looks fine as well. We thought this might be ‘server’ related but it’s a little out of our field of expertise so we thought we would find out if anyone has any experience with this (ideas of reasons, how to check…etc.) or any potential suggestions. Any extra insight would be really appreciated. Please let us know if there is anything we could provide further details for that might. Looking forward to hearing from all of you! Thanks in advance. Best,
Moz Pro | | Ben-R0 -
Need advise/strategy for cleaning up backlinks to my site
I recently redesigned my website (studio35design.com), and with that, I'm finally paying attention to SEO. I used a few different tools to find the amount of backlinking domains I've built up through the 7 or so years. The numbers are the following: 52 Total Backlinking Domains (800+ links):
Moz Pro | | rubennunez
• 17 of those are from blog commenting - they are pretty much all NF
• 20 of those are from sitewide footer credits on websites I've built. They are all old, as I stopped adding sitewide links to my client sites over a year ago.
• 7 of those are from spam. My site was hacked last year which contributed to alot of it. I've since then completely scrapped my old site and built this one on webflow (Not self-hosted like my old WP site).
• The other 10 or so are from forums, and the odd photo credit. As you can tell, almost none of these backlinks links are really any good. I'm surprised that my DA is 27 really. So moving forward, I need to know the best strategy dealing with these "bad" links. For the spam, I'm going to disavow in google webmasters. As for the rest, here are my questions... QUESTION 1:
As for the sitewide links, would the best thing be to remove the link altogether from the footer of each one of those sites? Some I can't because they are really old, and I don't have access to them (I'll probably disavow), but the rest I can still go in and update. QUESTION 2:
Will removing a ton of links at once hurt my DA and my google ranking? I can probably eliminate 500-600 links within a few days just by removing the sitewide links. How quickly can I expect those links to drop off? A few months? QUESTIONS 3:
Should I disavow blog commenting links even though they are NF? Does it matter at all? QUESTION 4:
I noticed 5 or so of the domains I have links one aren't working domains anymore. How quickly can I expect those links to drop off? Thanks in advance for your help.0 -
Site Crawl Error
In moz crawling error this message is appears: MOST COMMON ISSUES 1Search Engine Blocked by robots.txt Error Code 612: Error response for robots.txt i asked help staff but they crawled again and nothing changed. there's only robots.XML (not TXT) in root of my webpage it contains: User-agent: *
Moz Pro | | nopsts
Allow: /
Allow: /sitemap.htm anyone please help me? thank you0 -
Huge spike in crawl errors today - mozbot ignoring noindex tag?
Hi Mozzers, Today I received a ton of errors and warnings in my weekly crawl due to the mozbot crawling my noindex'd search results pages, such as this - http://www.consumerbase.com/Mailing-Lists.html?q=Construction&type=bus&channel=all&page=7&order=title&orderBy=DESC See image: http://screencast.com/t/qaZzq78j2Udx Anyone else seen a similar error this week with their crawl? Thanks!
Moz Pro | | Travis-W0 -
My Campaign only crawled 3 pages on my site
On my first crawl of a new campaign, the software only crawled 3 pages. XXXaceXXXscholarships.org any ideas?
Moz Pro | | Santaur0 -
Open Site explorer (last 1-3 updates) shows new and wierd results
Hi Moz'ers! I have a questions for you guys. Can you explain why the website "Netspiren" has a lower "domain Authority" than "Duft og Natur"? See screenshot. I know it's a tough question without a detailed analysis, but looking at OSE's data, does the mozrank,moztrust, C-block don't reflect the power of the Domain Authority. What's you take? BTW: "Netspiren" has always had more and better links, and also had a higher Domain Authority. Something about the Domain Authority changed since the past 1-3 OXE updates. Looking forward for your take on this! Have a good weekend! mnRPI.png
Moz Pro | | FrederikTrovatten220 -
Anyone else have trouble with Open Site Explorer
Ever since the new Open Site Explorer came out, I've haven't been able to use the download feature. It just gives me a prompt saying "No Data Received." Anyone else have trouble with OSE, or been able to get past this issue?
Moz Pro | | EricVallee341 -
When using Wordpress, why does it show up so many meta data errors on here and on google webmaster? A list of do's would be good?
Using wordpress is a good CMS, yet there sre so many meta data errors occuring, is there a list of what to look out for and good practices when using wordpress?
Moz Pro | | CosmikCarrot0