The Site Explorer crawl shows errors for files/folders that do not exist.
-
I'm fairly certain there is ultimately something amiss on our server but the Site Explorer report on my website (www.kpmginstitutes.com) is showing thousands of folders that do not exist.
Example: For my "About Us" page (www.kpmginstitutes.com/about-us.aspx), the report shows a link: www.kpmginstitutes.com/rss/industries/404-institute/404-institute/about-us.aspx.
We do have "rss", "industries", "404-institute" folders but they are parallel in the architecture, not sequential as indicated in the error url.
Has anyone else seen these types of error in your Site Explorer reports?
-
Hi David - I'm looking at the top pages report and don't see those (but only browsed through a few pages, so they could be further down). I suspect what's happening is some sort of misconstructed redirects or links to those pages. If you use the PRO Web App's crawling functionality, you can create a campaign for kpmginstitutes.com and see not only where those errors happen, but download a CSV and get the sources of the 404s, too.
You might also find this information in Google Webmaster Tools.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why my site not crawl?
hi all me allow rogerbot in robots.txt but rogerbot can't crawl my site my site: toska-co.ir
Moz Pro | | jahanidawodi0 -
Site Not Cached By Google
Hi My name is Apoorwa and i have my own website, My website is not cached by google, Why is this problem happening with my site.can somebody help me please? its urgent....this is my site - http://www.holifestival.org/Please assist me.......
Moz Pro | | Packersmove0 -
Can someone kindly explain what 'Crawl Issue Found: No rel="canonical" Tags' means? Is this a critical error and how can it be rectified?
Can someone kindly explain what 'Crawl Issue Found: No rel="canonical" Tags' means? Is this a critical error and how can it be rectified?
Moz Pro | | JoshMcLean0 -
When do the "just discovered" links on Open Site Explorer count?
I have been working hard to get follow backlinks but they have all been in the Just Discovered part of Open Site Explorer for a long time. So they don't count in my stats for Domain Authority and such. When do they move OUT of Just Discovered?
Moz Pro | | dealblogger0 -
Crawl Diagnostics Report
I'm a bit concerned about the results I'm getting from the Crawl Diagnostics Report. I've updated the site with canonical urls to remove duplicate content and when I check the site - it all displays the right values, but the report, which has just finished crawling is still showing a lot of pages as duplicate content. Simple example: http://www.domain.com http://www.domain.com/ Both of them are in the duplicate content section although both have canonical url set as: Does each crawl check the entire site from the beginning or just the pages it didn't have a chance to crawl the last time? This is just one of 333 duplicate content pages, which have canonical url pointing to the right page. Can someone please explain?
Moz Pro | | coremediadesign0 -
Why would Open Site Explorer say some internal links are images when in the source code they're text?
Hi, All! I was looking at OSE for one of my client's site's pages, and I saw that all internal links were said to be images. I was pretty sure their menu was CSS, and all the links were text. So I did "fetch as Googlebot" and looked in the resultant code of one of the homepage to see the main navigation bar. The navigation link for one of those pages looked like this: `onmouseover="doMenu2on(this);">[](http://www.mysite.com/solution_sub.asp?ID=8)` [``` <code>![](images/arrow6.gif)Anchor Text Here</code> ```](http://www.mysite.com/solution_sub.asp?ID=8) ``` The nav link for a page that does show internal anchor text in OSE looks like this: onmouseover="doMenu2on(this);">[](http://www.mysite.com/solution.asp?ID=5) [```
Moz Pro | | debi_zyx
<code>Anchor Text Here</code> So there is an image in the link (it's the little arrow before the text to indicate a sub-category), but the anchor text comes right after it. Is Linkscape (and therefore potentially Google) seeing them as two different links to the same page and only counting the first? But it's all wrapped within the same <a></a>tags. Any ideas on if this is a bug in Linkscape, or a real issue, and what should be done? Thanks! Aviva``0 -
CSV export of Open Site Explorer is incomplete.
I exported my back links report from the Open Site Explorer toolbar as a CSV but the file it showed was only about 400 urls. The tool bar is listing over 1,200 links, so at first I thought maybe it was only exporting one link for each unique domain, but it only lists 200 or so unique domains linking to my site. I know it will only export 10,000 urls, but obviously I'm significantly below this level. Here is a link to a competitors site which is having the same issue.
Moz Pro | | bbelgard
http://www.opensiteexplorer.org/links?site=www.zoobooks.comListing about 900 links and only generating about 500 in the CSV report. Any help would be much appreciated.0 -
Crawl test. Bot crawled only 200 or so links when it should have crawled thousands
Hi everyone, I just recieved my crawl test report and its only given me 200 or so URL's when my site has thousands, any thoughts?
Moz Pro | | Ev840