Repeated mysterious 404's from ancient site structure killing my rankings
-
Several years ago I changed my site structure to go from a flash based site to a blog based wordpress site. After doing so I went from page 1 to page 30 for my relevant search terms. I have employed people to help me track down the problem and I believe that they have narroed it to the existance of 404's being created from some unknown internal source. I have been for years getting links like this...
<colgroup><col width="792"></colgroup>
||
......regularly showing in webmaster tools, (this is from a top pages report from MOZ where there are hundreds also shown).
When I do a moz crawl of the site, none of these links show up. Therefore I have no way of finding the source of these links (they also do not show me the source in WMT as they should).
We have completely cleared the site and rebuilt it and although it is still only a couple of weeks in it still does not appear to have stopped them.
Does anyone have any way of helping me find the source of these mysterious 404's?
-
Why bother trying to clean anything up? If somewhere out there there are links to your domain, and they're 404'ing, just 301 them to new pages on your site! Capture that link juice, don't let it run out
-
Thanks for your reply EEE3
The ancient link says it is linked from another non existent ancient page that no longer exists and it is always first crawled and last detected on the day that it arrives.
eg. last crawled 4/23/14, first detected 4/23/14
http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/03/st-kilda-wedding......
linked from
http://dfphotographer.com.au/brisbaneweddingphotographer/index.php/2011/03/st-kilda-wedding.....
and
http://dfphotographer.com.au/brisbaneweddingphotographer/2011/03/st-kilda-wedding....
-
Thanks for your response Keri,
Being staff can you please tell me where does the top pages data come from? Is it from crawling my site (like a google spider) or is it sourced from google or somewhere else. How often is that data refreshed?
In answer to your response, I have tried both screaming frog and xenu and my nice clean site structure is all it picks up. None of the ancient messy site structure appears.
Have been through the list of domains looking for an old sitemap or something similar that may have been scraped off my site but after a long and arduous task could not locate any reference to any of these links that show up in top pages and webmaster tools (which says they are linked from other ancient pages - which I will expand on below)
We have looked at all the usual suspects - old sitemaps, plugins and rebuilt the site just in case we missed anything that was lingering around. I have had really good people looking at it who continue to do so it just never seems to go away.
-
In Webmaster Tools, when you click on the 404 and the popup window appears, what is showing in the Linked from tab?
-
I edited the post so the URLs didn't run together. Still not perfect, but a little easier to read.
I'm not exactly sure where those links are coming from. You might run a tool like Xenu Link Sleuth or Screaming Frog on your site to see if there is an internal linking widget gone awry. The other thought I have is to look at Open Site Explorer to see what sites are linking to you and if they're linking to any of those pages.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz was unable to crawl your site on Jun 22, 2020\. We were unable to access your site due to a page timeout on your robots.txt, which prevented us from crawling the rest of your site.
Site: www.kpmg.us Getting robots.txt timeout fail since 02/29/20. We've checked our server logs and see no errors. Went through all the steps of the "Troubleshooter". Updated robots.txt to allow rogerbot full access: User-agent: rogerbot
Link Explorer | | KPMG-Search-Social
Disallow: Any ideas how to get roger to crawl my site????1 -
What do we know about Open Site Explorer?
Any clear answer for this result? Google get penalty from Google for it's own website? Please refer to the attached picture below. vsgKw
Link Explorer | | BBT-Digital0 -
Drop in rankings following a migration
Hi we have recently migrated our website and while I expected some drop in visibility I didnt expect a huge drop and definitely not a big drop in MozRank and MozTrust. But we went from 4.34 to 3.69 on Domain Rank and 4.42 to 3.85 in MozTrust. That to me looks like a lot. Particularly since I have been building links and it should be going up not down. We dont buy links and really dont employ any black hat link building. Now at the same time our total link profile looks massive. Apparently we have 18k of links. there is no way this is correct. Our competitors all have below 5k. The total links have grown from 13k to 18k in a month as well. Where is this coming from? Is there any way of seeing what these links are? Our visibility went up actually after the launch. Main keyword campaign went from 1.59% to 6.13% then to 7.53% at first. Which made sense since the new site has much better on page optimisation. But now this dropped again to 2.37%. Our competitors visibility is much more stable then that. I know some fluctuations is normal but these fluctuations seem a bit drastic. Are they? We still have a few 404s to sort out and quite a bit of re-directs on the page. But other then having impact on speed this should not influence the rankings so severely. Should it? Before we migrated the site I followed the instruction given by Moz https://moz.com/blog/web-site-migration-guide-tips-for-seos and yet there are all these issues that are popping up. It's disappointing that I made all this effort prior to migrating plus made sure our new page is much better in terms of SEO (I mean I even developed a pagination strategy to get rid of the duplicates!) and it doesnt seem like its paying of. Any help is much appreciated. Id say my SEO understanding is mid range but Im really interested in it and keen on building my skills. And this is really discouraging if Im honest. Please help
Link Explorer | | ACEmina0 -
Open Site Explorer Messge - Mysite.com redirects to www.mysite.com
Hello All, When I plug in my site's URL http://mysite.com ( Not my actual URL of-course) into the OpenSiteExplorer tool I get the following message: "You entered the URL http://Mysite.com which redirects to http://www.Mysite.com/.
Link Explorer | | jjimen03
Because it's likely to have more accurate metrics, we're showing data for the redirected URL instead.
Click here to analyze http://Mysite.com instead?" Not sure why I am getting this message. On my hosting server, I have defined my preferred domain to be the non-www. version. I have also used a Canonical Tag on Mysite.com/index.html file ( ). In addition, on Google Search Console ( Webmaster Tools ) , I have added both the www. and non-www. properties, where on both property settings, I have defined the non-www. version as my preferred one. Also, on my server, I have not implemented any 301 redirects at all. So my questions are: Why am I receiving this message when plugging in my non-www. URL version of my website into OpenSiteExplorer? Is my DA or PA possibly being split up between the two versions as a result? Should I be concerned? How can I fix this? Thanks in advance.0 -
DA hasn't Moved over
We moved our site over a couple of weeks ago from bi-mi.com to bimi.co - its a magento site. We followed instructions to wait 2 weeks and upload a coming soon page etc to help google realise it was not just a parked domain. We moved everything over and then set a hta record up to redirect the "bi-mi" base domain to "bimi" , we then logged teh site move within web master tools also and I set the bimi.co preferred url etc. However its been about a week and half now and the DA is still showing as 1 and bi-mi (the old site that is redirecting) is showing as 18 Is it just patience needed here or have any of you also come across this issue?
Link Explorer | | Kelly33301 -
No back links showing in site explorer but..
I am quite surprise with this, normally site explorer show more and valid database for back links but this time its opposite. the site url is www.motortrader.com.pk webmaster shows me about 2000 where as site explorer is null. is there any particular reason for that?
Link Explorer | | Mustansar0 -
Why does the number of the total external links and the followed linking root domains between Open site explorer and the campaign in Moz pro doesn't match?
Opensiteexplorer returns 52.473 total external links and 715 followed linking root domains while my campaign in Moz analytics return 35.899 total external links and 1092 followed linking root domains. Does anyone knows how this is possible?
Link Explorer | | ConversionMobstars0 -
Links from no-indexed pages in Open Site Explorer
I just looked up a site in Open Site Explorer. After putting in the site, I get a list of domains, links etc which is very useful. At the bottom is a note which I have pasted below. It mentions "24 links from no-indexed pages" and says we can't get any info on these. Is there a way to see what the 24 links are so I can investigate further?"Why does my number of inbounds links listed not match my total links count? The listed number may be slightly different because we only show 25 links per domain (so that you see a variety). Additionally you have 24 links from no-indexed pages. Unfortunately, we can't get info for those links."
Link Explorer | | EdKim0