Recovering from index problem
-
Hi all. For a while, we've been working on http://thewilddeckcompany.co.uk/. Everything was going swimmingly, and we had a top 5 ranking for the term 'bird hides' for this page - http://thewilddeckcompany.co.uk/products/bird-hides.
Then disaster struck! The client added a link with a faulty parameter in the Joomla back end that caused a bunch of duplicate content issues. Before this happened, all the site's 19 pages were indexed. Now it's just a handful, including the faulty URL (<cite>thewilddeckcompany.co.uk/index.php?id=13</cite>)
This shows the issue pretty clearly.
I've removed the link, redirected the bad URL, updated the site map and got some new links pointing at the site to resolve the problem. Yet almost two month later, the bad URL is still showing in the SERPs and the indexing problem is still there.
Any ideas? I'm stumped!
-
Hi
You can use the URL removal, which should work fine, but I think this issue was you were blocking crawling in robots.txt for /?id=13 http://thewilddeckcompany.co.uk/robots.txt and www http://www.thewilddeckcompany.co.uk/robots.txt
If the crawler is blocked it can not see the redirect, so you would want to remove the /?id=13 from robots.txt and let Google crawl it to see the redirect, and that URL will drop out over time.
Something unrelated I just noticed - you should have a better 404 template http://thewilddeckcompany.co.uk/kjhf - one that uses your site's template/design and provides something a little more useful.
-Dan
-
I had no idea you could request a removal like that. Thank you!
-
Blink,
It sounds like you've done all the right things but if you wanted to, you can request removal of a cached page via google webmaster tools--it might help. Otherwise, just keep waiting, It'll go away. Have you looked at your server logs to see if googlebot's crawled those pages recently?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Recovering from an open redirect
From a previous company we have inherited a domain which once contained an open redirect redirect.magnet.me. Even though this domain has been returning a 410 for every single request directed at it for the last few months, we continue to see new links popping up in Google which refer to this domain https://www.google.com/search?safe=off&q=%22redirect.magnet.me%22 Currently we just keep disavowing these links, but at the same time they keep appearing in our Moz.com tooling, being unable to disavow those links here. Does anybody have any successful tips how to deal with this scenario, compared to only disavow new links after the fact?
Intermediate & Advanced SEO | | rogier_slag0 -
Travel site schema problems
I'm developing a travel site for my home state (Kansas - http://www.kansasisbeautiful.com though it's still has some development being worked on), but struggling to find scheme to work with for some items. So far my site is laid out by both region (northeast Kansas, western Kansas, etc.) and location types (waterfalls, parks, etc.). I'm currently working on coding in schema markup. I've found schema types for waterfalls, parks and landmarks, but I'm struggling to find anything for scenic drives (or highways, drives, anything related), hiking/biking trails and regions (northeast Kansas, southeast Kansas, etc.) The question I have is: What can I do to still try and put some kind of markup when there's nothing available that fits the item I'm trying to markup?
Intermediate & Advanced SEO | | msphoto0 -
Fix Google Index error
I changed my blog URL structure Can Someone please let me how to solve this?
Intermediate & Advanced SEO | | Michael.Leonard0 -
Problems with US site being prioritized in Google UK
Our US version (.com) of our site is appearing above the UK version (co.uk) when using Google UK. I know Google has been giving US more priority in the UK market over the last couple years... What is protocol for fixing/dealing with this? Also, and probably more importantly, how do we handle users who are looking for the UK site right now? Majority of our users are coming from the US so we don't want to cause them any inconvenience, but the UK users need an easy way to get to the UK version quickly. Input is much appreciated!
Intermediate & Advanced SEO | | chrisvogel0 -
How long does google index old urls?
Hey guys, We are currently in the process of redesigning a site but in two phases as the timeline issues. So there will be up to a 4 week gap between the 1st and 2nd set of redirects. These urls will be idle 4 weeks before the phase content is ready. What effect if any will this have on the domain and page authority? Thanks Rob
Intermediate & Advanced SEO | | daracreative0 -
Indexed non existent pages, problem appeared after we 301d the url/index to the url.
I recently read that if a site has 2 pages that are live such as: http://www.url.com/index and http://www.url.com/ will come up as duplicate if they are both live... I read that it's best to 301 redirect the http://www.url.com/index and http://www.url.com/. I read that this helps avoid duplicate content and keep all the link juice on one page. We did the 301 for one of our clients and we got about 20,000 errors that did not exist. The errors are of pages that are indexed but do not exist on the server. We are assuming that these indexed (nonexistent) pages are somehow linked to the http://www.url.com/index The links are showing 200 OK. We took off the 301 redirect from the http://www.url.com/index page however now we still have 2 exaact pages, www.url.com/index and http://www.url.com/. What is the best way to solve this issue?
Intermediate & Advanced SEO | | Bryan_Loconto0 -
Rich snippet on main index page
Hello, I am using a 3rd party company to generate reviews for my website. I want to optimize my site for the index page to see a star rating in the SERP. I am pulling the the count of the number of reviews and the average rating from my review partner and rendering this on the page. It is not visible to a visitor to the site. My page has been marked up correctly as you can see using the rich snippet testing tool http://www.google.com/webmasters/tools/richsnippets?url=http%3A%2F%2Fwww.jsshirts.com.au However the stars are not showing in SERP's. Does anyone have any ideas as to why the stars are not showing. Many thanks, Jason
Intermediate & Advanced SEO | | mullsey0 -
Sitemap not indexing pages
My website has about 5000 pages submitted in the sitemap but only 900 being indexed. When I checked Google Webmaster Tools about a week ago 4500 pages were being indexed. Any suggestions about what happened or how to fix it? Thanks!
Intermediate & Advanced SEO | | theLotter0