Google de-indexed a page on my site
-
I have a site which is around 9 months old. For most search terms we rank fine (including top 3 rankings for competitive terms).
Recently one of our pages has been fluctuating wildly in the rankings and has now disappeared altogether from the rankings for over 1 week.
As a test I added a similar page to one of my other sites and it ranks fine.
I've checked webmaster tools and there is nothing of note there.
I'm not really sure what to do at this stage. Any advice would me much appreciated!
-
Another thing which is weird:
If I google "site:medexpress.co.uk" the page /clinics/erectile-dysfunction/viagra appears.
If I google "site:medexpress.co.uk viagra" that page no longer appears!
I could see why my page would have maybe dropped in the rankings but to go from a rank of around 30-70 for most of the keywords for this page to dropping off the index points to something more extraordinary. Its been like this for almost two weeks and I'm considering maybe changing the URL (as I mentioned other long-tail optimized blog pages are now starting to rank so it appears to be just this page).
Is it possible this page has been moved to the supplemental index for some reason?
-
Hi,
The domain actually has plenty of links and that page has two very high quality backlinks. The Moz tool for some reason is missing almost all the backlinks. If you use AHREFS it works much better (remembering to use www as the prefix for the domain).
The domain authority is 49 which is much higher than the bulk of sites on there and higher than the site in position number #1 which has somehow managed to rank with almost no backlinks (it has less than 20) or any quality content.
Whats even weirded I added a page to my other site www.centraltravelclinic.co.uk and it now outranks my main site even though it has less backlinks/relevant content.
There is even a page in my blog section which is now ranking as well.
I'm not sure but it seems as if there is some penalty against this one page...or something has gone wrong on the search index and it has been temporarily removed for whatever reason.
Regards,
Dwayne
-
Hi Everett,
I agree 100% the domain itself has a great name, the lack of domain authority or links undoubtably has taken its toll surprised it ranks for anything the honest without any authority.
A content marketing campaign with high quality content covering the topics he discussed like law, medical care and including tools for the end-user would make it extremely brand worthy.
I think the best way to go about it would be to start a six-month campaign and do some very aggressive work on site.
You have some great advice.
Sincerely,
Thomas
-
Thank you Thomas,
I did have a look at the site and came to the conclusion that it had relatively no domain authority or page/URL-level authority from quality backlinks. The page had no links, and the domain only had a couple, neither of them great. As you mention, this industry is very competitive. It is one of the most competitive niches online.
My recommendation was to embark on a content marketing campaign, possibly one that highlights medical care / law / coverage disparities between countries. The domain itself is very brandable, and if they were to latch onto a hot-topic issue in the right way they could get quoted as experts in that industry by major news outlets, or at least some decent blogs. Meanwhile, steady posting about the lindustry on the blog, occasional white papers or studies created by the company about the the industry... will help build their body of content and present their expertise on the topic. Any tool (calculators, price comparison charts, etc...) would also help. I also mentioned a recommended minimum budget for content creation and paid promotion of it over the next six months.
-
Hi Everett,
There is a good reason for him not not actually posting URL for keywords wants list for.
I think Deelo555 should private message you the information he sent me. They are keywords that are commonly thought of negatively is all I will say.
Deelo555 please send Everett what you sent me.
All the best,
Thomas
-
Deelo555 We'll need more information to be of much help here. Can you post the site and/or the keyword? If not, this is probably going to have to be assisted by private message with someone.
I'd look for over-optimized anchor text or spammy links going into that page just to make sure. From there I would look into whether the content on the page "should" rank for the keyword. In other words, does it answer the query or give the searcher what they are looking for? After that I would move on to general user experience. Does the site look good, trustworthy, authoritative...
Follow that path and you'll probably uncover some things to improve. If not, let us know.
-
I replied to the private message I hope it is helpful.
-
Fluxing sometimes can mean Google is testing your site verse the other competitors for that keyword.
If Google is unable to determine what is the most enjoyed by the end-user so they will allow for you to fluctuate in the SERPS.
If people query your keyword find your site in the SERPS then immediately leave once they have landed on your website. That is called "Pogo sticking" Google is simply trying to find out whether or not you are the best fit for that keyword.
1st off if you could test the site some of the tools below
https://moz.com/researchtools/crawl-test
http://deepcrawl.co.uk/ (Amazing tool)
http://www.screamingfrog.co.uk/seo-spider/ ( everyone should have a copy I recommend the paid but you can crawl 500 pages for free using SF free addition)
You want to be see what Google bot can see your site can do that using
http://www.feedthebot.com/tools/
Check your Robots.txt using
http://www.internetmarketingninjas.com/seo-tools/robots-txt-generator/ ( this will pull the file sometimes there are more than 1 it does happen)
make sure that if you're using WordPress or other similar CMS is that Google bot is not being blocked from seeing J query
The reason for this is Google cannot see the site as it might be shown to the end user therefore they would be less likely to come back & index
https://www.authoritydev.com/dont-block-jquery-from-googlebot/
once we have completed eliminated and chance of robots.txt or no follow / no index then you will want to look at your entire website Very thoroughly.
I do not know how old your domain is could you share its age?
what is your domain authority? what is the page authority of pages not being indexed?
we need to look at all of this before we can render a verdict.
If you're uncomfortable sharing your URL publicly you're welcome to send it to me privately.
what type of URLs are pointing (if any) Internal or external are pointing at your pages that are not indexing.
Sincerely,
Thomas
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Redirecting Pages During Site Migration
Hi everyone, We are changing a website's domain name. The site architecture will stay the same, but we are renaming some pages. How do we treat redirects? I read this on Search Engine Land: The ideal way to set up your redirects is with a regex expression in the .htaccess file of your old site. The regex expression should simply swap out your domain name, or swap out HTTP for HTTPS if you are doing an SSL migration. For any pages where this isn’t possible, you will need to set up an individual redirect. Make sure this doesn’t create any conflicts with your regex and that it doesn’t produce any redirect chains. Does the above mean we are able to set up a domain redirect on the regex for pages that we are not renaming and then have individual 1:1 redirects for renamed pages in the same .htaccess file? So have both? This will not conflict with the regex rule?
Intermediate & Advanced SEO | | nhhernandez0 -
Substantial difference between Number of Indexed Pages and Sitemap Pages
Hey there, I am doing a website audit at the moment. I've notices substantial differences in the number of pages indexed (search console), the number of pages in the sitemap and the number I am getting when I crawl the page with screamingfrog (see below). Would those discrepancies concern you? The website and its rankings seems fine otherwise. Total indexed: 2,360 (Search Consule)
Intermediate & Advanced SEO | | Online-Marketing-Guy
About 2,920 results (Google search "site:example.com")
Sitemap: 1,229 URLs
Screemingfrog Spider: 1,352 URLs Cheers,
Jochen0 -
How do you check the google cache for hashbang pages?
So we use http://webcache.googleusercontent.com/search?q=cache:x.com/#!/hashbangpage to check what googlebot has cached but when we try to use this method for hashbang pages, we get the x.com's cache... not x.com/#!/hashbangpage That actually makes sense because the hashbang is part of the homepage in that case so I get why the cache returns back the homepage. My question is - how can you actually look up the cache for hashbang page?
Intermediate & Advanced SEO | | navidash0 -
When does Google index a fetched page?
I have seen where it will index on of my pages within 5 minutes of fetching, but have also read that it can take a day. I'm on day #2 and it appears that it has still not re-indexed 15 pages that I fetched. I changed the meta-description in all of them, and added content to nearly all of them, but none of those changes are showing when I do a site:www.site/page I'm trying to test changes in this manner, so it is important for me to know WHEN a fetched page has been indexed, or at least IF it has. How can I tell what is going on?
Intermediate & Advanced SEO | | friendoffood0 -
JavaScript Issue? Google not indexing a microsite
We have a microsite that was created on our domain but is not linked to from ANYwhere EXCEPT within some Javascript elements on pages on our site. The link is in one JQuery slide panel. The microsite is not being indexed at all - when i do site:(microsite name) on Google, it doesn't return anything. I think it's because the link's only in a Java element, but my client assures me that if I submit to Google for crawling the problem will be solved. Maybe so, but my point is that if you just create a simple HTML link from at least one of our site pages, it will get indexed no problem. The microsite has been up for months and it's still not being indexed - another newer microsite that's been up for a few weeks and has simple links to it from our pages is indexing fine. I have submitted the URL for crawling but had to use the google.com/webmasters/tools/submit-url/ method as I don't have access to the top level domain WMT account. p.s. when we put the microsite URL into the SEOBook spider-test tool it returns lots of lovely information - but that just tells me the page is findable, does exist, right? That doesn't mean Google's going to necessarily index it, as I am surmising...Moz hasn't found in the 5 months the microsite has been up and running. What's going on here?
Intermediate & Advanced SEO | | Jen_Floyd0 -
Why is our page will not being found by google?
Hi, We have a page that went live nearly 2 months ago. https://www.invoicestudio.com/Secure/InvoiceTemplate Why does google not notice it. Both site: URL's return nothing. site:www.invoicestudio.com/Secure/InvoiceTemplate site:www.invoicestudio.com/Secure This is an important page for us and do not understand why google doesn't like it. Hope you can help Thanks Andrew
Intermediate & Advanced SEO | | Studio330 -
Merging your google places page with google plus page.
I have a map listing showing for the keyword junk cars for cash nj. I recently created a new g+ page and requested a merge between the places and the + page. now when you do a search you see the following. Junk Cars For Cash NJ LLC
Intermediate & Advanced SEO | | junkcars
junkcarforcashnj.com/
Google+ page - Google+ page the first hyperlink takes me to the about page of the G+ and the second link takes me to the posts section within g+. Is this normal? should i delete the places account where the listing was originally created? Or do i leave it as is? Thanks0 -
Best practice for removing indexed internal search pages from Google?
Hi Mozzers I know that it’s best practice to block Google from indexing internal search pages, but what’s best practice when “the damage is done”? I have a project where a substantial part of our visitors and income lands on an internal search page, because Google has indexed them (about 3 %). I would like to block Google from indexing the search pages via the meta noindex,follow tag because: Google Guidelines: “Use robots.txt to prevent crawling of search results pages or other auto-generated pages that don't add much value for users coming from search engines.” http://support.google.com/webmasters/bin/answer.py?hl=en&answer=35769 Bad user experience The search pages are (probably) stealing rankings from our real landing pages Webmaster Notification: “Googlebot found an extremely high number of URLs on your site” with links to our internal search results I want to use the meta tag to keep the link juice flowing. Do you recommend using the robots.txt instead? If yes, why? Should we just go dark on the internal search pages, or how shall we proceed with blocking them? I’m looking forward to your answer! Edit: Google have currently indexed several million of our internal search pages.
Intermediate & Advanced SEO | | HrThomsen0