Site Not Indexing After 2 Weeks - PA at 1
-
Hi Moz Community!
I'm working as a digital marketing consultant for an organization that uses us for their online registration - we do not manage their web page. The issue that I am hoping you might have some ideas on is that their SERPS still aren’t making much of a recovery since they revamped their site in mid August. I ran a MOZ campaign for them and despite that they (eventually) got all their 301s in place, they submitted an updated sitemap to Google, aren’t hitting any crawl errors, and have a working robots.txt over two-thirds of their site pages don’t seem to be indexing. MOZ is giving most of them a Page Authority of 1, and when I login to their GWT, it’s showing me that only 3 pages have been indexed of the 315 URLs submitted.
I know Google doesn’t make any guarantees in index update timelines, but 2+ weeks seems like a long time
Their website is https://www.northshoreymca.org/. The site has a DA of 43 but most of the pages on the main nav are still at 1. They gave me permission to share in this forum because we're really trying to figure out a recovery strategy.
Any thoughts or ideas as to what might be causing this? Is there anything else that you think I should check or that might be causing an issue? Is it possible that Google is just taking this long to index their page? Note: this page is built with Drupal.
THANK YOU!
-
being a standard drupal setting doesn't mean it makes SE friendly anyway I have no backup for that theory, I'm just assuming that new sites should be as simple as possible in order to google to get a better grasp of them and start trusting before complicating thing in an unnecessary way, unless the node url is adding any value to you, I would get rid of it and 301 it to its canonical.
-
Thanks again! I noticed all of this too before I submitted to Q&A but doing a little bit of research (and with my admittedly limited knowledge of the topic) I thought that this was pretty standard for how clean Drupal URLs are setup? Is that incorrect?
-
I would not focus too much on GSC if the site has been recently built, the place where you want your pages to be is google index
The place I would check is GA to see how many of your pages are getting at least 1 visits and which ones don't. You can then look for the pages which are not getting traffic and understand if they are not being indexed or not ranking high.
This page for example https://www.northshoreymca.org/programs/creative-arts I've noticed that you're using the rel="<a class="attribute-value">shortlink</a>", which I don't think it's adding too much value, probably is making things messier, as you two different version of your page, in fact if you check for /node/ folder you're finding pages you don't want (ex.https://www.northshoreymca.org/node/145 instead of this <a class="attribute-value">https://www.northshoreymca.org/content/ymca-north-shore-annual-gala</a>) I would set up a 301 at least so you ensure that google is not deciding which is the best page to index and serve to users, I know you hav a canonical but it could be something you could test, and help google not making too many decisions, especially because canonical is just a recommendation done to bots, and which google normally doesn't follow boldly for new sites.
hoep this helps, let me know how it goes!
-
Yes! Better safe than sorry!
-
Dont get spammy and add all your 300 pages. You cant never know when google pisses off. Be discrete and and dont try to rush all the indexed.
(this is just a myth, but lets not try to probe it). -
You are too kind! I thought we checked into all that stuff too. I'm glad to at least know that we're probably just up against a waiting game and there isn't something fundamentally wrong with the page that's preventing the index. I'll start manually adding main nav links from addurl and cross my fingers.
Thank you again!
-
Yeap. Just wait.
I've checked if there was a problem with robots.txt or the meta robots tag, and there isnt any problem with that particularly page.
You can speed up the indexing of some pages with google.com/addurl -
So here's an example of a page from the main nav on their site that is a problem page:
site:https://www.northshoreymca.org/programs/creative-arts
I guess we're just stuck in a waiting game for pages like this?
Thanks again!
-
You're welcome. We are here to help.
I cannot specify an exact amount of time. I've had sites that were fully indexed and informed in WMT in 3 weeks, and other sites that took over 2 months and only got informed roughly 90% of pages.
Sorry, Google is that way. Sometimes gives is a buch of information and sometimes nothing.
Again, i'd trust what you get in the search results, not what appears in WMT. -
Thanks for the input Oleg. I did verify that in GSC that they are pointing to https://www. so I'm not sure what gives in terms of the discrepancy between the index of 3 pages showing in GSC vs. the several hundred pages showing when you hit site:https://www.northshoreymca.org.
Very new to MOZ and SEO so I really appreciate your time and input!
-
Thanks Gaston! In your experience, are there some generalities you can speak to for the length of time it takes to index a site? I understand that the response to that question is probably relative given a site's size, age, update frequency etc. but would you care to ballpark it?
I'm really new to SEO (and entirely self-taught) so appreciate all the info! Thanks again!
-
Thanks so much! Any thoughts on why their GSC is saying 3 pages indexed? I checked as Oleg suggested above that it was referencing https:www. and verified that it is. I'm very new to the technical side of things so thanks for the help!
-
hey camarin, so far I see 271 URLS indexed for the search "site:https://www.northshoreymca.org". There are of course a couple of changes I would do like try to have a friendlier look to the tag URLs instead of having the tag parameter, but anyway it seems that it's working. Also PA for this page https://www.northshoreymca.org/locations/haverhill/ is 33. I think as you said it was just a matter of time. I hope your problem got fixed.
-
Hi there,
There are some points to mark here:
1- The site was redisigned, as you say there has been restructured the site completely.
2- As some of the URLs seem to be new, still none of them were crawled by roger (moz's bot) and/or they are likely to be considered to no have any leverage. That's some explanation for the PA1.
3- It's known that google takes its time to index the whole site. And also takes its time to inform it in WMT. My advise is to do a search with: 'site;yoursite.com' and check whether there has been an improval in the indexation. Just now im getting 620 results in that search.
4- Being built in Dupal is no metric to google (at least as fas as my knoledge) in order to harm or benefit you. It's transparent for Google.Hope I've helped.
GR. -
I see a good amount of pages indexed: https://www.google.com/search?q=site%3Ahttps%3A%2F%2Fwww.northshoreymca.org%2F
Make sure the profile you are using in GSC (formerly GWT) is the https://www. version of the website (any other profile will show fewer/no indexed pages).
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
International Site Migration
Hi guys, In the process of launching internationally ecommerce site (Magento CMS) for two different countries (Australia and US). Then later on expand to other countries like the UK, Canada, etc. The plan is for each country will have its own sub-folder e.g. www.domain.com/us, www.domain.com.au/au, www.domain.com.au/uk A lot of the content between these English based countries are the same. E.g. same product descriptions.
Intermediate & Advanced SEO | | jayoliverwright
So in order to prevent duplication, from what I’ve read we will need to add Hreflang tags to every single page on the site? So for: Australian pages: United States pages: Just wanted to make sure this is the correct strategy (will hreflang prevent duplicate content issues?) and anything else i should be considering? Thankyou, Chris0 -
With the New Panda update supposedly only weeks away, is it wise to No Index my products I have not had time to rewrite the product descriptions for ?
Hi Mozzers, I read on SEJ yesterday than apparently the Panda update was due in the 2 - 4 weeks. I still have a large of my products which I have not got around to rewriting unique product descriptions for. I know these product descriptions are duplicated on other affiliate sites so do it think it in light of the panda update coming , would it wise to put a NO INDEX Meta tag on these product pages until I get around to rewriting the descriptions. That way, I may not hit my Panda and it will buy me a bit more time. Just an idea , but thought I'd run it by. thanks Pete
Intermediate & Advanced SEO | | PeteC120 -
How to make Google index your site? (Blocked with robots.txt for a long time)
The problem is the for the long time we had a website m.imones.lt but it was blocked with robots.txt.
Intermediate & Advanced SEO | | FCRMediaLietuva
But after a long time we want Google to index it. We unblocked it 1 week or 8 days ago. But Google still does not recognize it. I type site:m.imones.lt and it says it is still blocked with robots.txt What should be the process to make Google crawl this mobile version faster? Thanks!0 -
How to make sure dev site is not index in wordpress and how would it be affected?
hi guys! I'm currently having a dev version of my site (dev.website.com) that once everything is done i would move the dev to the public domain (website.com). But since is a total duplicate content of my real site would it affect the seo? if so, i tried setting the reading privacy in wordpress so google would not index it but im afraid when i live it in the future and revert the setting back to normal it would affect the site seo. any opinion and suggestion on this?
Intermediate & Advanced SEO | | andrewwatson920 -
Moving career site to new URL from main site. Will it hurt SEO for main page?
For one of our clients we are building a career site and putting it under a different URL and hosting service (mainly due to security concerns of hosting it under the same host and domain). almost 100% of the incoming traffic to their current career section (which it is in a sub-folder) receives traffic for branded keywords (brand + job/career/employment), that is, there are no job position specific keywords. The client is now worried that after moving the site, the inbound traffic to the main site will be severely affected as well as the SERP results. My questions are, will the non-career related SERPs be affected? I don't see how will they be but I could be wrong If no, how could we reassure her that the SEO to the main site wont be affected? are there any case studies of a similar case (splitting part of the website under a new URL and hosting service?) Thank you for your help. PS: this is my first post so please forgive me if this has been asked before. I could not find a good response.
Intermediate & Advanced SEO | | rflores0 -
Total Indexed 1.5M vs 83k submitted by sitemap. What?
We recently took a good look at one of our content site's sitemap and tried to cut out a lot of crap that had gotten in there such as .php, .xml, .htm versions of each page. We also cut out images to put in a separate image sitemap. The sitemap generated 83,000+ URLs for google to crawl (this partially used the Yoast Wordpress plugin to generate) In webmaster tools in the index status section is showing that this site has a total index of 1.5 million. With our sitemap coming back with 83k and google indexing 1.5 million pages, is this a sign of a CMS gone rogue? Is it an indication that we could be pumping out error pages or empty templates, or junk pages that we're cramming into Google's bot? I would love to hear what you guys think. Is this normal? Is this something to be concerned about? Should our total index more closely match our sitemap page count?
Intermediate & Advanced SEO | | seoninjaz0 -
Sitemap not indexing pages
My website has about 5000 pages submitted in the sitemap but only 900 being indexed. When I checked Google Webmaster Tools about a week ago 4500 pages were being indexed. Any suggestions about what happened or how to fix it? Thanks!
Intermediate & Advanced SEO | | theLotter0 -
Migrating a site
Hello, I have what a I think it's a noob question.. I have a medium size website and need to put it into maintenance for the next 2 months, and afterwards activate a completly new site. My client asked me to do this, cause the same people whoe run the constant flow of information on the site, are the ones who are going to develop the new site, so he wants to just close it out So... what are the steps for doing this with minimum impact on any SEO advances made this past months?.. How do I tell the search engines, Hey, just under maintenance for a while....then... i'm back in the game but this is my new structure. and the old one should go here
Intermediate & Advanced SEO | | daniel.alvarez0