Site Not Indexing After 2 Weeks - PA at 1
-
Hi Moz Community!
I'm working as a digital marketing consultant for an organization that uses us for their online registration - we do not manage their web page. The issue that I am hoping you might have some ideas on is that their SERPS still aren’t making much of a recovery since they revamped their site in mid August. I ran a MOZ campaign for them and despite that they (eventually) got all their 301s in place, they submitted an updated sitemap to Google, aren’t hitting any crawl errors, and have a working robots.txt over two-thirds of their site pages don’t seem to be indexing. MOZ is giving most of them a Page Authority of 1, and when I login to their GWT, it’s showing me that only 3 pages have been indexed of the 315 URLs submitted.
I know Google doesn’t make any guarantees in index update timelines, but 2+ weeks seems like a long time
Their website is https://www.northshoreymca.org/. The site has a DA of 43 but most of the pages on the main nav are still at 1. They gave me permission to share in this forum because we're really trying to figure out a recovery strategy.
Any thoughts or ideas as to what might be causing this? Is there anything else that you think I should check or that might be causing an issue? Is it possible that Google is just taking this long to index their page? Note: this page is built with Drupal.
THANK YOU!
-
being a standard drupal setting doesn't mean it makes SE friendly anyway I have no backup for that theory, I'm just assuming that new sites should be as simple as possible in order to google to get a better grasp of them and start trusting before complicating thing in an unnecessary way, unless the node url is adding any value to you, I would get rid of it and 301 it to its canonical.
-
Thanks again! I noticed all of this too before I submitted to Q&A but doing a little bit of research (and with my admittedly limited knowledge of the topic) I thought that this was pretty standard for how clean Drupal URLs are setup? Is that incorrect?
-
I would not focus too much on GSC if the site has been recently built, the place where you want your pages to be is google index
The place I would check is GA to see how many of your pages are getting at least 1 visits and which ones don't. You can then look for the pages which are not getting traffic and understand if they are not being indexed or not ranking high.
This page for example https://www.northshoreymca.org/programs/creative-arts I've noticed that you're using the rel="<a class="attribute-value">shortlink</a>", which I don't think it's adding too much value, probably is making things messier, as you two different version of your page, in fact if you check for /node/ folder you're finding pages you don't want (ex.https://www.northshoreymca.org/node/145 instead of this <a class="attribute-value">https://www.northshoreymca.org/content/ymca-north-shore-annual-gala</a>) I would set up a 301 at least so you ensure that google is not deciding which is the best page to index and serve to users, I know you hav a canonical but it could be something you could test, and help google not making too many decisions, especially because canonical is just a recommendation done to bots, and which google normally doesn't follow boldly for new sites.
hoep this helps, let me know how it goes!
-
Yes! Better safe than sorry!
-
Dont get spammy and add all your 300 pages. You cant never know when google pisses off. Be discrete and and dont try to rush all the indexed.
(this is just a myth, but lets not try to probe it). -
You are too kind! I thought we checked into all that stuff too. I'm glad to at least know that we're probably just up against a waiting game and there isn't something fundamentally wrong with the page that's preventing the index. I'll start manually adding main nav links from addurl and cross my fingers.
Thank you again!
-
Yeap. Just wait.
I've checked if there was a problem with robots.txt or the meta robots tag, and there isnt any problem with that particularly page.
You can speed up the indexing of some pages with google.com/addurl -
So here's an example of a page from the main nav on their site that is a problem page:
site:https://www.northshoreymca.org/programs/creative-arts
I guess we're just stuck in a waiting game for pages like this?
Thanks again!
-
You're welcome. We are here to help.
I cannot specify an exact amount of time. I've had sites that were fully indexed and informed in WMT in 3 weeks, and other sites that took over 2 months and only got informed roughly 90% of pages.
Sorry, Google is that way. Sometimes gives is a buch of information and sometimes nothing.
Again, i'd trust what you get in the search results, not what appears in WMT. -
Thanks for the input Oleg. I did verify that in GSC that they are pointing to https://www. so I'm not sure what gives in terms of the discrepancy between the index of 3 pages showing in GSC vs. the several hundred pages showing when you hit site:https://www.northshoreymca.org.
Very new to MOZ and SEO so I really appreciate your time and input!
-
Thanks Gaston! In your experience, are there some generalities you can speak to for the length of time it takes to index a site? I understand that the response to that question is probably relative given a site's size, age, update frequency etc. but would you care to ballpark it?
I'm really new to SEO (and entirely self-taught) so appreciate all the info! Thanks again!
-
Thanks so much! Any thoughts on why their GSC is saying 3 pages indexed? I checked as Oleg suggested above that it was referencing https:www. and verified that it is. I'm very new to the technical side of things so thanks for the help!
-
hey camarin, so far I see 271 URLS indexed for the search "site:https://www.northshoreymca.org". There are of course a couple of changes I would do like try to have a friendlier look to the tag URLs instead of having the tag parameter, but anyway it seems that it's working. Also PA for this page https://www.northshoreymca.org/locations/haverhill/ is 33. I think as you said it was just a matter of time. I hope your problem got fixed.
-
Hi there,
There are some points to mark here:
1- The site was redisigned, as you say there has been restructured the site completely.
2- As some of the URLs seem to be new, still none of them were crawled by roger (moz's bot) and/or they are likely to be considered to no have any leverage. That's some explanation for the PA1.
3- It's known that google takes its time to index the whole site. And also takes its time to inform it in WMT. My advise is to do a search with: 'site;yoursite.com' and check whether there has been an improval in the indexation. Just now im getting 620 results in that search.
4- Being built in Dupal is no metric to google (at least as fas as my knoledge) in order to harm or benefit you. It's transparent for Google.Hope I've helped.
GR. -
I see a good amount of pages indexed: https://www.google.com/search?q=site%3Ahttps%3A%2F%2Fwww.northshoreymca.org%2F
Make sure the profile you are using in GSC (formerly GWT) is the https://www. version of the website (any other profile will show fewer/no indexed pages).
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Should m-dot sites be indexed at all
I have a client with a site with a m-dot mobile version. They will move it to a responsive site sometime next year but in meanwhile I have a massive doubt. This m-dot site has some 30k indexed pages in Google. Each of this page is bidirectionally linked to the www. version (rel="alternate on the www, rel canonical on the m-dot) There is no noindex on the m-dot site, so I understand that Google might decide to index the m-dot pages regardless of the canonical to the www site. But my doubts stays: is it a bad thing that both the version are indexed? Is this having a negative impact on the crawling budget? Or risking some other bad consequence? and how is the mobile-first going to impact on this? Thanks
Intermediate & Advanced SEO | | newbiebird0 -
Something happened within the last 2 weeks on our WordPress-hosted site that created "duplicates" by counting www.company.com/example and company.com/example (without the 'www.') as separate pages. Any idea what could have happened, and how to fix it?
Our website is running through WordPress. We've been running Moz for over a month now. Only recently, within the past 2 weeks, have we been alerted to over 100 duplicate pages. It appears something happened that created a duplicate of every single page on our site; "www.company.com/example" and "company.com/example." Again, according to our MOZ, this is a recent issue. I'm almost certain that prior to a couple of weeks ago, there existed both forms of the URL that directed to the same page without be counting as a duplicate. Thanks for you help!
Intermediate & Advanced SEO | | wzimmer0 -
I've got duplicate pages. For example, blog/page/2 is the same as author/admin/page/2\. Is this something I should just ignore, or should I create the author/admin/page2 and then 301 redirect?
I'm going through the crawl report and it says I've got duplicate pages. For example, blog/page/2 is the same as author/admin/page/2/ Now, the author/admin/page/2 I can't even find in WordPress, but it is the same thing as blog/page/2 nonetheless. Is this something I should just ignore, or should I create the author/admin/page2 and then 301 redirect it to blog/page/2?
Intermediate & Advanced SEO | | shift-inc0 -
Seo for international sites
Hello, I have a question for the group, our main US site- http://www.datacard.com is utilized to move content to other regional sites like http://www.datacard.co.uk/ and http://www.datacard.fr/ and http://www.datacard.com.br/. Anyhow, we essentially have some regional content on those sites, but for ease of maintaining and updating the content we have a company translate this for us and then undergo an in country review for local people in our company to review the content. That being said the meta descriptions, titles, code, everything gets translated to that language. I know there are issue for SEO for these purposes as we get much better rankings with http://www.datacard.com. The regional sites are newer so this could be part of it. We don't have an agency helping us with SEo and i get a lot of questions on what can be done internally for this for regional sites with our current structure. Any tips you have? It would be greatly appreciated! Laura
Intermediate & Advanced SEO | | lauramrobinson320 -
Is my site penalized by Google?
Let's say my website is aaaaa.com and company name is aaaaa Systems. When I search Google aaaaa my site do not come up at all. When I search for "aaaaa Systems" it comes up. But in WMT I see quite a few clicks from aaaaa as keyword. Most of the traffic is brand keywords only. I never received any manual penalty in WMT ever. Is the site penalized or regular algorithm issues?
Intermediate & Advanced SEO | | ajiabs0 -
Reindexing a site with www.
We have a site that has a mirror - i.e. www.domain.com and domain.com - there is not redirect both url's work and show pages so basically a site with 2 sets of URLs for each page. We have changed it so the domain.com and all assorted pages 301 redirect to the right URL with www. i.e. domain.com/about 301's to www.domain.com/about In the search engines the domain.com is the site indexed and the only www. page indexed is the homepage. I checked in the robots.txt file and nothing blocking the search engines from indexing both the www. and non www. versions of the site which makes me wonder why did only one version get indexed and how did the clients avoid a duplicate content issue? Secondly is it best to get the search engines to unidex domain.com and resubmit www.domain.com for the full site? We are definately staying with the www.domain.com NOT domain.com so need to find the best way to get the site indexed with www. and remove the non www. Hope that makes sense and look forward to everyone's input.
Intermediate & Advanced SEO | | JohnW-UK0 -
Indexing an e-commerce site
Hi all, My client babyblingstreet.com. She sells baby and toddler clothing. Now a lot of the links on her site contain the same products. For instance: if you go to "What's new" you can find those same products in let's say her "Sale Items" link category. The real problem with this is let's say my client sells a green dress and someone accesses it through the "baby and toddler dresses" category. And let's say this URL has 10 links pointing to it. Now, let's say someone else accesses this same green dress through the "What's new" category. And let's say this particular URL has 10 links pointing to it. Instead of having 20 links pointing to one URL about the green dress, I now have 10 links pointing to one URL and 10 pointing to another URL even though both URLs feature the exact same green dress. In this particular example I would want to make the URL of the green dress in the "baby and toddler clothing" section be the canonical URL. So that means I would have to use this canonical tag on the green dress URL that's in the "what's new" category and let's say also the "sale items" category. This could get very tedious if my client has 200+ products. So I am wondering if I have to place a canonical tag on every URL that displays the green dress? More importantly, I would like to know other people's strategies for indexing e-commerce sites that have the same product featured in multiple categories throughout the site. I hope this makes sense. Thanks for your time.
Intermediate & Advanced SEO | | jenga110 -
Scapers and Other Sites Outranking
Post panda, there is definitely more talk about scrapers or other (more authoritative) sites outranking the original content creators in the SERPS. The most common way this problem is addressed (from what I've seen) is by rewriting the content and try your hardest to be the first one to be indexed or just ignoring it from an on page standpoint and do more link dev. Does anyone have any advice on the best way to address? Should site owners be looking deeper into their analytics and diagnostics before doing the rewrites?
Intermediate & Advanced SEO | | Troyville0