Site Not Indexing After 2 Weeks - PA at 1
-
Hi Moz Community!
I'm working as a digital marketing consultant for an organization that uses us for their online registration - we do not manage their web page. The issue that I am hoping you might have some ideas on is that their SERPS still aren’t making much of a recovery since they revamped their site in mid August. I ran a MOZ campaign for them and despite that they (eventually) got all their 301s in place, they submitted an updated sitemap to Google, aren’t hitting any crawl errors, and have a working robots.txt over two-thirds of their site pages don’t seem to be indexing. MOZ is giving most of them a Page Authority of 1, and when I login to their GWT, it’s showing me that only 3 pages have been indexed of the 315 URLs submitted.
I know Google doesn’t make any guarantees in index update timelines, but 2+ weeks seems like a long time
Their website is https://www.northshoreymca.org/. The site has a DA of 43 but most of the pages on the main nav are still at 1. They gave me permission to share in this forum because we're really trying to figure out a recovery strategy.
Any thoughts or ideas as to what might be causing this? Is there anything else that you think I should check or that might be causing an issue? Is it possible that Google is just taking this long to index their page? Note: this page is built with Drupal.
THANK YOU!
-
being a standard drupal setting doesn't mean it makes SE friendly anyway I have no backup for that theory, I'm just assuming that new sites should be as simple as possible in order to google to get a better grasp of them and start trusting before complicating thing in an unnecessary way, unless the node url is adding any value to you, I would get rid of it and 301 it to its canonical.
-
Thanks again! I noticed all of this too before I submitted to Q&A but doing a little bit of research (and with my admittedly limited knowledge of the topic) I thought that this was pretty standard for how clean Drupal URLs are setup? Is that incorrect?
-
I would not focus too much on GSC if the site has been recently built, the place where you want your pages to be is google index
The place I would check is GA to see how many of your pages are getting at least 1 visits and which ones don't. You can then look for the pages which are not getting traffic and understand if they are not being indexed or not ranking high.
This page for example https://www.northshoreymca.org/programs/creative-arts I've noticed that you're using the rel="<a class="attribute-value">shortlink</a>", which I don't think it's adding too much value, probably is making things messier, as you two different version of your page, in fact if you check for /node/ folder you're finding pages you don't want (ex.https://www.northshoreymca.org/node/145 instead of this <a class="attribute-value">https://www.northshoreymca.org/content/ymca-north-shore-annual-gala</a>) I would set up a 301 at least so you ensure that google is not deciding which is the best page to index and serve to users, I know you hav a canonical but it could be something you could test, and help google not making too many decisions, especially because canonical is just a recommendation done to bots, and which google normally doesn't follow boldly for new sites.
hoep this helps, let me know how it goes!
-
Yes! Better safe than sorry!
-
Dont get spammy and add all your 300 pages. You cant never know when google pisses off. Be discrete and and dont try to rush all the indexed.
(this is just a myth, but lets not try to probe it). -
You are too kind! I thought we checked into all that stuff too. I'm glad to at least know that we're probably just up against a waiting game and there isn't something fundamentally wrong with the page that's preventing the index. I'll start manually adding main nav links from addurl and cross my fingers.
Thank you again!
-
Yeap. Just wait.
I've checked if there was a problem with robots.txt or the meta robots tag, and there isnt any problem with that particularly page.
You can speed up the indexing of some pages with google.com/addurl -
So here's an example of a page from the main nav on their site that is a problem page:
site:https://www.northshoreymca.org/programs/creative-arts
I guess we're just stuck in a waiting game for pages like this?
Thanks again!
-
You're welcome. We are here to help.
I cannot specify an exact amount of time. I've had sites that were fully indexed and informed in WMT in 3 weeks, and other sites that took over 2 months and only got informed roughly 90% of pages.
Sorry, Google is that way. Sometimes gives is a buch of information and sometimes nothing.
Again, i'd trust what you get in the search results, not what appears in WMT. -
Thanks for the input Oleg. I did verify that in GSC that they are pointing to https://www. so I'm not sure what gives in terms of the discrepancy between the index of 3 pages showing in GSC vs. the several hundred pages showing when you hit site:https://www.northshoreymca.org.
Very new to MOZ and SEO so I really appreciate your time and input!
-
Thanks Gaston! In your experience, are there some generalities you can speak to for the length of time it takes to index a site? I understand that the response to that question is probably relative given a site's size, age, update frequency etc. but would you care to ballpark it?
I'm really new to SEO (and entirely self-taught) so appreciate all the info! Thanks again!
-
Thanks so much! Any thoughts on why their GSC is saying 3 pages indexed? I checked as Oleg suggested above that it was referencing https:www. and verified that it is. I'm very new to the technical side of things so thanks for the help!
-
hey camarin, so far I see 271 URLS indexed for the search "site:https://www.northshoreymca.org". There are of course a couple of changes I would do like try to have a friendlier look to the tag URLs instead of having the tag parameter, but anyway it seems that it's working. Also PA for this page https://www.northshoreymca.org/locations/haverhill/ is 33. I think as you said it was just a matter of time. I hope your problem got fixed.
-
Hi there,
There are some points to mark here:
1- The site was redisigned, as you say there has been restructured the site completely.
2- As some of the URLs seem to be new, still none of them were crawled by roger (moz's bot) and/or they are likely to be considered to no have any leverage. That's some explanation for the PA1.
3- It's known that google takes its time to index the whole site. And also takes its time to inform it in WMT. My advise is to do a search with: 'site;yoursite.com' and check whether there has been an improval in the indexation. Just now im getting 620 results in that search.
4- Being built in Dupal is no metric to google (at least as fas as my knoledge) in order to harm or benefit you. It's transparent for Google.Hope I've helped.
GR. -
I see a good amount of pages indexed: https://www.google.com/search?q=site%3Ahttps%3A%2F%2Fwww.northshoreymca.org%2F
Make sure the profile you are using in GSC (formerly GWT) is the https://www. version of the website (any other profile will show fewer/no indexed pages).
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Magento 1.9 SEO. I have product pages with identical On Page SEO score in the 90's. Some pull up Google page 1 some won't pull up at all. I am searching for the exact title on that page.
I have a website built on Magento 1.9. There are approximately 290,000 part numbers on the site. I am sampling Google SERP results. About 20% of the keywords show up on page 1 position 5 thru 10. 80% don't show up at all. When I do a MOZ page score I get high 80's to 90's. A page score of 89 on one part # may show up on page one, An identical page score on a different part # can't be found on Google. I am searching for the exact part # in the page title. Any thoughts on what may be going on? This seems to me like a Magento SEO issue.
Intermediate & Advanced SEO | | CTOPDS0 -
URLs are not indexed
My website has 0.5 million pages with urls like this- **http://www.mycity4kids.com/Delhi-NCR/collage-painting-classes-%3cnear%3e-shalimar-bagh ****, **none of these urls are indexed. Question 1- What can be the possible reason for this issue? Users see this url as : http://www.mycity4kids.com/Delhi-NCR/collage-painting-classes-<near>-shalimar-bagh</near>
Intermediate & Advanced SEO | | prsntsnh
The symbol "<" and ">" get converted into "%3c" and "%3e" respectively, is this the reason for these urls not getting indexed?0 -
3 Wordpress sites 1 Tumblr site coming under 1domain(4subdomains) WPMU: Proper Redirect?
Hey Guys, witnessSF.org (WP), witnessLA.org(Tumblr), witnessTO.com(WP), witnessHK.com(WP), and witnessSEOUL.com(new site no redirects needed) are being moved over to sf.ourwitness.com, la.ourwitness.com and so forth. All under on large Wordpress MU instance. Some have hundreds of articles/links others a bit less. What is the best method to take, I understand there are easy redirects, and the complete fully manual one link at a time approach. Even the WP to WP the permalinks are changing from domain.com/date/post-name to domain.com/post-name? Here are some options: Just redirect all previous witinessla.org/* to la.ourwitness.org/ (automatic direct all pages to home page deal) (easiest not the best)2) Download Google Analytics top redirected domains about 50 urls have significant ranking and traffic (in LA's sample) and just redirect those to custom links. (most bang for the buck for the articles that rank manually set up to the correct place) 3) Best of the both worlds may be possible? Automated perhaps?I prefer working with .htaccess vs a redirect plugin for speed issues. Please advise. Thanks guys!
Intermediate & Advanced SEO | | vmialik0 -
Mobile Site Outranking Main Site
Hi, We have recently been hit with a problem regarding our mobile site, where it is outranking our main site. This is causing a drop in orders and ranknings for our main site. It would appear that google has indexed our mobile site and so the two are now competing against each other. Our main site is on a .co.uk and our mobile site on a .mobi, but we have now taken down the mobile site until we get this sorted. Does anyone else have any experience of this happening and how to stop it happening again? Thanks Steve
Intermediate & Advanced SEO | | Steve251 -
Indexed non existent pages, problem appeared after we 301d the url/index to the url.
I recently read that if a site has 2 pages that are live such as: http://www.url.com/index and http://www.url.com/ will come up as duplicate if they are both live... I read that it's best to 301 redirect the http://www.url.com/index and http://www.url.com/. I read that this helps avoid duplicate content and keep all the link juice on one page. We did the 301 for one of our clients and we got about 20,000 errors that did not exist. The errors are of pages that are indexed but do not exist on the server. We are assuming that these indexed (nonexistent) pages are somehow linked to the http://www.url.com/index The links are showing 200 OK. We took off the 301 redirect from the http://www.url.com/index page however now we still have 2 exaact pages, www.url.com/index and http://www.url.com/. What is the best way to solve this issue?
Intermediate & Advanced SEO | | Bryan_Loconto0 -
XML Sitemap Index Percentage (Large Sites)
Hi all I'm wanting to find out from those who have experience dealing with large sites (10s/100s of millions of pages). What's a typical (or highest) percentage of indexed pages vs. submitted pages you've seen? This information can be found in webmaster tools where Google shows you the pages submitted & indexed for each of your sitemap. I'm trying to figure out whether, The average index % out there There is a ceiling (i.e. will never reach 100%) It's possible to improve the indexing percentage further Just to give you some background, sitemap index files (according to schema.org) have been implemented to improve crawl efficiency and I'm wanting to find out other ways to improve this further. I've been thinking about looking at the URL parameters to exclude as there are hundreds (e-commerce site) to help Google improve crawl efficiency and utilise the daily crawl quote more effectively to discover pages that have not been discovered yet. However, I'm not sure yet whether this is the best path to take or I'm just flogging a dead horse if there is such a ceiling or if I'm already at the average ballpark for large sites. Any suggestions/insights would be appreciated. Thanks.
Intermediate & Advanced SEO | | danng0 -
Can you see the 'indexing rules' that are in place for your own site?
By 'index rules' I mean the stipulations that constitute whether or not a given page will be indexed. If you can see them - how?
Intermediate & Advanced SEO | | Visually0 -
Scapers and Other Sites Outranking
Post panda, there is definitely more talk about scrapers or other (more authoritative) sites outranking the original content creators in the SERPS. The most common way this problem is addressed (from what I've seen) is by rewriting the content and try your hardest to be the first one to be indexed or just ignoring it from an on page standpoint and do more link dev. Does anyone have any advice on the best way to address? Should site owners be looking deeper into their analytics and diagnostics before doing the rewrites?
Intermediate & Advanced SEO | | Troyville0