Site Not Indexing After 2 Weeks - PA at 1
-
Hi Moz Community!
I'm working as a digital marketing consultant for an organization that uses us for their online registration - we do not manage their web page. The issue that I am hoping you might have some ideas on is that their SERPS still aren’t making much of a recovery since they revamped their site in mid August. I ran a MOZ campaign for them and despite that they (eventually) got all their 301s in place, they submitted an updated sitemap to Google, aren’t hitting any crawl errors, and have a working robots.txt over two-thirds of their site pages don’t seem to be indexing. MOZ is giving most of them a Page Authority of 1, and when I login to their GWT, it’s showing me that only 3 pages have been indexed of the 315 URLs submitted.
I know Google doesn’t make any guarantees in index update timelines, but 2+ weeks seems like a long time
Their website is https://www.northshoreymca.org/. The site has a DA of 43 but most of the pages on the main nav are still at 1. They gave me permission to share in this forum because we're really trying to figure out a recovery strategy.
Any thoughts or ideas as to what might be causing this? Is there anything else that you think I should check or that might be causing an issue? Is it possible that Google is just taking this long to index their page? Note: this page is built with Drupal.
THANK YOU!
-
being a standard drupal setting doesn't mean it makes SE friendly
anyway I have no backup for that theory, I'm just assuming that new sites should be as simple as possible in order to google to get a better grasp of them and start trusting before complicating thing in an unnecessary way, unless the node url is adding any value to you, I would get rid of it and 301 it to its canonical.
-
Thanks again! I noticed all of this too before I submitted to Q&A but doing a little bit of research (and with my admittedly limited knowledge of the topic) I thought that this was pretty standard for how clean Drupal URLs are setup? Is that incorrect?
-
I would not focus too much on GSC if the site has been recently built, the place where you want your pages to be is google index
The place I would check is GA to see how many of your pages are getting at least 1 visits and which ones don't. You can then look for the pages which are not getting traffic and understand if they are not being indexed or not ranking high.
This page for example https://www.northshoreymca.org/programs/creative-arts I've noticed that you're using the rel="<a class="attribute-value">shortlink</a>", which I don't think it's adding too much value, probably is making things messier, as you two different version of your page, in fact if you check for /node/ folder you're finding pages you don't want (ex.https://www.northshoreymca.org/node/145 instead of this <a class="attribute-value">https://www.northshoreymca.org/content/ymca-north-shore-annual-gala</a>) I would set up a 301 at least so you ensure that google is not deciding which is the best page to index and serve to users, I know you hav a canonical but it could be something you could test, and help google not making too many decisions, especially because canonical is just a recommendation done to bots, and which google normally doesn't follow boldly for new sites.
hoep this helps, let me know how it goes!
-
Yes! Better safe than sorry!
-
Dont get spammy and add all your 300 pages. You cant never know when google pisses off. Be discrete and and dont try to rush all the indexed.
(this is just a myth, but lets not try to probe it). -
You are too kind! I thought we checked into all that stuff too. I'm glad to at least know that we're probably just up against a waiting game and there isn't something fundamentally wrong with the page that's preventing the index. I'll start manually adding main nav links from addurl and cross my fingers.
Thank you again!
-
Yeap. Just wait.
I've checked if there was a problem with robots.txt or the meta robots tag, and there isnt any problem with that particularly page.
You can speed up the indexing of some pages with google.com/addurl -
So here's an example of a page from the main nav on their site that is a problem page:
site:https://www.northshoreymca.org/programs/creative-arts
I guess we're just stuck in a waiting game for pages like this?
Thanks again!
-
You're welcome. We are here to help.
I cannot specify an exact amount of time. I've had sites that were fully indexed and informed in WMT in 3 weeks, and other sites that took over 2 months and only got informed roughly 90% of pages.
Sorry, Google is that way. Sometimes gives is a buch of information and sometimes nothing.
Again, i'd trust what you get in the search results, not what appears in WMT. -
Thanks for the input Oleg. I did verify that in GSC that they are pointing to https://www. so I'm not sure what gives in terms of the discrepancy between the index of 3 pages showing in GSC vs. the several hundred pages showing when you hit site:https://www.northshoreymca.org.
Very new to MOZ and SEO so I really appreciate your time and input!
-
Thanks Gaston! In your experience, are there some generalities you can speak to for the length of time it takes to index a site? I understand that the response to that question is probably relative given a site's size, age, update frequency etc. but would you care to ballpark it?
I'm really new to SEO (and entirely self-taught) so appreciate all the info! Thanks again!
-
Thanks so much! Any thoughts on why their GSC is saying 3 pages indexed? I checked as Oleg suggested above that it was referencing https:www. and verified that it is. I'm very new to the technical side of things so thanks for the help!
-
hey camarin, so far I see 271 URLS indexed for the search "site:https://www.northshoreymca.org". There are of course a couple of changes I would do like try to have a friendlier look to the tag URLs instead of having the tag parameter, but anyway it seems that it's working. Also PA for this page https://www.northshoreymca.org/locations/haverhill/ is 33. I think as you said it was just a matter of time. I hope your problem got fixed.
-
Hi there,
There are some points to mark here:
1- The site was redisigned, as you say there has been restructured the site completely.
2- As some of the URLs seem to be new, still none of them were crawled by roger (moz's bot) and/or they are likely to be considered to no have any leverage. That's some explanation for the PA1.
3- It's known that google takes its time to index the whole site. And also takes its time to inform it in WMT. My advise is to do a search with: 'site;yoursite.com' and check whether there has been an improval in the indexation. Just now im getting 620 results in that search.
4- Being built in Dupal is no metric to google (at least as fas as my knoledge) in order to harm or benefit you. It's transparent for Google.Hope I've helped.
GR. -
I see a good amount of pages indexed: https://www.google.com/search?q=site%3Ahttps%3A%2F%2Fwww.northshoreymca.org%2F
Make sure the profile you are using in GSC (formerly GWT) is the https://www. version of the website (any other profile will show fewer/no indexed pages).
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google Mobile site crawl returns poorer results on 100% responsive site
Has anyone experienced an issue where Google Mobile site crawl returns poorer results than their Desktop site crawl on a 100% responsive website that passes all Google Mobile tests?
Intermediate & Advanced SEO | | MFCommunications0 -
How to make Google index your site? (Blocked with robots.txt for a long time)
The problem is the for the long time we had a website m.imones.lt but it was blocked with robots.txt.
Intermediate & Advanced SEO | | FCRMediaLietuva
But after a long time we want Google to index it. We unblocked it 1 week or 8 days ago. But Google still does not recognize it. I type site:m.imones.lt and it says it is still blocked with robots.txt What should be the process to make Google crawl this mobile version faster? Thanks!0 -
Which URLs were indexed 2 years ago?
Hi, I hope anyone can help me with this issue. Our french domain experienced a huge drop of indexed URLs in 2012. More than 50k URLs were indexed, after the drop less than 10k were counted. I would like to check what happened here and which URLs were thrown out of the index. So I was thinking about a comparison between todays data and the data of 2012. Unfortunately we don't have any data on the indexed pages in 2012 beside the number of indexed pages. Is there any way to check, which URLs were indexed 2 years ago?
Intermediate & Advanced SEO | | Sandra_h0 -
SEO for 1,000,000 page site
Dear All, I hope you can help me with another question about doing SEO for a large site: 1 - My domain is 11 year old, all time was a parking domain
Intermediate & Advanced SEO | | SteveTran2013
2 - We have 10,000 articles - unique content (500-1500 words)
3 - the remaining are automated content, however, they are also unique with data (numbers, figure) We are going to launch it in 2 weeks, and intend to do the following things: Stage 1: first 2 months - only post 10,000 articles with unique content, NO using automated ones.
Link building: get 5-10 authority links pointing to it, either article writings or link pages (authority links Yahoo directory/Dmoz) Stage 2: month 3 to 6: gradually put the automated content online while still posting unique and well written articles.
Link building: Start building links with PR websites, article submission. Do you think there are any problems with this plan? and if 5-10 links can improve our site ranking, given it has a lot of unique content? Thank you very much. BR/Tran1 -
Duplicate site (disaster recovery) being crawled and creating two indexed search results
I have a primary domain, toptable.co.uk, and a disaster recovery site for this primary domain named uk-www.gtm.opentable.com. In the event of a disaster, toptable.co.uk would get CNAMEd (DNS alias) to the .gtm site. Naturally the .gtm disaster recover domian is an exact match to the toptable.co.uk domain. Unfortunately, Google has crawled the uk-www.gtm.opentable site, and it's showing up in search results. In most cases the gtm urls don't get redirected to toptable they actually appear as an entirely separate domain to the user. The strong feeling is that this duplicate content is hurting toptable.co.uk, especially as .gtm.ot is part of the .opentable.com domain which has significant authority. So we need a way of stopping Google from crawling gtm. There seem to be two potential fixes. Which is best for this case? use the robots.txt to block Google from crawling the .gtm site 2) canonicalize the the gtm urls to toptable.co.uk In general Google seems to recommend a canonical change but in this special case it seems robot.txt change could be best. Thanks in advance to the SEOmoz community!
Intermediate & Advanced SEO | | OpenTable0 -
Redirect micro-niche site to bigger niche site?
I have a micro niche site that performs reasonably well (page 1 at least) for it's main keywords. It is an exact match domain. To save the ongoing maintenance of a site that gets less than 10 visitors a day, I was thinking of redirecting this micro niche site to a bigger site (a niche site that the micro niche fits into, if that makes sense!) Would I lose rankings because of the power that the EMD provided? Would it be better keeping it there for the backlink it provides to the bigger site (although on the same C Class IP)
Intermediate & Advanced SEO | | BigMiniMan0 -
On-Site Optimization Tips for Job site?
I am working on a job site that only ranks well for the homepage with very low ranking internal pages. My job pages do not rank what so ever and are database driven and often times turn to 404 pages after the job has been filled. The job pages have to no content either. Anybody have any technical on-site recommendations for a job site I am working on especially regarding my internal pages? (Cross Country Allied.com)
Intermediate & Advanced SEO | | Melia0