I've hit a wall. What's next?
-
I've been working on creating content and optimizing my website for the past 18 months, and have seen decent gains in organic traffic. Recently my keyword ranking increases have slowed dramatically, despite adding additional content. I'm hoping a fresh set of eyes can spot something that may be holding me back. I appreciate any feedback the MOZ community is able to provide.
One area of concern/confusion is the number of pages indexed according to GSC. The number tends to go up and down, and I can't figure out why. Of the roughly 8,000 pages that are submitted through the sitemap, it says only around 1,100 are indexed (sitemap page). The index status page says I've got 7,500 pages indexed. Kind of confused on that one.
Anyway, my website is MetroAtlantaHome dot com. Thanks everyone!
-
Matt,
Thank you for taking a look at my site. I really appreciate the feedback.
I had noticed the search results with parameter tags being indexed as well. I tried limiting Google's crawler to non-parameter pages about 8 months ago, but didn't seem to do much. I was afraid one of my settings was messing things up so I deleted it and selected let GoogleBot decide for all of them. Not sure why the paginated pages are being indexed too. I thought I'd read where the paginate tag was similar to the canonical tag and Google would treat it as a signal not to index. I would think if GoogleBot can crawl and index the paginated search pages, it could also crawl the listing results on all those pages. I do have a large portion of listing pages on my site no-indexed since they don't fall within my service area and I used to get a ton of calls about them. Maybe that is causing issues for all the listing results pages to not be indexed.
In regards to Screaming Frog, which settings did you use? I use the preset user agent GoogleBot Regular and have thousands of pages that it crawls. Wish I could replicate your scan to see what might be holding things up.
Regarding the Wistia sitemap, I put it in the robots.txt file to try and get the videos embedded on my site indexed. I didn't realize this was hurting more than helping.
Thanks again for your feedback and taking the time to review my site.
-
As far as the discrepancy in numbers, Google is indexing a lot of ?search= parameter results (as well as /listing/ results) but the search ones are not in your sitemap. Your site doesn't crawl all the way very well - I put it in ScreamingFrog twice and only came up with about 400 pages - some listings pages but not the thousands Google has in the index.
You have a number of paginated pages:
- http://www.metroatlantahome.com/contemporary-style-homes/300000-400000/?p=5
- http://www.metroatlantahome.com/contemporary-style-homes/300000-400000/?p=3
Your canonicals take care of this issue for the search index but your search page results seem to be "indexed" even though they aren't in your sitemap. See the attachment.
So I think you're gaining indexed pages from the search parameter but losing them from /listings/ that aren't indexed and harder to crawl. I would suggest submitting sitemap_0.xml directly to Search Console as a start. Then trying to figure out why those pages don't crawl very well.
The Wistia sitemap in your robots.txt is also NOT something I'd want Google to ever see but having it in robots.txt ensures they do. I'd try to remove that from robots.txt
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to safely exclude search result pages from Google's index?
Hello everyone,
Reporting & Analytics | | llamb
I'm wondering what's the best way to prevent/block search result pages from being indexed by Google. The way search works on my site is that search form generates URLs like:
/index.php?blah-blah-search-results-blah I wanted to block everything of that sort, but how do I do it without blocking /index.php ? Thanks in advance and have a great day everyone!0 -
Big variation in the number of search results. (person's name)
Hi, I have been noticing a really dramatic variation in the number of results Google is returning for the name "Carolyn Hadlock." Most of the time it seems to be around 2000. But then it will jump up to over 10,000. Does anyone know why there would be such a big jump? And then why it would go back? If tested both logged into Google and then not - as well as having others log is as themselves. That does not seem to be it. Any thoughts would be much appreciated.
Reporting & Analytics | | yandl0 -
Where have the 'most changed keyword rankings' gone from the weekly summary emails?
Since the change to Moz we have noticed that the weekly summary emails do not show the 'most changed keyword rankings' table. We found these extremely helpful and would be disappointed to see these go. Are these going to make a come back?
Reporting & Analytics | | RedAntSolutions2 -
Can't figure this ranking out..
Hi, This is puzzling me. I've been in the second/third position for a week or so for my best keyword. That is for Google US unpersonalized, which is the one that brings more traffic, as far as I understand. It can't get MUCH better. Well, I can be first, but second and third position is really awesome in my case (highly competitive keyword according to SEOMOZ PRO). Then, why on earth my traffic for that keyword was 8 times better a year ago?? I mean, a year ago I received an average of 800 visits per day and now I can barely reach 90 visits per day being in the second / third place. Visits can't increase from 90 to 800 just for increasing one spot. I've never seen in my stats such drop in my rankings. I thought that due to google updates my site was sent below the 20th position or something. But my I was shocked today when I saw that I still have the second/third position Am I crazy or this looks wrong? The page title and description that shows in google hasn't changed, so people looking for that keyword are seeing the same as one year ago. It is not a seasonal or time sensitive keyword. My best guess is that people are now always logged in and results are personalized. Don't know much about personalized results but I don't think you can optimize much for those. If that's the case, then how on earth can we optimize a page if everybody is using personalized results? Is there a way to improve your rankings in those cases? Thanks, Enrique
Reporting & Analytics | | enriquef0 -
"It appears there's a problem with our connection to your Google Analytics ...
account. Please go to your Settings page to update your connection." I set up a GA account for our website (www.edao.biz) prior to creating the SEO campaign. When I set up the campaign it told me there was a problem. I tried to fix the connection using the Settings page and it created a second account - however, it still cannot connect to it. In the GA account, it shows that I have granted access to pro.seomoz.org. I did not setup a 2-step verification with GA; don't think that's the issue. Should I blow both GA accounts away and try again? I don't think it's working correctly, and I would really like to be able to see the analytics for our site. I did see that in the GA account I had checked [v] Share my Google Analytics data... [v ] with other Google products only. - What should be the proper setting? (BTW I'm a bit lost with the new GA, I still go to the old interface (though ugly, it shows more links and info)) Thank you, Ingrid
Reporting & Analytics | | IngridWood0 -
Has Google changed its algorithm? My traffic has almost doubled and I don't know why.
My traffic has nearly doubled over the past few days, and my conversion rate has doubled as well. It looks like our rankings haven't changed... We haven't done anything to the site recently, although we did submit a couple of press releases through the wire not too long ago (within the last few weeks). I do not think that this is a cyclical/seasonal jump in traffic because last year this did not occur. Any ideas?
Reporting & Analytics | | deuce1s0 -
Analytics goals & funnels - troubleshooting 100% proceed to next step
As you can see from the screenshots, 100% of the visitors in the checkout proceed from step 2 (Delivery Date Selected) to step 3 (Enter Delivery Details) - this sample is a month, but this applies going all the way back. Can you tell me if some RegEx is missing from the goal set up? Thanks fEXtD
Reporting & Analytics | | jdeb1 -
Site crawler hasn't crawled my site in 6 days!
On 4.23 i requested a site crawl. My site only has about 550 pages. So how can we get faster crawls?
Reporting & Analytics | | joemas990