I've hit a wall. What's next?
-
I've been working on creating content and optimizing my website for the past 18 months, and have seen decent gains in organic traffic. Recently my keyword ranking increases have slowed dramatically, despite adding additional content. I'm hoping a fresh set of eyes can spot something that may be holding me back. I appreciate any feedback the MOZ community is able to provide.
One area of concern/confusion is the number of pages indexed according to GSC. The number tends to go up and down, and I can't figure out why. Of the roughly 8,000 pages that are submitted through the sitemap, it says only around 1,100 are indexed (sitemap page). The index status page says I've got 7,500 pages indexed. Kind of confused on that one.
Anyway, my website is MetroAtlantaHome dot com. Thanks everyone!
-
Matt,
Thank you for taking a look at my site. I really appreciate the feedback.
I had noticed the search results with parameter tags being indexed as well. I tried limiting Google's crawler to non-parameter pages about 8 months ago, but didn't seem to do much. I was afraid one of my settings was messing things up so I deleted it and selected let GoogleBot decide for all of them. Not sure why the paginated pages are being indexed too. I thought I'd read where the paginate tag was similar to the canonical tag and Google would treat it as a signal not to index. I would think if GoogleBot can crawl and index the paginated search pages, it could also crawl the listing results on all those pages. I do have a large portion of listing pages on my site no-indexed since they don't fall within my service area and I used to get a ton of calls about them. Maybe that is causing issues for all the listing results pages to not be indexed.
In regards to Screaming Frog, which settings did you use? I use the preset user agent GoogleBot Regular and have thousands of pages that it crawls. Wish I could replicate your scan to see what might be holding things up.
Regarding the Wistia sitemap, I put it in the robots.txt file to try and get the videos embedded on my site indexed. I didn't realize this was hurting more than helping.
Thanks again for your feedback and taking the time to review my site.
-
As far as the discrepancy in numbers, Google is indexing a lot of ?search= parameter results (as well as /listing/ results) but the search ones are not in your sitemap. Your site doesn't crawl all the way very well - I put it in ScreamingFrog twice and only came up with about 400 pages - some listings pages but not the thousands Google has in the index.
You have a number of paginated pages:
- http://www.metroatlantahome.com/contemporary-style-homes/300000-400000/?p=5
- http://www.metroatlantahome.com/contemporary-style-homes/300000-400000/?p=3
Your canonicals take care of this issue for the search index but your search page results seem to be "indexed" even though they aren't in your sitemap. See the attachment.
So I think you're gaining indexed pages from the search parameter but losing them from /listings/ that aren't indexed and harder to crawl. I would suggest submitting sitemap_0.xml directly to Search Console as a start. Then trying to figure out why those pages don't crawl very well.
The Wistia sitemap in your robots.txt is also NOT something I'd want Google to ever see but having it in robots.txt ensures they do. I'd try to remove that from robots.txt
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is Google's Knowledge Graph stealing sessions from the organic channel?
Does Google count it as an organic session in Google Analytics when a searcher clicks on the "get directions", "call" or even "website" from Google's Knowledge Graph. Are the articles that prove or disprove this question? Thanks!
Reporting & Analytics | | SearchOpt0 -
"index.htm" for all url's in google analytics
I don't have this issue with other wordpress websites, only this one website, and I don't know what's causing the issue: Google Analytics is adding an "index.htm" to every single page on the website. So it is tracking the pages, I see no errors - is it tracking the right page? When I click on the page link in a report, I naturally go to a "404 page not found" since the website address isn't "www.example.com/rewards/index.htm" - but instead the actual address would be:
Reporting & Analytics | | cceebar
"www.example.com/rewards/". I have navigated to View Settings in GA to insure "default page" is empty. Although adding anything else to this field does not effect the page url in analytics reports either. Could it be htaccess file - or a plugin effecting the htaccess file?_Cindy0 -
Webmaster Tools vs. Google Trends data doesn't add up
I am investigating a two-month 25% drop in organic traffic from Google to a client's site. When I turned to the Webmaster Tools data for the site, there is a clear, gradual drop over the course of a couple months both in impressions and clicks. In general, the drop occurred across many pages and for a large number of queries; there wasn't a core group of keywords or pages that saw the drop...it was more sitewide. Yet, the average rankings reported by WMT were, for the top 100 or so landing pages, not significantly different. The site hosts information about medical conditions, and I wouldn't expect any time-related variations in search volume, and this was confirmed by looking at Google Trends data for a number of the top keywords. I started to look at the data by query for all the top keywords (all ranked in the top 10), and saw the following general trend: impressions were down, rankings stayed in the top 10, and Google Trends showed either flat or rising volumes. So I am trying to make sense of that. If the search volume trend did not decline and rankings held inside the top 10, then how could the number of impressions drop significantly? Am I trusting the WMT data too much? But the reality is that the volume of traffic measured by Google Analytics from Google organic did indeed drop the way Webmaster Tools show it.
Reporting & Analytics | | WillW0 -
What penalty might have hit here (screenshot attached)
I've had a spiky organic traffic profile for some time and wondered if anyone could suggest what penalty might have hit me. Something did in July but then when it recovered (not sure how) I ended up with double the traffic. Then it dipped, recovered a but and has slowly declined since. I've had no manual penalties so it must be algorithmic which means I can fix it. The problem is I don't know what the issues is! Any help appreciated! Ae00Lzl.png
Reporting & Analytics | | SamCUK0 -
The client's website serves as the main referral?
Hi mozzers, I have this weird case where one of my client's first referral is its own website!! I am really confused especially that I have checked there www vs non www and the non www is redirected to the www. This means that it resolve to one version which is good! Any thoughts on why the main referral is its own site? Thanks
Reporting & Analytics | | Ideas-Money-Art0 -
Can't figure this ranking out..
Hi, This is puzzling me. I've been in the second/third position for a week or so for my best keyword. That is for Google US unpersonalized, which is the one that brings more traffic, as far as I understand. It can't get MUCH better. Well, I can be first, but second and third position is really awesome in my case (highly competitive keyword according to SEOMOZ PRO). Then, why on earth my traffic for that keyword was 8 times better a year ago?? I mean, a year ago I received an average of 800 visits per day and now I can barely reach 90 visits per day being in the second / third place. Visits can't increase from 90 to 800 just for increasing one spot. I've never seen in my stats such drop in my rankings. I thought that due to google updates my site was sent below the 20th position or something. But my I was shocked today when I saw that I still have the second/third position Am I crazy or this looks wrong? The page title and description that shows in google hasn't changed, so people looking for that keyword are seeing the same as one year ago. It is not a seasonal or time sensitive keyword. My best guess is that people are now always logged in and results are personalized. Don't know much about personalized results but I don't think you can optimize much for those. If that's the case, then how on earth can we optimize a page if everybody is using personalized results? Is there a way to improve your rankings in those cases? Thanks, Enrique
Reporting & Analytics | | enriquef0 -
Haven't seen anything like this
I personally haven't seen anything like this before. I am optimizing my first worldwide page. The rank checker at seomoz and another rankchecker as well says that I achieve rankings in the Us and in the UK as well for my 2-3 word terms. However if I copy a paste a whole sentence from either of my pages (8-10 words) google can not find my site. If I put the terms in quotes than it is ok, but it still cannot find the home page. Not any sentence with or without quotes from the home page, although this page has the most incoming links. Anybody any idea how can it be?
Reporting & Analytics | | sesertin0 -
Site crawler hasn't crawled my site in 6 days!
On 4.23 i requested a site crawl. My site only has about 550 pages. So how can we get faster crawls?
Reporting & Analytics | | joemas990