I've hit a wall. What's next?
-
I've been working on creating content and optimizing my website for the past 18 months, and have seen decent gains in organic traffic. Recently my keyword ranking increases have slowed dramatically, despite adding additional content. I'm hoping a fresh set of eyes can spot something that may be holding me back. I appreciate any feedback the MOZ community is able to provide.
One area of concern/confusion is the number of pages indexed according to GSC. The number tends to go up and down, and I can't figure out why. Of the roughly 8,000 pages that are submitted through the sitemap, it says only around 1,100 are indexed (sitemap page). The index status page says I've got 7,500 pages indexed. Kind of confused on that one.
Anyway, my website is MetroAtlantaHome dot com. Thanks everyone!
-
Matt,
Thank you for taking a look at my site. I really appreciate the feedback.
I had noticed the search results with parameter tags being indexed as well. I tried limiting Google's crawler to non-parameter pages about 8 months ago, but didn't seem to do much. I was afraid one of my settings was messing things up so I deleted it and selected let GoogleBot decide for all of them. Not sure why the paginated pages are being indexed too. I thought I'd read where the paginate tag was similar to the canonical tag and Google would treat it as a signal not to index. I would think if GoogleBot can crawl and index the paginated search pages, it could also crawl the listing results on all those pages. I do have a large portion of listing pages on my site no-indexed since they don't fall within my service area and I used to get a ton of calls about them. Maybe that is causing issues for all the listing results pages to not be indexed.
In regards to Screaming Frog, which settings did you use? I use the preset user agent GoogleBot Regular and have thousands of pages that it crawls. Wish I could replicate your scan to see what might be holding things up.
Regarding the Wistia sitemap, I put it in the robots.txt file to try and get the videos embedded on my site indexed. I didn't realize this was hurting more than helping.
Thanks again for your feedback and taking the time to review my site.
-
As far as the discrepancy in numbers, Google is indexing a lot of ?search= parameter results (as well as /listing/ results) but the search ones are not in your sitemap. Your site doesn't crawl all the way very well - I put it in ScreamingFrog twice and only came up with about 400 pages - some listings pages but not the thousands Google has in the index.
You have a number of paginated pages:
- http://www.metroatlantahome.com/contemporary-style-homes/300000-400000/?p=5
- http://www.metroatlantahome.com/contemporary-style-homes/300000-400000/?p=3
Your canonicals take care of this issue for the search index but your search page results seem to be "indexed" even though they aren't in your sitemap. See the attachment.
So I think you're gaining indexed pages from the search parameter but losing them from /listings/ that aren't indexed and harder to crawl. I would suggest submitting sitemap_0.xml directly to Search Console as a start. Then trying to figure out why those pages don't crawl very well.
The Wistia sitemap in your robots.txt is also NOT something I'd want Google to ever see but having it in robots.txt ensures they do. I'd try to remove that from robots.txt
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How To Stop Google's "Fetch & Render" From Showing Up In Google Analytics
Hi all, Within Google's "Fetch & Render" (found in Google Search Console) is the ability to index certain pages from my website on-demand. Unfortunately, every time I ask Google to index a page, it registers as a bounce in Google Analytics. Also, if it means anything, my website (www.knowtro.com) is a single-page application, functioning similarly to Google. If you guys know of any solution to this problem, please help! I originally thought that Google would know to block its own Fetch & Render crawler from Google Analytics but that doesn't seem to be the case. Thanks, Austin
Reporting & Analytics | | A_Krauss0 -
Tool to check page size for multiple url's at once
In Google Analytics under Site Speed > Page Timings, you can see all pages and their loading time compared to the average. This is very handy to check which pages maybe need some optimization. I would also like to check the size for these pages in a similar way. There are multiple tools out there like GTmetix and Pingdom that give specific information and performance insights. The problem is that they are limited to check one url at a time. Does someone know about a tool to check the page size of multiple url’s at once (and if possible to easily export to Excel)? That way I can check which pages are big in size and research/optimize them. Thanks in advance
Reporting & Analytics | | Mark.0 -
Keyword ranking with competitors with lower #s
When analyzing a keyword ranking, our term is consistently on P1 P3-5. Looking more closely, I find that the numbers don't make sense to me. Our competitors have lower Page Authority 3s, lower # Root Domains Linking to Page, Lower Domain Authority 3#s and lower Root Domains linking to the Root Domains Linking to the Root Domain #s. What explains the consistent_ ranking discrepancy? Any ideas?_
Reporting & Analytics | | Chermak1 -
Why doesn't Google seem to care about referral spam?
In researching the issue of referral spam, there is no shortage if info, both on MOZ and beyond. But, neither the Google Analytics Blog or Help Forums seem to mention the issue at all. I'd think it is something that they would want to get rid of, yet it seems like they don't even acknowledge that it exists. Anyone have insights into this? Am I missing something, or is Google strangely silent on an issue that is becoming more and more annoying for anyone trying to use GA data?
Reporting & Analytics | | irapasternack1 -
Why we shouldn't use AWstats to measure marketing efforts?
and what are the disadvantages of awstats compared to Google Analytics?
Reporting & Analytics | | esiow20130 -
I have data missing in Google and don't know who to turn to for help
Hi everyone, I know this isn't the 'Google help forum' but I'm stuck and I hope someone here might be able to point me in the right direction. For a period last month - Thursday 22nd to Sunday 25th November Google Analytics reports our site as having 0 visits. In addition we have two days which were strangely low - Weds 21st 105 visits, Weds 28th Nov 78 visits. We normally get between 1000 and 1200 visits on a weekday from a global audience (I know that was the Thanksgiving weekend, but the US accounts for ~10% of total traffic). Has anyone else had this problem? If so, what did you do? The "report a bug" board on the Google help forum has a few entries like this, people with 0 visits shouting "help!" into the void with no response. Ideas?
Reporting & Analytics | | StevenHowe0 -
"It appears there's a problem with our connection to your Google Analytics ...
account. Please go to your Settings page to update your connection." I set up a GA account for our website (www.edao.biz) prior to creating the SEO campaign. When I set up the campaign it told me there was a problem. I tried to fix the connection using the Settings page and it created a second account - however, it still cannot connect to it. In the GA account, it shows that I have granted access to pro.seomoz.org. I did not setup a 2-step verification with GA; don't think that's the issue. Should I blow both GA accounts away and try again? I don't think it's working correctly, and I would really like to be able to see the analytics for our site. I did see that in the GA account I had checked [v] Share my Google Analytics data... [v ] with other Google products only. - What should be the proper setting? (BTW I'm a bit lost with the new GA, I still go to the old interface (though ugly, it shows more links and info)) Thank you, Ingrid
Reporting & Analytics | | IngridWood0 -
What impact will Google's 10/18/2011 announcement of 'Making Search More Secure' have on the ability to track specific keyword queries via Analytics?
The full announcement is here: http://googleblog.blogspot.com/2011/10/making-search-more-secure.html My concern is that the ability for Google Analytics to parse information on specific keyword queries will be diminished. The article hints that Google Webmaster Tools will be exempt from the problem, and I've never relied on Webmaster tools as a go-to for tying specific keyword queries to Goal Tracking (form submissions and sales). The community's thoughts on this one are appreciated. 🙂
Reporting & Analytics | | MKR_Agency0