I've hit a wall. What's next?
-
I've been working on creating content and optimizing my website for the past 18 months, and have seen decent gains in organic traffic. Recently my keyword ranking increases have slowed dramatically, despite adding additional content. I'm hoping a fresh set of eyes can spot something that may be holding me back. I appreciate any feedback the MOZ community is able to provide.
One area of concern/confusion is the number of pages indexed according to GSC. The number tends to go up and down, and I can't figure out why. Of the roughly 8,000 pages that are submitted through the sitemap, it says only around 1,100 are indexed (sitemap page). The index status page says I've got 7,500 pages indexed. Kind of confused on that one.
Anyway, my website is MetroAtlantaHome dot com. Thanks everyone!
-
Matt,
Thank you for taking a look at my site. I really appreciate the feedback.
I had noticed the search results with parameter tags being indexed as well. I tried limiting Google's crawler to non-parameter pages about 8 months ago, but didn't seem to do much. I was afraid one of my settings was messing things up so I deleted it and selected let GoogleBot decide for all of them. Not sure why the paginated pages are being indexed too. I thought I'd read where the paginate tag was similar to the canonical tag and Google would treat it as a signal not to index. I would think if GoogleBot can crawl and index the paginated search pages, it could also crawl the listing results on all those pages. I do have a large portion of listing pages on my site no-indexed since they don't fall within my service area and I used to get a ton of calls about them. Maybe that is causing issues for all the listing results pages to not be indexed.
In regards to Screaming Frog, which settings did you use? I use the preset user agent GoogleBot Regular and have thousands of pages that it crawls. Wish I could replicate your scan to see what might be holding things up.
Regarding the Wistia sitemap, I put it in the robots.txt file to try and get the videos embedded on my site indexed. I didn't realize this was hurting more than helping.
Thanks again for your feedback and taking the time to review my site.
-
As far as the discrepancy in numbers, Google is indexing a lot of ?search= parameter results (as well as /listing/ results) but the search ones are not in your sitemap. Your site doesn't crawl all the way very well - I put it in ScreamingFrog twice and only came up with about 400 pages - some listings pages but not the thousands Google has in the index.
You have a number of paginated pages:
- http://www.metroatlantahome.com/contemporary-style-homes/300000-400000/?p=5
- http://www.metroatlantahome.com/contemporary-style-homes/300000-400000/?p=3
Your canonicals take care of this issue for the search index but your search page results seem to be "indexed" even though they aren't in your sitemap. See the attachment.
So I think you're gaining indexed pages from the search parameter but losing them from /listings/ that aren't indexed and harder to crawl. I would suggest submitting sitemap_0.xml directly to Search Console as a start. Then trying to figure out why those pages don't crawl very well.
The Wistia sitemap in your robots.txt is also NOT something I'd want Google to ever see but having it in robots.txt ensures they do. I'd try to remove that from robots.txt
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
PDF web traffic hitting our site
Hi there, Over the last few months our traffic has spiked due to irrelevant pdf documents sending us crap traffic, our bounce rate is sky high as well as other metrics. I don't want to just filter out this traffic in GA rather try and stop our site from being attacked. Any advice on a way forward would be great. Thanks
Reporting & Analytics | | ICMPmarketing0 -
Directory Listings the DO's and Dont's
Hi guys, We are currently working on increasing our online marketing presence and with a new website on the cards I am turning to all of our B2B business directories to update, and being tracking referrals etc to see ones that may be worth premium listings. I have a list of 200 business directories to scope and check, some are relevant some are not, obviously i dont want to sign up to them all and risk a dodgy link profile so im going to be selective, but im not sure how many to aim for etc. So im looking for some general advice and guidance at this early stage so I can properly plan my approach. What advice would you give and are there any major DO's and DONT's of sorting through these directories to look for some new ways to source customers. EDIT: We are UK based Thanks
Reporting & Analytics | | ATP0 -
Ecommerce site product link. How to handle a link that doesn't exist.
Suppose we have this product A, and we just have a single item for this. When the item is sold out we do not want to show it on the website saying "out of stock". Instead we would like to remove the product from out store which will now result in a url that doesn't exist. And google webmaster tool and Moz analytic will show them as page not found after they crawl over the site. Should i be generating a new sitemap.xml and update ? How do i handle those pages that don't exist anymore ? Thanks
Reporting & Analytics | | MindlessWizard0 -
Google's Not Provided - What can I see and what can't I?
Hi Guys, I've been looking into my company's analytics's data recently to establish where most of our traffic is coming from. More so, I want to get an indication of the percentage of organic traffic that is coming from branded and none branded terms. Not provided takes up 80% of my organic traffic and the vast majority of keywords that are provided all mention the brand name. Does analytics's provide you with all of your branded traffic but just block others that it doesn't want you to see? Or is it just coincidence that the majority of the terms I can see are all branded? I am just trying to establish how strong our brand is and how much traffic the brand name brings against none brand terms. All help is appreciated! Thank you!
Reporting & Analytics | | Sandicliffe1 -
My GA code is on my site but Google Analytics isn't being pulled into SEOMoz...why?
The CEO wants me to present an SEO plan next week for three of our sites; however, I got this message when I went to campaign overview tab: "It appears there's a problem with our connection to your Google Analytics account. Please go to your Settings page to update your connection." I double-checked the GA code and it's the same on both our site and in SEOMoz...what gives? I clicked on Choose Your GA Profile->Set GA Account and Profile then got this warning: "Are you sure you want to change your Google Analytics connection? Changing your connection will reset our cache of your historical GA traffic data." I need this data pronto so I can set strategy for three sites; any help would be greatly appreciated! Darrell
Reporting & Analytics | | AdviceElle0 -
What's the difference between landing pages and entrance pages on Google Analytics?
I'm confused about the difference between entrance pages and landing pages on Google Analytics. If I compare our search traffic to entrance pages with search traffic to landing pages it seems very similar -- but not identical. But this is probably because all of our GA analytics is sampled (we're a huge site). Can anyone help?
Reporting & Analytics | | CecilyP0 -
List all URL's indexed by google
Hi all i need a list of all urls google has indexed from my site i want this in excel format or csv how do i go about getting this thanks in advance
Reporting & Analytics | | Will_Craig0 -
What impact will Google's 10/18/2011 announcement of 'Making Search More Secure' have on the ability to track specific keyword queries via Analytics?
The full announcement is here: http://googleblog.blogspot.com/2011/10/making-search-more-secure.html My concern is that the ability for Google Analytics to parse information on specific keyword queries will be diminished. The article hints that Google Webmaster Tools will be exempt from the problem, and I've never relied on Webmaster tools as a go-to for tying specific keyword queries to Goal Tracking (form submissions and sales). The community's thoughts on this one are appreciated. 🙂
Reporting & Analytics | | MKR_Agency0