Is the Google results serp broken?
-
Hi everyone!
We've been trying to decipher how many of our pages are indexed by google at the moment. If we do the usual "site:https://www.hobbydb.com" search term, the serp says that we have more than 740,000 pages indexed. However, when I do a deep dive and click through to the last page of results, I can only get to page 54, and then there are no more results. This would mean that I only have 540 pages indexed, not 740,000. We have also done other queries for other sub-sections of our website, and the results also truncate at 50 pages. Has anyone run into this problem? Any suggestions are appreciated!
Best,
Alex
-
Google search console Index Status report
Google Webmaster tools tell you in the
https://support.google.com/webmasters/answer/2642366?hl=en
if you want to know without a doubt you have to connect Google Analytics to Deepcrawl it will say exactly how many URLs are in the index.
- https://www.deepcrawl.com
- https://www.deepcrawl.com/knowledge/best-practice/how-to-measure-indexed-pages-more-accurately/
- https://www.deepcrawl.com/knowledge/best-practice/how-can-non-indexable-pages-receive-google-organic-traffic/
- http://www.stateofdigital.com/40-deepcrawl-tweaks/
Now that Google Analytics can be added to screaming frog you can do something very similar.
- https://www.screamingfrog.co.uk/seo-spider/
- https://www.screamingfrog.co.uk/seo-spider/user-guide/general/#crawling
- https://www.screamingfrog.co.uk/seo-spider/faq/
- https://moz.com/community/q/how-to-determine-which-pages-are-not-indexed
I Hope this helps,
Tom
-
Michael, the site: command typically has not "worked" or provided accurate results for years now. It's just they way it is--and I don't expect Google to really give us the number of pages that are actually indexed anytime soon.
That said, typically I recommend using the site:hobbydb.com command to see the pages, and then click to the final page of results (if you can). I'm currently seeing about 766,000 pages indexed.
-
That index query returns dubious results. URLProfiler wrote an excellent article last year sharing the results of some experimentation they did around the accuracy of that command and other tools used to help determine the extent of your site indexation. I recommend you give it a read - http://urlprofiler.com/blog/google-index-checker/. It will take some some work and access to their tool, but I think you'll gain a lot of insight.
Good luck!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Some results disappeares after a while
Hi every body i have a strange issue with my search results in google. i noticed some of my results are disappeared after a while! there are no notifications or messages in webmaster tools just my results get lost! for example when my URL (zomorodgasht.com) take a good place with a keyword's result for some days (page 2 or 3) but after a while that will gone for good in all pages! there is no results anymore in any pages! can you help me please what's the problem with google? i'm so stressed about this results. PS 1: my google webmaster is totally clean and every thing is fine. and of course my "search analytics" positioned the missing keywords in page 2 or 3 but i can't find them! google is showing wrong analytics results!!! some my results are totally gone. PS 2: all of my url's are truly submitted and showing in google there is no removed pages or results. just some keywords are gone after a while. best regards
Technical SEO | | ZomorodGasht0 -
PDF in search results?
Hello community! I am not an SEO professional, though I am a practitioner, I would say. I am seeking a solution on behalf of a friend. If you search the term "Peter Blatt" you will discover a "black eye" on the first page, towards the bottom of SERPs. It's a PDF published on the Florida Department of Financial Services website regarding the final order for a settlement he and his company ("Blatt Financial Group") reached with the state as it related to professional conduct allegations. Does anyone have any advice on how to address this? I don't want "game" the search engines, but at the same time, this document looks really scary and much worse than it actually is to people, and I would love for it do drop below page one. Any advice or suggestions from the community? Thanks! Tom
Technical SEO | | 800GoldLaw0 -
Why is Google replacing our title tags with URLs in SERP?
Hey guys, We've noticed that Google is replacing a lot of our title tags with URLs in SERP. As far as we know, this has been happening for the last month or so and we can't seem to figure out why. I've attached a screenshot for your reference. What we know: depending on the search query, the title tag may or may not be replaced. this doesn't seem to have any connection to the relevance of the title tag vs the url. results are persistent on desktop and mobile. the length of the title tag doesn't seem to correlate with the replacement. the replacement is happening at mass, to dozens of pages. Any ideas as to why this may be happening? Thanks in advance,
Technical SEO | | Mobify
Peter mobify-site-www.mobify.com---Google-Search.png0 -
SERP - Sitelinks but not sitelinks and not clickable
We have a rather large site. On SERP, a page is seeing snippet with top navigation links captured. But they are not active links on SERP although on the live site they are. And there are 6 sitelinks showing up as well. Has anyone experienced this before? Thanks.
Technical SEO | | b.digi0 -
Google Local Gone Loco
I am a bankruptcy attorney in Southern California. I have been doing my own SEO since I had a couple of bad experiences paying someone to "do" it in the past. If you want it done right, do it yourself I suppose. Anyway, I have been ranking well in Google local results. At first I peeked in at 3/3 showing on the first page of the searches. Then I climbed to Number 2 in local searches, probably as a result of finding sites and making sure my addresses, phone numbers and business names were all correct. However, this week (as I climbed to #3 spot in the local search for my city+ bankruptcy attorney, my Google local result dropped to page 2. One of my employees rated me on google local and gave me a google + which is gone and the pictures that I uploaded to Local Google are gone. I don't know if this is some kind of penalty because an employee gave me a rating (they were completely up front about working for me) or if something else is going on. I was also trying to claim my business on Yahoo (which resulted in some kind of "Account Suspension"). I have no idea what is going on. You can take a look at my site if it helps: http://ashcraftfirm.com We are trying to rank for "murrieta bankruptcy attorney" Thanks for any help you can provide.
Technical SEO | | gcashcraft0 -
Why do some serps have a + map symbol?
Hi from sunny but freezing wetherby UK.. Ive noticed when you enter "York solicitors" some listings have + Show map symbol. Hers is a screen shot to illustrate: http://i216.photobucket.com/albums/cc53/zymurgy_bucket/plus-map-serps-langleyscopy.jpg I'd like to know please what i would have to do to emulate this. Thanks in advance, David
Technical SEO | | Nightwing1 -
How to ask for forgiveness from the Google God?
Ok so maybe not ask for "forgiveness" because I am not sure what we did to get penalized. I believe our site is being penalized 1. most of our usual keywords are not ranked in their usual placements in the search results. 2. some of our keywords are listing the wrong pages as search results and 3. our search results are landing on pages 8 or 9 on Google (not 2 or 3 as before). This is an ecommerce site. How do we figure out what trigger the penalty (if at all) and how do we fix it so that we can get our ranking back (is that even possible)? Please advise - much help is needed!
Technical SEO | | mof3kz0 -
Not ranking well in Google
Hi, I am new to Seomoz,I have some little doubts regarding <title>tag.</p> <p>Can i target 3 words in the title tag. Currently i am on top for one keyword, and i cant get the rest two in top positions. Here is my website, can anyone review my site please.</p> <p>xxx(dot)ridpiles(dot)com with keyword hemorrhoids treatment</p> <p>I have good amount of backlinks, but still something i am missing. I have 100% unique content.</p> <p> </p> <p>Regards</p></title>
Technical SEO | | Dexter22387874870