Should I care about this Webmaster Tools Message
-
Here is the message:
"Googlebot found an extremely high number of URLs on your site: http://www.uncommongoods.com/"
Should i try to do anything about this? We are not having any indexation issues so we think Google is still crawling our whole site. What could be some possible repercussions of ignoring this?
Thanks Mozzers!
-Zack
-
Hi Zack,
Just checking in to see if you had run any other tests to determine why this message might have appeared (e.g. a site crawl to find duplication / bad canonicalisation, etc.)? Let me know if you still need assistance.
Cheers,
Jane
-
Also agree with David, but it wold not hurt to ensure that your XML sitemaps are up-to-date and an accurate reflection of your site's content. It also does not hurt to clean up any potential duplicate URL issues that your site may have. Otherwise you do not need to put a lot of weight into this message from GWT.
-
David is spot on aobut the titles and urls. Large DB driven sites tend to cause big issues off of simple mistakes in coding or content entry.
I have to say "Crawl it" again.
-
Since it is an ecommerce store with a lot of products, its natural for you to have a lot of URLs. As long as your content, titles, and urls are unique, I wouldn't pay a lot of attention to it.
Did a site search, and it came up with "About 181,000 results" that were indexed. If you know that number to be excessive, I would begin checking to see if you have cms generated URLs, that may be causing such a high page count.
-
I would crawl the site and look for and spider traps or potential duplicate content. I make it a point to do so every time I see one of these notices and I have found things after these notices that could potentially or havecontributed to a Panda filter.
Although I do recommend at least weekly crawls on larger sites, these notices area good prompt to do it if you have been lax on your audits.
-
If Google sends you a message, I'd listen.
Generally, these messages comes when you don't have something set correctly in your parameters. Have you set canonicals for your items?
Here are some resources to go through.
From Google: https://support.google.com/webmasters/answer/76401?hl=en
A Good Product Forum Discussion: https://productforums.google.com/forum/?hl=en#!category-topic/webmasters/crawling-indexing--ranking/CCORJBI-mEg
A Good Product Forum Discussion that has John Mueller (works for Google) on it: https://productforums.google.com/forum/#!topic/webmasters/1aTAjsRbIOU
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Tool to identify if meta description are showing?
Hi we have a Ecommerce client with 1000s of meta descriptions, we have noticed that some meta descriptions are not showing properly, we want to pull and see which ones are showing on Google SERP results. You can use tools like screaming frog to pull meta description from page, but we want to see if it's showing for certain keywords. Any ideas on how to automate this? Cheers.
Intermediate & Advanced SEO | | brianna00 -
SEO-optimized Data Visualizations (e.g. Charts) Tools
Hi there! We are currently evaluating data visualization / charting tools for rich content. Are there any open source solutions that work best in your opinion? Why? Some specific questions: Are static image / svg rendered images better than a javascript dynamic chart (canvas/HTML5)? Which gets indexed better? Is there any proven or perceived benefit to using Google Charts API that gives you an SEO boost? Are there tools for progressively enhancing HTML raw data tables to generate charts? Looking at a couple of solutions: Google Charts API C3.js Chartjs Thanks for your feedback!
Intermediate & Advanced SEO | | insurifyusa0 -
Should I set a max crawl rate in Webmaster Tools?
We have a website with around 5,000 pages and for the past few months we've had our crawl rate set to maximum (we'd just started paying for a top of the range dedicated server at the time, so performance wasn't an issue). Google Webmaster Tools has alerted me this morning that the crawl rate has expired so I'd have to manually set the rate again. In terms of SEO, is having a max rate a good thing? I found this post on Moz, but it's dated from 2008. Any thoughts on this?
Intermediate & Advanced SEO | | LiamMcArthur0 -
Should We Remove Content Through Google Webmaster Tools?
We recently collapsed an existing site in order to relaunch it as a much smaller, much higher quality site. In doing so, we're facing some indexation issues whereas a large number of our old URLs (301'd where appropriate) still show up for a site:domain search. Some relevant notes: We transitioned the site from SiteCore to Wordpress to allow for greater flexibility The Wordpress CMS went live on 11/22 (same legacy content, but in the new CMS) The new content (and all required 301s) went live on 12/2 The site's total number of URLS is currently at 173 (confirmed by ScreamingFrog) As of posting this question, a site:domain search shows 6,110 results While it's a very large manual effort, is there any reason to believe that submitting removal requests through Google Webmaster Tools would be helpful? We simply want all indexation of old pages and content to disappear - and for Google to treat the site as a new site on the same old domain.
Intermediate & Advanced SEO | | d50-Media0 -
Link Removal Request Sent to Google, Bad Pages Gone from Index But Still Appear in Webmaster Tools
| On June 14th the number of indexed pages for our website on Google Webmaster tools increased from 676 to 851 pages. Our ranking and traffic have taken a big hit since then. The increase in indexed pages is linked to a design upgrade of our website. The upgrade was made June 6th. No new URLS were added. A few forms were changed, the sidebar and header were redesigned. Also, Google Tag Manager was added to the site. My SEO provider, a reputable firm endorsed by MOZ, believes the extra 175 pages indexed by Google, pages that do not offer much content, may be causing the ranking decline. My developer submitted a page removal request to Google via Webmaster tools around June 20th. Now when a Google search is done for site:www.nyc-officespace-leader.com 851 results display. Would these extra pages cause a drop in ranking? My developer issued a link removal request for these pages around June 20th and the number in the Google search results appeared to drop to 451 for a few days, now it is back up to 851. In Google Webmaster Tools it is still listed as 851 pages. My ranking drop more and more everyday. At the end of displayed Google Search Results for site:www.nyc-officespace-leader.comvery strange URSL are displaying like:www.nyc-officespace-leader.com/wp-content/plugins/... If we can get rid of these issues should ranking return to what it was before?I suspect this is an issue with sitemaps and Robot text. Are there any firms or coders who specialize in this? My developer has really dropped the ball. Thanks everyone!! Alan |
Intermediate & Advanced SEO | | Kingalan10 -
GWT Message - CMS Update Available
Howdy Moz, Just received a message in Google Webmaster Tools about a CMS update: "Joomla Update Available As of the last crawl of your website, you appear to be running Joomla 1.5. One or more of the URLs found were: http://www.website/custom-url/article5034 Google recommends that you update to the latest release. Older or unpatched software may be vulnerable to hacking or malware that can hurt your users. To download the latest release, visit the Joomla download page. If you have already updated to the latest version of Joomla, please disregard this message. If you have any additional questions about why you are receiving this message, Google has provided more background information in a blog post about this subject." Read through the associated blog post. According to the post a generator meta tag is created in Joomla that notes the CMS version. Here's the oddity: The site was on Joomla 1.5 over 2 years ago. 1 Year ago it was updated to Joomla 2.5. About a week ago it was converted completely to Wordpress. According to GWT the last date the Google bot accessed the site was the day before (5/1/14) the email. I went through the code, css/html, and the database and found no reference of Joomla 1.5. Has anyone seen this message? If so, how did you rectify it? Were there any adverse effects on rankings?
Intermediate & Advanced SEO | | AaronHenry0 -
Why is my servers ip address showing up in Webmaster Tools?
In links to my site in Google Webmaster Tools I am showing over 28,000 links from an ip address. The ip address is the address that my server is hosted on. For example it shows 200.100.100.100/help, almost like there are two copies of my site, one under the domain name and one under the ip address. Is this bad? Or is it just showing up there and Google knows that it is the same since the ip and domain are from the same server?
Intermediate & Advanced SEO | | EcommerceSite0 -
How long for Google Webmaster tools to update/reflect link changes
Hi all, Does anyone know or have experience of how long GWMT takes to update its data?, we did some work on our link profile back in October/November but are still seeing old links (removed) showing in GWMT. Thanks in advance,
Intermediate & Advanced SEO | | righty0