How to resolve - Googlebot found an extremely high number of URLs
-
Hi,
We got this message from Google Webmaster “Googlebot found an extremely high number of URLs on your site”. The sample URLs provided by Google are all either noindex or have a canonical.
- http://www.myntra.com/nike-stylish-show-caps-sweaters
- http://www.myntra.com/backpacks/f-gear/f-gear-unisex-black-&-purple-calvin-backpack/162453/buy?src=tn&nav_id=541
- http://www.myntra.com/kurtas/alma/alma-women-blue-floral-printed-kurta/85178/buy?nav_id=625
Also we have specified the parameters on these URLs as representative URL in Google Webmaster - URL parameters.
Your comments on how to resolve this issue will be appreciated.
Thank You
Kaushal Thakkar
-
Hi Kaushal,
Thanks for the question.
There are a few ways to deal with this problem which are recommended by Google here. In summary, you can:
- Use parameter handling as you have done
- Add the nofollow attribute to problematic URLs
- Block problematic URLs in robots.txt
There is also a thread in the Google webmaster forums which may be useful to you:
Overall, it comes down to having a good site architecture and cutting down / removing / blocking URLs that you don't care about from a search perspective.
I hope that helps a bit!
Paddy
-
Thank you David, Its been more than 10 months since these parameters have been specified in webmaster. This and other activities like noindex and canonicals helped us to reduce the indexed URL count from 32 million to 1.2 million. As the url index reduced this warning from google stopped for 4 months. However we started receiving this message again from february 2014.
Thanks
Kaushal
-
"we have specified the parameters on these URLs as representative URL in Google Webmaster - URL parameters."
How long ago was this done? Since there are so many URL's, it may take a while for them to recrawl and index the representative URL's per your request.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
High Rank and Traffic of low DA and Backlinks
Hi guys, is a pleasure being a part of this community, hope in learning a lot with you guys, i just started a year learning about SEO and it been a big journey. I was looking at some competition of some websites that i been optmizing, and i found a website that called my attention and i cant figure out whats going on, it haves huge traffic but in terms of technicall SEO is really week, and not just this but also in terms of DA and backlinks (most of them spammy - 20 backlinks), the domain in question is bhnews.com.br I notice that doesnt have any social media, not analytics, etc. The only thing that i notice is that there is a website or a company called "BH news" (televesion), but its not related with it, since the type of information that bhnews.com.br presents is "lottery" results. So this kind of situation confuses me a lot, because is a lot of hard work in optmizing a website to rank in google, and than i come a across with this type of website with 20 backlinks (most of anchor or name of domain), and than haves like 2M visits per month and ranks for keywords related with the this type of sites of lottery. Can someone tell me if there is some kind of black seo, or something that is making this rank so high? regards
White Hat / Black Hat SEO | | jogobicho0 -
Following urls should be add in disavow file or not
Hey Moz Friends, Should I include following spam link urls in disavow file or not? OR Will Google handle automatically? These type I have thousands urls. =>>>web-seek.org/the_worlds_most_visited_web_pages_42.html<<<=
White Hat / Black Hat SEO | | Rajesh.Prajapati
=>>>web-seek.net/the_worlds_most_visited_web_pages_42.html<<<=
=>>>websearching.net/the_worlds_most_visited_web_pages_42/
=>>>websearch.pl/the_worlds_most_visited_web_pages_42.html<<<=
=>>>web-search.net/the_worlds_most_visited_web_pages_42/
=>>>web-pages.org/the_worlds_most_visited_web_pages_42/
=>>>web-page.org/the_worlds_most_visited_web_pages_42.html<<<=
=>>>the-world.net/the_worlds_most_visited_web_pages_42.html<<<=
=>>>the-internet.tv/the_worlds_most_visited_web_pages_42.html<<<=
=>>>the-internet.in/the_worlds_most_visited_web_pages_42.html<<<=
=>>>the-globe.tv/the_worlds_most_visited_web_pages_42/
=>>>theglobe.sk/the_worlds_most_visited_web_pages_42.html<<<=
=>>>theglobe.ru/the_worlds_most_visited_web_pages_42.html<<<=
=>>>theglobe.pl/the_worlds_most_visited_web_pages_42.html<<<= Hope you will give any solution. Waiting for your positive response.0 -
Deleting 301 Redirect URLs from the CMS
Hi Everyone, Would there be a negative SEO effect from deleting pages with 301 redirects in your CMS? Does anyone know of an average time of authority transfer from a redirect? Thanks,
White Hat / Black Hat SEO | | JMSCC
Jon0 -
Does Google want contact numbers in the meta description?!
Reading up it seems like there's complete free reign to enter what you want in the meta description and they are not considered a direct ranking signal However I have added contact numbers to the meta descriptions for around 20 reasonably high ranking pages for my company and it seems to have had a negative effect (taken screen grabs and previous rankings) More strangely when you 'inspect' the page the meta description features the desired number yet when you find the page in the serps the meta description just does not feature the number (page has been cached and the description does not carry on) I'm wondering whether such direct changes are seen as spam and therefore negative to the page?
White Hat / Black Hat SEO | | Jacksons_Fencing1 -
Magento Category URL
Hello I do SEO consulting and a client launch a new Magento Enterprise site. My question is they changed a URL from /category-list/ to /category/ and it is 301 redirecting correctly but the links off of that URL are not. Example: www.site.com/category/ if you click a link the next one shows up like this: www.site.com/categorty-list/vendor/ for example. Any help would be appreciated! Thanks
White Hat / Black Hat SEO | | christaylorconsulting0 -
Do searchs bot understand SEF and non SEF url as the same ones ?
I've jsut realized that since almost for ever I use to code first my website using the non sef for internal linkings. It's very convenient as I'm sure that what ever will be the final url the link will always be good. ex: website.com/component1/id=1 Before releasing the website I use extensions to make the url user friendly according the choosen strategy. ex: website.com/component1/id=1 -> website.com/article1.html But I just wondered if google consider both urls as the same ones or if it consider just as a 301 redirection. What do you think is the best to do ?
White Hat / Black Hat SEO | | AymanH0 -
Creating pages as exact match URL's - good or over-optimization indicator?
We all know that exact match domains are not getting the same results in the SERP's with the algo changes Google's been pushing through. Does anyone have any experience or know if that also applies to having an exact match URL page (not domain). Example:
White Hat / Black Hat SEO | | lidush
keyword: cars that start with A Which way to go is better when creating your pages on a non-exact domain match site: www.sample.com/cars-that-start-with-a/ that has "cars that start with A" as the or www.sample.com/starts-with-a/ again has "cars that start with A" as the Keep in mind that you'll add more pages that start the exact same way as you want to cover all the letters in the alphabet. So: www.sample.com/cars-that-start-with-a/
www.sample.com/cars-that-start-with-b/
www.sample.com/cars-that-start-with-C/ or www.sample.com/starts-with-a/
www.sample.com/starts-with-b/
www.sample.com/starts-with-c/ Hope someone here at the MOZ community can help out. Thanks so much0 -
Is it still valuable to place content in subdirectories to represent hierarchy or is it better to have every URL off the root?
Is it still valuable to place content in subdirectories to represent hierarchy on the site or is it better to have every URL off the root? I have seen websites structured both ways. It seems having everything off the root would dilute the value associated with pages closest to the homepage. Also, from a user perspective, I see the value in a visual hierarchy in the URL.
White Hat / Black Hat SEO | | belcaro19860