Serp tracking - legal?
-
Isn't this scraping Google results on a massive scale? Is this legal at all?
-
Well Google collects our data, why should you not collect theirs.
Put a button on your web site but dont make it easy to find, add some small print including your terms of use, and a disclamer that if search engines dont want their data scapped they can opt out by pressing the button, make them fill out a few forms, verify themsefls, make them wait 4 weeks then send them a no-reply email that does not address their concerns properly, so they have to go thought it all again.
-
You can get permission from Google, in which case it would not be illegal. ...But they don't just give permission away freely.
-
It's against the Google TOS. Source
That being said, there are many offenders. I'm not sure if Google lets any of the big marketing companies do it, or even give them API access in some shape or form, but I know for the smaller guys that it's frowned upon.
To my knowledge there has not been a case of Google pursuing action against someone who has scraped search results.
Scraping Google requires a proxy network because they do indeed block requests that appear like scraping bots. There are temporary bans and captcha tests put in place, but switching out an IP address works just fine until the test no longer appears.
When it comes down to it: no, not legal, but you also probably won't get in trouble for it.
(Would love to hear from official SEOmoz staff on this one...)
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Very different SERP Results
Hi there, I am having some big issues when it comes to getting accurate SERP results for a client http://www.airandice.com.au/ The keyword in question is "air conditioning installation" Moz is giving me a result of 47 Incognito chrome is giving me anywhere between 8-12. Same when I changed it to Australia search as well. Firefox is giving me 8. Incognito is >100 Now my workmate who is next to me, same network and setup and he is seeing Incognito Chrome - 54 Firefox Incognito - 8 And a third computer in the office on a different network is throwing out different results again. This is real confusing as I can't get a clear idea of where this keyword is situated. Results are varying from 8 - >100 Has anyone else seen or had this problem? It is a 1st for me. I know that keywords fluctuate each time they are searched but this is a huge fluctuation.
Keyword Research | | JoelMolloy0 -
How do you keep track of the keywords you're working on ?
Hello Moz community, Let's suppose you're working on a +600 pages website and you are working on lots of keywords. I'd like to know if you had a database / excel / tool to know which keywords you've been targetting so that you don't create twice the same content ? Thanks for your answers
Keyword Research | | Sindicic_Alexis0 -
How can I easily track multiple keywords for multiple pages?
We are creating landing pages to target keywords, and would like to be able to have something set up so at a glance we can see each page's rank for its targeted keyword. For example, if we have pages with the URLs of example.com/sites/purple-widgets, example.com/sites/purple-widgets-for-cheap, example.com/sites/cheap-purple-widgets, etc., we'd like to see the rank of each of those pages for their respective keyword ("purple widgets", "purple widget for cheap", "cheap purple widgets", etc.). Any suggestions?
Keyword Research | | brandonRT0 -
Is there any way to track search volume for a particular keyword on a day-to-day basis?
My boss has asked me to track the number of searches for a keyword (a particular company's name) on a daily basis this week to see how the volume fluctuates from day to day. Is this even possible? I should note that his request does not involve an active SEO or AdWords campaign. In fact, the company my boss is interested in doesn't even have a website at the moment. Thanks in advance – either for helping me confirm that it's impossible to track keyword search volume on a day-to-day basis, or for showing me the magical way to actually do this.
Keyword Research | | matt-145670 -
Future of SERP tracking
Hi all I guess we all know what happend to Raven, loosing its AdWords API and being forced into removing SERP tracking. If not, see more here: http://raventools.com/blog/scraped-data-serp-tracker/ What is SEOMOZ stand on this? Will you continue to provide SERP tracking? Kind regards Fredrik
Keyword Research | | Resultify0 -
Google Keyword tool data + No. 1 Serp rank =/= to taffic on landing page
So a keyword we are targeting "painted bedroom furniture" google keyword tool says gets 480 exact local searches (and 880 broad), and in the same local google we have ranked 1st for months (and currently we are 2nd and 3rd too), but looking at the google analytics that landing page has only gotten 78 unique page views from searches and only 21 from "painted bedroom furniture" . (the 2nd link gets 12 page views and the 3rd gets none, from that keyword) Now for me that does not make sense! For other keyword which we rank No.1 the keyword data and analytics generally match/make sense. Is there something I'm missing?
Keyword Research | | eunaneunan0 -
Google SERPS for similar Keywords?
I have website which is being listed for a keyword which is not in the site. It seems that google is using a Thesaurus to find words with similar meaning. Is this right? How could this be used for SEO purposes?
Keyword Research | | Tinderbox0
