Serp tracking - legal?
-
Isn't this scraping Google results on a massive scale? Is this legal at all?
-
Well Google collects our data, why should you not collect theirs.
Put a button on your web site but dont make it easy to find, add some small print including your terms of use, and a disclamer that if search engines dont want their data scapped they can opt out by pressing the button, make them fill out a few forms, verify themsefls, make them wait 4 weeks then send them a no-reply email that does not address their concerns properly, so they have to go thought it all again.
-
You can get permission from Google, in which case it would not be illegal. ...But they don't just give permission away freely.
-
It's against the Google TOS. Source
That being said, there are many offenders. I'm not sure if Google lets any of the big marketing companies do it, or even give them API access in some shape or form, but I know for the smaller guys that it's frowned upon.
To my knowledge there has not been a case of Google pursuing action against someone who has scraped search results.
Scraping Google requires a proxy network because they do indeed block requests that appear like scraping bots. There are temporary bans and captcha tests put in place, but switching out an IP address works just fine until the test no longer appears.
When it comes down to it: no, not legal, but you also probably won't get in trouble for it.
(Would love to hear from official SEOmoz staff on this one...)
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Snippet Tracking in MOZ
Where can I go in MOZ to view Google snippets that I am not currently tracking? I noticed a client is listed on a snippet but MOZ shows 0 snippets. I am also fairly confident given organic traffic data that this snippet has been listed for a while.
Keyword Research | | WebMarkets0 -
Difference in Serp updates
I've notice that the Serp for some keywords are updated more frequently then others (or am I mistaken?) Do any of you have any data that might support that theory? what seems to be the longest periode it takes for a SERP to update for a certain keyword? Is there any rules of thumps on this matter?
Keyword Research | | Justian0 -
Keyword tracking- Local
Silly question about Local ranking monitors. If I have a local client in Pheonix, AZ and I want to track rankings for keywords. Is it best to monitor city+keyword or just keyword? I have ran tests with multiple clients and locations, and cannot ascertain the difference- as far as rankings go. I appreciate all input.
Keyword Research | | TammyWood1 -
Why do small changes in keyword phrasing have such big SERP impacts?
I am trying to better understand why some of my pages rank well and some don't rank at all. I've discovered that slight changes to how the key phrase is typed into Google can have dramatic effects on the results. Why is this? And how should I interpret it or use it? I understand that some phrases will be more competitive than others, but that doesn't seem to explain the variances entirely. For example, http://traveltipsthailand.com/phuket/best-bachelor-hotels-in-phuket/ (which is SEO optimised for the long-tail phrase "bachelor hotels in Phuket" and "girl-friendly bachelor hotels in Phuket") ranks #1 or #2 for the key phrase "bachelor hotels phuket", but if I modify the phrase slightly to "bachelor hotels IN phuket" it drops to #12 (page 2) with less relevant competitors (like "Bachelor hotels in Chiang Mai") getting in ahead of it. Likewise, if I search on "best bachelor hotels phuket" (the URL phrase of the page) it is #1 or #2 again, but if I modify the search phrase to "best bachelor hotels IN phuket", my SERP drops to #13. If I use the longer-tail key phrase "girl-friendly bachelor hotels in phuket" the results are even more dramatic. I rank #5 for that phrase in the SERPs with or without "IN" in the search phrase. But if I remove "bachelor" from the key phrase and just search on "girl-friendly hotels in phuket" my page drops right off the SERP radar. Somewhere above #200 I think. Would love to get a better understanding of what influences these changes if anyone really knows. Is it just Goovoodoogle or is there a logical explanation? 51c0d097f1c8d9-81984651 51c0d11688af68-43859477
Keyword Research | | Gavin.Atkinson0 -
Product Page is Battling with Homepage in SERPs
My product page had been solidly in the middle of the first page for months. Now, it is being replaced by my homepage for the same keywords. I don't understand why this is happening and I'm worried about it, particularly from a business stand-point (we offer a variety of products that appeal to completely different audiences) In terms of SEO, Is this necessarily a problem? What can I do to ensure that Google recognizes that the content that those keywords are tied to is on the product page, not the homepage. One thing I did notice is that the 2nd and 3rd most common anchor text for the links to my homepage are the two keywords in question (they are a distant 2nd and 3rd however). If nothing else, is there a way I can get SeoMoz to recognize the homepage on its page rankings so that my heart doesn't drop once a week. Thanks,
Keyword Research | | CleanEdisonInc0 -
Should my Google rank be different to actual SERP results?
In my reports this week I was delighted to see "emergency power" at #8 for http://apexgenerators.co.uk/emergency-power/ but then today seems to have jumped to page 4 in SERPS? Can anyone offer any advice? Thanks, Laura
Keyword Research | | lauratagdigital0 -
Can I Trace The Keywords From a PPC & SEO Campaign That Brought The individual To My Site Without Using a Call Tracking Service?
Hi All I was wondering if it is possible to trace the individual keywords/key-phrases that someone has used to get them to my pages/site and if they came in from PPC or SEO, preferably without having to use a call tracking service, code under number, or multi-telephone line system? Regards Nic
Keyword Research | | KDWeb0 -
3 monitoring tools are giving me the simular SERP ranking position but manual searching and traffic are telling me something different. What gives?
I have looked up SERP position in 4 different tools, 3 out of the 4 (Raven, SEO Moz, and Google webmaster tools) are telling me that the site is ranking in the 90s range. When I manually search for the term (when I'm logged out), the site lists on the 1st pages. I also see it listed as the #9 spot when I use SEO Books Rank Checker. Last month, Google webmaster says that the term got us 200 impressions. Has anyone seen this before? Thanks
Keyword Research | | TheOceanAgency0