Thoughts on scraping SERPs and APIs
-
I'm perplexed about a couple of things.
Google says that scraping keyword rankings is against their policy from what I've read. Bummer. We comprise a lot of reports and manual finding and entry was a pain. Enter Moz! We still manually check and compare, but it's nice having that tool. I'm confused now though about practices and getting SERPs in an automated way. Here are my questions
- Is it against policy to get SERPs from an automated method? If that is the case, isn't Moz breaking this policy with it's awesome keyword tracker?
- If it's not, and we wanted to grab that kind of data, how would we do it? Right now, Moz's API doesn't offer this data. I thought Raven Tools at one point offered this, but they don't now from what I've read. Are there any APIs out there that we can grab this data and do what we want with it? (let's day build our own dashboard)?
Thanks for any clarification and input!
-
You're much too kind Happy New Year!
-
Hi Rand. Anyone ever tell you you're awesome?
I just did. Thanks bud
-
Hi Boogily,
A) In terms of ToS, I'm not 100% clear. I know that Google has been strict about automated rank checking programs installed on a user's local machine, and they've enforced that a bit through technical and guidelines means. However, they've been unclear about companies like Moz, Searchmetrics, GetStat, AuthorityLabs, Conductor, Brightedge, Yield, RankAbove, and hundreds of others which provide this data in their software. I suspect they don't love it, but tolerate it and haven't taken action for over a decade now.
B) On the API front, check with GetStat and AuthorityLabs. I believe they both have rank data offerings from an API standpoint. Moz doesn't offer that and probably won't in the future, either.
Cheers!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Need Moz SEO Wordpress Plugin With API
Re: Moz WordPress Plugin? Hi guys,
Moz Pro | | mrezair
I need some Moz SEO Wordpress Plugins For my website working with Moz API. I've already found Moz DA-PA Checker plugin Moz DA-PA Checker But Need SEO Plugins too. Any Suggestion will be appreciated.0 -
Are Moz Ratings that reliable/correlated against SERPS?
So 3 weeks in Penguin 2.0 and after an initial drop in rankings (4-5 places on top keywords from rank 1), I have seen a small climb in rankings by a couple places but have seen a huge jump in my DA, PA and Domain trust/rank... That FAR surpasses any other magicians website. However I am ranking below some really really poorly rated sites. I am getting a PA of 51 which is really high for the industry (maybe the highest). If this is the case, why am I not number one for every keyword in my demographic?
Moz Pro | | TomLondon
I know this is asked a lot but how reliable are Moz stats, I know no one can really know how Google rank sites on SERPS but if Moz is the best shouldn't it be kinda close? Any thoughts on how accurate Moz rank is and also if it can be used as some indication of the SEO power behind a website.0 -
Mozbar SERP Control Panel Help: Export Results Option Not Available
Hi everyone. For some strange reason, the "Export" option is no longer appearing in my SERP Control panel when trying to export results from the SERP Overlay. It worked fine before SEOMoz changed over to Moz, but now the option is no longer available. Is there something I can do to restore this feature?
Moz Pro | | bashseo2 -
Free API
I have a problem. I got my api credencials. I use the example from this site http://www.seomoz.org/ugc/seomoz-api-lab-experiment-ajaxed-page-comparison-tool I changed the credentials data and.. All I got is Service Unavailable or Authentication failed. Do I have to add my application on http://apidash.seomoz.org/users/392511/applications to get it work? Whats wrong. My id is member-3f4c13759d
Moz Pro | | traffictrends0 -
Top 10 SERP Competition PA
I really like the Keyword Difficulty Tool. I'm looking to get into some affiliate marketing and I'm trying to assess a good niche site to create. I have a couple questions about assessing the results of this tool: 1. When looking to compete for top 10 SERPs are Page Authority & Domain Authority closely related? because a page could have a 1 PA and an 80 DA. 2. What individual PA ranking is considered to be surpass-able? below 40? 30? 3. What difficulty percent would you consider worth competing for? or a waste of time? I guess I'm looking for some breaking points here. Thanks!
Moz Pro | | AndySolo0 -
What's Your Thought About Market Samurai as An SEO Tool Compared to SEOMoz?
What is your opinion about Market Samurai tool as a SEO Tool? I have used it and found it good for analyzing the top 10 competition, getting anchor text profiles and so on. SEOMoz is cool, but has a lot more features. However it lacks keyword research tool. We really cant compare the two tools in terms of pricing because the cost of the MS tool for a lifetime is what will cost SEOMoz membership for a month. What;s your take on this?
Moz Pro | | ConversionChamp0 -
Help with SEOmoz API
Hi guys, I'm trying to make API requests from my webserver via PHP. I'd like to retrieve data from the SEOmoz URL Metrics API. Unfortunately I always get the error response "unauthorized" even when I copy and paste the Sample Valid API Signature generated by your system into the browser. Is Signed Authentication not longer supported? I even tried the sample PHP Code SignedAuth.php but there's the same problem, too. If signed authentication is not longer available, do you have a code example for the basic http authorization? Thanks, Brandon
Moz Pro | | thegreatpursuit1 -
Mozbar export of serp overlay as csv not opening on Mac OS w/FF.
Its works on my (virtual) Window based machine in FF. And when I open that same file on my Mac OS, it works! However, when downloading the overlay data to csv on my Mac OS in FF, i get a super long file name & then the file won't open? Shows -5000 error? Both in Excel and Open Office. Any ideas? Both new version of Excel & Mozbar.
Moz Pro | | josey1