Thoughts on scraping SERPs and APIs
-
I'm perplexed about a couple of things.
Google says that scraping keyword rankings is against their policy from what I've read. Bummer. We comprise a lot of reports and manual finding and entry was a pain. Enter Moz! We still manually check and compare, but it's nice having that tool. I'm confused now though about practices and getting SERPs in an automated way. Here are my questions
- Is it against policy to get SERPs from an automated method? If that is the case, isn't Moz breaking this policy with it's awesome keyword tracker?
- If it's not, and we wanted to grab that kind of data, how would we do it? Right now, Moz's API doesn't offer this data. I thought Raven Tools at one point offered this, but they don't now from what I've read. Are there any APIs out there that we can grab this data and do what we want with it? (let's day build our own dashboard)?
Thanks for any clarification and input!
-
You're much too kind Happy New Year!
-
Hi Rand. Anyone ever tell you you're awesome?
I just did. Thanks bud
-
Hi Boogily,
A) In terms of ToS, I'm not 100% clear. I know that Google has been strict about automated rank checking programs installed on a user's local machine, and they've enforced that a bit through technical and guidelines means. However, they've been unclear about companies like Moz, Searchmetrics, GetStat, AuthorityLabs, Conductor, Brightedge, Yield, RankAbove, and hundreds of others which provide this data in their software. I suspect they don't love it, but tolerate it and haven't taken action for over a decade now.
B) On the API front, check with GetStat and AuthorityLabs. I believe they both have rank data offerings from an API standpoint. Moz doesn't offer that and probably won't in the future, either.
Cheers!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Need Moz SEO Wordpress Plugin With API
Re: Moz WordPress Plugin? Hi guys,
Moz Pro | | mrezair
I need some Moz SEO Wordpress Plugins For my website working with Moz API. I've already found Moz DA-PA Checker plugin Moz DA-PA Checker But Need SEO Plugins too. Any Suggestion will be appreciated.0 -
SERPs ans SEO
I am trying to analyze my site to determine what we may be doing wrong as far as our site goes Ilike everyone else I suppose). In any event I have followed as much as I can from the Moz guideline and tools. We were ranking very well for quite some time and now..kaput. We have tried to make our site faster (using Google Page Speed ..the CDM for GOOGLE). We have also tried redoing out title and description tags to be more search and user friendly. Our site is very fast now...which is good. But we are still not seeing the rankings improvements that we had hoped for. We have built the site using WP and broke the template to make what we feel is an attractive site....used what we feel are the best plugins to capitalize....can anyone give us some feedback to let us know if we are just missing something here. We are RELEVANT to our industry...
Moz Pro | | AdsOnWheels0 -
Wher is the API id and key? I tried generating it several times but I get nothing...?
Wher is the API id and key? I tried generating it several times but I get nothing...?
Moz Pro | | breezego0 -
Rankings Different in Serps from Report
My site shows up on page one for many search queries, but I'm "not in the top 50" for those same terms according to the rankings report. Having troubleshooted the problem, it may be a canonical issue. I did not include www when I originally set up my reports and it seems that my site shows up in search results with www. However; if you type in the url without the www, it will automatically forward to the page with www. I did this intentionally in order not to get penalized for duplicate content pages. So here's my question: If I've got one page redirected to the other, shouldn't the rankings report also follow that redirect? If so, then it should show the correct results, right? Thanks, Dino
Moz Pro | | Dino640 -
Video SERP and Seomoz ranking
It seems that my keywords that lead to videoresults in SERP, is not being ranked on Seomoz! How come when i rank #3 on a certain keyword with a videoresult Seomoz is displaying me as #15 (which is the second of my pages in SERP)? What is the reason for not counting the video-result in the ranking-tool?
Moz Pro | | alsvik0 -
Are there plans for an API for the keyword difficulty tool?
I don't know about everyone else, but this would make me one happy pro member!
Moz Pro | | davidangotti0 -
How do I get the SERP overlay tool to work?
I have the SEOMoz toolbar installed. In the settings I have a tick next to Display SERP Overlay. When I first activated this it showed up but with no data just continually searching for a long time. Now it is not showing up at all. This is such a great tool, how can I get it working? Thanks, Daniel.
Moz Pro | | iSenseWebSolutions0 -
Toolset Q.) Re. Linkscape - How is the External Links (link juice) calculated in the API?
Re. External Links (link-juice) - I really need to know what this reflects.Ie. linkdiagnosis.com divides the PR by external link factors to get an idea of link juice or power - how does Moz calculate this scoring?
Moz Pro | | Turkey0