Thoughts on scraping SERPs and APIs
-
I'm perplexed about a couple of things.
Google says that scraping keyword rankings is against their policy from what I've read. Bummer. We comprise a lot of reports and manual finding and entry was a pain. Enter Moz! We still manually check and compare, but it's nice having that tool. I'm confused now though about practices and getting SERPs in an automated way. Here are my questions
- Is it against policy to get SERPs from an automated method? If that is the case, isn't Moz breaking this policy with it's awesome keyword tracker?
- If it's not, and we wanted to grab that kind of data, how would we do it? Right now, Moz's API doesn't offer this data. I thought Raven Tools at one point offered this, but they don't now from what I've read. Are there any APIs out there that we can grab this data and do what we want with it? (let's day build our own dashboard)?
Thanks for any clarification and input!
-
You're much too kind
Happy New Year!
-
Hi Rand. Anyone ever tell you you're awesome?
I just did. Thanks bud
-
Hi Boogily,
A) In terms of ToS, I'm not 100% clear. I know that Google has been strict about automated rank checking programs installed on a user's local machine, and they've enforced that a bit through technical and guidelines means. However, they've been unclear about companies like Moz, Searchmetrics, GetStat, AuthorityLabs, Conductor, Brightedge, Yield, RankAbove, and hundreds of others which provide this data in their software. I suspect they don't love it, but tolerate it and haven't taken action for over a decade now.
B) On the API front, check with GetStat and AuthorityLabs. I believe they both have rank data offerings from an API standpoint. Moz doesn't offer that and probably won't in the future, either.
Cheers!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
SEOMoz API not working for Scrapebox
I want to import SEOMoz data to list of URLs I have using scrapbox. I added in my credentials according to the API but am getting error 401 as the status of all my links. Any idea why and what I should be doing?
Moz Pro | | theLotter0 -
I cant generate my Mozscape API
I have tried to generate my Mozscape API numerous times after waiting at least 20 mins between. Any help would be great.
Moz Pro | | MLMLEADZONE1 -
SERP Changes depending on ISP
If I search Google for my site using my mobile internet provider I get different results from my main internet. Before anyone suggests it, it's nothing to do with saved searches as I'm clearing cookies and I've tried on multiple different platforms. I can plug my iPad and use my wireless, it's my normal rankings, but as soon as I switch to my mobile provider for internet, I'm 3rd instead of 2nd on the SERPs. Any ideas?
Moz Pro | | awdgareth0 -
Seomoz keyword difficulty api
Is there a way to get this from an api or a better method than pasting 5 keywords at a time into the keyword difficulty tool to get these numbers?
Moz Pro | | insitegoogle0 -
How good is Link Assistant Suite? and how good is the SEOmoz API?
Ive gotten many mixed opinions on Link Assistant and its complete suite, I wanted to get some opinions on the matter.. Anyone use these tools? What is the difference between these tools and other tools on the web? Would adding the free SEOmoz API into this software show better results?
Moz Pro | | SEODinosaur0 -
SEOMoz SERP Overlay Vs. Opensite Explorer
This may be a simple answer, but when I search for a term and see a website on the SERP, the SEOMoz tool bar shows link data beneath the link. For this site in particular, it shows 300+ links for the root domain and for the page, it shows 8 links. When I put that website in opensite explorer, it shows the same data for the "Page" stats (8 links from 3 root domains), but nowhere can I find where the 315 links from 4 domains comes from. So my questions is why do those links show in the SERP overlay, but not in OSE? il5y9.png
Moz Pro | | GetFoundFirst0 -
Rank Tracker via API
Hello SEOMoz, The functionality of the Rank Tracker Tool is excellent - I was wondering if it might be coming to the API so we can do some deeper analysis? Thanks!
Moz Pro | | igzebedze0