Thoughts on scraping SERPs and APIs
-
I'm perplexed about a couple of things.
Google says that scraping keyword rankings is against their policy from what I've read. Bummer. We comprise a lot of reports and manual finding and entry was a pain. Enter Moz! We still manually check and compare, but it's nice having that tool. I'm confused now though about practices and getting SERPs in an automated way. Here are my questions
- Is it against policy to get SERPs from an automated method? If that is the case, isn't Moz breaking this policy with it's awesome keyword tracker?
- If it's not, and we wanted to grab that kind of data, how would we do it? Right now, Moz's API doesn't offer this data. I thought Raven Tools at one point offered this, but they don't now from what I've read. Are there any APIs out there that we can grab this data and do what we want with it? (let's day build our own dashboard)?
Thanks for any clarification and input!
-
You're much too kind Happy New Year!
-
Hi Rand. Anyone ever tell you you're awesome?
I just did. Thanks bud
-
Hi Boogily,
A) In terms of ToS, I'm not 100% clear. I know that Google has been strict about automated rank checking programs installed on a user's local machine, and they've enforced that a bit through technical and guidelines means. However, they've been unclear about companies like Moz, Searchmetrics, GetStat, AuthorityLabs, Conductor, Brightedge, Yield, RankAbove, and hundreds of others which provide this data in their software. I suspect they don't love it, but tolerate it and haven't taken action for over a decade now.
B) On the API front, check with GetStat and AuthorityLabs. I believe they both have rank data offerings from an API standpoint. Moz doesn't offer that and probably won't in the future, either.
Cheers!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Does anyone know why the MOZ SERP analysis has become so slow that it's not even useful?
Does anyone know why the MOZ SERP analysis has become so slow that it's not even useful?
Moz Pro | | PLEXI3 -
SERP Overlay Won't Show Up
I'm using the latest version of Chrome. I'm logged into Moz and the SERP Overlay is turned on. I turn it off and on again, and then it says "loading" beneath all the search results. Any answers would be appreciated, thanks!
Moz Pro | | franklinmozart0 -
Followerwonk API (401 Unauthorized)
I am trying to use the Followerwonk api and I have changed the C# code from the MozscapeAPI code here for it to work as it uses the same encryption etc. https://github.com/QueryClick/MozscapeAPI The problem I am having is that I generate the correct link but I still get back 401 Unauthorized from Followerwonk it works fine on Mozscape API. https://api.followerwonk.com/social-authority/?screen_name=maximillion195;AccessID=member-NWQyZTI1M2EtMWUyZC01NDJhLThmZW;Timestamp=1368030369;Signature=PxK24AP7cgXMMVhzrU8NSRtSI%3D (I have changed the member ID and Signature) The Link looks right and it defiantly hashes it correctly and the timestamp is set for 20 minutes in the future, Can anyone explain why this is not working. Thanks
Moz Pro | | intSchools0 -
I'm shocked! KEYWORD SERPs: GA avg. position vs. SEOmoz
SEOmoz has us our position for a particular keyword as "Not in Top 50". The same keyword is listed in GA with an average position of. 3.0. What am I missing here? When I do a search, I most definitely am not seeing us listed as #3 for this keyword, and tend to believe the SEOmoz number, but why is it so wildly different in GA? Should I have hope? There is another keyword that SEOmoz has us at #4 and it isn't even on the GA list. Can anyone explain this to me? Many thanks.
Moz Pro | | gfiedel0 -
Seomoz keyword difficulty api
Is there a way to get this from an api or a better method than pasting 5 keywords at a time into the keyword difficulty tool to get these numbers?
Moz Pro | | insitegoogle0 -
Does Moz track SERP in Google Places?
Hi, how are you? I wanted to ask you if the rankings that Moz shows include the results from Google Places that sometimes appear in the SERPs. Thanks in advance1 Ariel
Moz Pro | | arielbortz0 -
Related Backlinks by Keyword SERP results
Is there no tool to search a keyword and find related backlinks among the top10,20,30 SERP results?
Moz Pro | | FirePowered0 -
Help with SEOmoz API
Hi guys, I'm trying to make API requests from my webserver via PHP. I'd like to retrieve data from the SEOmoz URL Metrics API. Unfortunately I always get the error response "unauthorized" even when I copy and paste the Sample Valid API Signature generated by your system into the browser. Is Signed Authentication not longer supported? I even tried the sample PHP Code SignedAuth.php but there's the same problem, too. If signed authentication is not longer available, do you have a code example for the basic http authorization? Thanks, Brandon
Moz Pro | | thegreatpursuit1