Why does Linkscap API request hang while extracting data ?
-
Hi,
I am using LinkScape API to get follow and nofollow links .
I use cron to get data for each url of sitemap.xml.
However while cron is running, the extraction of data hangs on some pages which i later need to delete manually for re starting the execution.
Do anyone have any idea why this is happening ? How can i ignore such pages ?
-
Hi...
Thank you so much for your reply..
I was implementing the changeswhich may work.. but they didn't.
I recently came to know about updates to seomoz api which are like,
- SEOmoz Free API: 1 request for every 10 seconds
- Free Extended and PRO Members: 1 request every 5 seconds
- SEOmoz Site Intelligence API: 1 request every 2 seconds
I think this will help me a lot .. thank you ..
-
Hey Ravi,
Sorry for the delayed response - I wanted to follow up with the engineers to see if they had any suggestions for you.
They agreed the Limit parameter set to 1,000 might be too large to process. Have you tried adjusting that to 300 or even 500? Do you see better success at a lower limit?
Our system will timeout at about 60 seconds so I'm not sure if the hanging is on our end. If dropping the limit size doesn't help, you might want to think about ending the request after about a minute. Sometimes requests that are too long wil timeout, but work fine on a retry as some data will be cached from the previous request.
I hope this information is helpful, but let me know if you're still experiencing issues!
Thanks,
Carin -
Some pages are the pages which are moved or not found. I am trying to ignore such pages by getting http response code. But this process takes large amount of time. Almost 10 minutes for a single url of sitemap.xml.
The url of call is like : (php)
http://lsapi.seomoz.com/linkscape/links/URL HERE?SourceCols=4&TargetCols=4&Scope=page_to_page&Sort=page_authority&Limit=1000&Filter=follow&AccessID=" . $accessID . "&Expires=" . $expires . "&Signature=" . $urlSafeSignature;
Thanks .
-
Hey! This is an issue I haven't heard of before - would you be able to provide anymore information like an example query to the API and some of the pages you are seeing hang?
Thanks!
Carin
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How often does Moz data update when leveraging it through Supermetrics for Datastudios?
Good Afternoon, A pretty straightforward question: How often does Moz data update when leveraging it through Super-metrics for Data studios? I noticed that the "time last crawled" metric had some URLs not crawled in over 2 months... wondering if there's a way to speed it up on Moz's end.
Moz Pro | | LoweProfero0 -
Linkscape API Sort calls
I'm using Linkscape API plugin from SEO Gadget. It's all fine but I can't find any documentation on other 'sort' calls. The only request that I knows that works is "domains_linking_page". Any idea where this information is? I was hoping for a list of all the available requests I can and more particularly I want to sort it by Internal Linking Domains.
Moz Pro | | iProspect-397560 -
API and bitflag question
I've googled and read and still confused on this. Regarding the link metric bit flags: http://apiwiki.seomoz.org/link-metrics I understand everything about how the API works and have it all working, except for this bit flag thing... And there's no example on this page of how to use the bit flags in an API request so it's hard to work it out. My current API call is: "http://lsapi.seomoz.com/linkscape/" & $db & "/" & $objectURL & "? SourceCols=" & $SourceCols & "&TargetCols=" & $TargetCols & "&Scope=" & $Scope & "&Sort=page_authority" & "&Filter=" & $Filter & "&AccessID=" & $accessID & "&Expires=" & $expires & "&Signature=" & $urlSafeSignature There are 4 Link Metric Bit Flags: 2, 4, 8, and 16. How do I use those in the above URL Do I use those in SourceCols? And there's about 15 Link Flag Definitions (ranging from 1 to 65536). So I use those in TargetCols? I've tested different variations and I get different responses but the responses aren't documented either. For example, if I get "luutrp":5.432777943351583,"luutrr":1.415861867916131e-14" in a response... what IS luutrp or luutrr. These acronyms are not outlined anywhere that I can find. This link: http://www.seomoz.org/ugc/the-busy-developers-guide-to-seomoz-bit-flags outlines an example but is using Cols (not SourceCols or TargetCols) so either this page is outdated or I'm missing something. Is there also a "Cols" parameter? Basically, I just want: - given a single URL, show me all links (page to page) pointing to that URL, and give me the same information that's displayed in Open Site Explorer (page authority, anchor text, title, etc, etc) but also give me some additional information such as, "is it on the same C block?" What's an example URL for the above request? Really hoping someone can shed some light on this under-documented API.
Moz Pro | | eatyourveggies0 -
How do I collect all links through the SEOMoz API?
How do I collect all links through the SEOMoz API? Yes, I know how to pull url metrics info but want to pull the inbound links only via php script w/out having to go to the OSE page to pull. any suggestions would be great!
Moz Pro | | destdigi0 -
Opensiteexplorer details in API
Is there a way to access opensiteexplorer result details via seomoz's API? Most interested in the social media results
Moz Pro | | fuzzlepop0 -
How do data feeds work in product selection
Hi – I don't know if this is an SEO matter or not, but I have data feeds to Google, Bing and thefind.com for all of my products. I have no idea if these feeds help. My guess is that they do not generate much business. For example if I type in "Brass Bookends" our products usually don't show up until the late pages. Using this as an example does anyone know how these sites select the order in which they display products? Another way to phrase this is what makes thefind.com show a competitor's brass bookends several pages before ours? FYI we have been doing these data feeds for a year on a consistent basis so being new shouldn't be a factor. Any insights will be most appreciated. Thanks. Don. www.uniquegiftsanddecor.com
Moz Pro | | uniquegifts-2778790 -
Any ideas about using research tools data to create client interest in dedicating marketing spend on SEO services vs their other current antiquated marketing methods?
I consult in the dental industry. Many professionals in this industry are operating in the dark ages when it comes to marketing. Any ideas about using research tools data to create client interest in dedicating marketing spend on SEO services vs their other current antiquated marketing methods? I am approaching potential clients to pitch SEO. They aren't necessarily seeking SEO services currently but have a strong marketing budget. I would like to use seomoz tools data about their site and competitors as way to show possibilities/potential of SEO services to gain interest in further discussion of SEO benefits.
Moz Pro | | cody_baird0