Why does Linkscap API request hang while extracting data ?
-
Hi,
I am using LinkScape API to get follow and nofollow links .
I use cron to get data for each url of sitemap.xml.
However while cron is running, the extraction of data hangs on some pages which i later need to delete manually for re starting the execution.
Do anyone have any idea why this is happening ? How can i ignore such pages ?
-
Hi...
Thank you so much for your reply..
I was implementing the changeswhich may work.. but they didn't.
I recently came to know about updates to seomoz api which are like,
- SEOmoz Free API: 1 request for every 10 seconds
- Free Extended and PRO Members: 1 request every 5 seconds
- SEOmoz Site Intelligence API: 1 request every 2 seconds
I think this will help me a lot .. thank you ..
-
Hey Ravi,
Sorry for the delayed response - I wanted to follow up with the engineers to see if they had any suggestions for you.
They agreed the Limit parameter set to 1,000 might be too large to process. Have you tried adjusting that to 300 or even 500? Do you see better success at a lower limit?
Our system will timeout at about 60 seconds so I'm not sure if the hanging is on our end. If dropping the limit size doesn't help, you might want to think about ending the request after about a minute. Sometimes requests that are too long wil timeout, but work fine on a retry as some data will be cached from the previous request.
I hope this information is helpful, but let me know if you're still experiencing issues!
Thanks,
Carin -
Some pages are the pages which are moved or not found. I am trying to ignore such pages by getting http response code. But this process takes large amount of time. Almost 10 minutes for a single url of sitemap.xml.
The url of call is like : (php)
http://lsapi.seomoz.com/linkscape/links/URL HERE?SourceCols=4&TargetCols=4&Scope=page_to_page&Sort=page_authority&Limit=1000&Filter=follow&AccessID=" . $accessID . "&Expires=" . $expires . "&Signature=" . $urlSafeSignature;
Thanks .
-
Hey! This is an issue I haven't heard of before - would you be able to provide anymore information like an example query to the API and some of the pages you are seeing hang?
Thanks!
Carin
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Keyword Rank History chart has missing data for periods of time
Hello, When I look at the rank history for a particular keyword, there are missing gaps in the data. For example, the keyword was fluctuating around rank 10-20 from Jan 2022 to July 2022. Then suddenly the line on the graph disappears. It starts tracking again in Oct 2022 starting at rank 16. It almost appears as if Moz lost track of the keyword for some time. Other tracked keywords did not experience the same issue during this time. Then as a result, Moz reporting will say the tracked keyword moved up in ranking 40+. What is happening here? I'm unsure how to explain this activity to my clients.
Moz Pro | | celsiusmarketing0 -
SEOmoz PRO: How to manage a Site with 2 languages on the same domain - without mixing up data?
I want to track a "rootdomain" that has two languages on it, the english version is in a subfolder /en/ 1. http://website.de
Moz Pro | | inlinear
2. http://website.de/en/ I want to manage and track each language-version isolated. So I will setup:
1. http://website.de as campaign DE - german
= as Root Domain
But as there are links to the /en/ Subfolder these data will also be included in all reports. And there is still no option in SEOmoz PRO to exclude folders or even urls.?! This will be bad when wanting a clear report of just one Language Version. 2. http://website.de/en as campaing EN - english
To track as "Subfolder" will not work beacause this option will only consider exactly this subfolder... So is there a way to see data just only for one language Version?0 -
OSE Report Shows HTTP Status "No Data"
Open Site Explorer shows HTTP Status "No Data" on 1,575 urls of the 3,335 urls listed in the "Top Pages" report for my site. What does this mean?
Moz Pro | | debc0 -
Exporting Twitter and FB data in report
Hi Been with this tool for a few days now and enjoying it so far. I do have one query though. In the campaigns section we have various tabs of data, including Social. However while all the other data is exportable in the created report, social is not available to add to the custom reports. Why is this? When I click on the social tab I can download it in CSV but it would be good to be able to export the charts in pdf as per the other analysis data. Would make it much easier when sharing reports with clients. Are there any plans to make the social metrics addable to the custom reports one can create?
Moz Pro | | GrumpyCarl0 -
Sometimes we could not download all the data of inbound links from all linking domains
Sometimes we could not download all the data of inbound links from all linking domains. (Around tithe.) Don't you have any idea?
Moz Pro | | crossfinity0 -
Help with SEOmoz API
Hi guys, I'm trying to make API requests from my webserver via PHP. I'd like to retrieve data from the SEOmoz URL Metrics API. Unfortunately I always get the error response "unauthorized" even when I copy and paste the Sample Valid API Signature generated by your system into the browser. Is Signed Authentication not longer supported? I even tried the sample PHP Code SignedAuth.php but there's the same problem, too. If signed authentication is not longer available, do you have a code example for the basic http authorization? Thanks, Brandon
Moz Pro | | thegreatpursuit1 -
How Do You Leverage Linkscape Data to Overcome Your Competitors?
Hi everyone...I used Q&A a long time ago when my company had a paid subsription but I haven't used it in a while, so I'm excited! And since the Q&A is apparently addressed to the Moz community, I figured I would embrace it and ask all of the Mozzers out there: How do YOU use Linkscape to reverse engineneer a competitor's website? I understand how to use Linkscape. What I'm looking for is specific filtering or "out of the box" uses of Linkscape to truly understand how a website has obtained it's ranking in the search results. In particular, I'm really curious about how everyone (including those who truly know how Linkscape works, i..e the minds behind it) make sense of the "DJ Passed" #'s or "most important links" criteria. I realize Linkscape is wonderful, but what I've found is that often times the links that "pass the most juice" or the links that are the "most important" AREN'T actually the most important links on a site. For example, I often find that the links that have the highest "DJ Passed" are directories. I could be wrong, but my guess would be that directories actually pass very little link juice. If directories gave as much link juice as the linkscape metrics indicate, then they are by far the best linking source, which I think we all know isn't the case in most instances. To be clear...My intention is not to "debunk" the value of Linkscape...On the contrary, I think it's a wonderful tool and I want to understand it's nuances so I can identify "false positives", use it to get a true picture of a website, and get any tips/tricks from those who've successuly used it to overcome there competitors. Thanks ahead of time!
Moz Pro | | LuminConsutling1