Problems with OSE downloads

blocker0408

Ordered 5 reports last 24 hours, none received. Anyone else with this problem ? I do expect better from an expensive subscription. C'mon Moz, fix this new OSE report system please.

carinoverturf

No problem! I'm so sorry for the inconvenience!

I just pushed the remaining pending reports through, so I think you should be set, but if you continue to run into any problems, just let me know!

ColumK

Thanks Carin! Appreciate it

carinoverturf

Hey there!

Haha - we ran into a problem on Monday night with one of the machines falling over causing a huge backlog to pile up. We were able to get things back on track yesterday and churn through the backed up reports, but with the index launch yesterday, we're seeing a bit of a backlog again this morning.

We are getting a monster machine up right now to speed through this! Once things calm down you should see these come through. It looks like you have about 8 pending - I'll keep an eye on them to make sure they go through!

Thanks,
Carin

ColumK

I am still getting problems downloading reports. They have been going for 5 hours now. Has the log increased again? Could you not use some of that $18m to buy a few more servers?

carinoverturf

Hey! Same message to you If you want me to look into your account, feel free to email me at carin@seomoz.org!

Just provide some info on what URL you are looking for, what tab you're requesting from and if you have any filters applied and we'll look into why these certain ones are having issues.

Thanks for your patience!!!

Carin

carinoverturf

Hey! I need some more info from you and I can look into it - feel free to email me at carin@seomoz.org.

You're not being difficult - I understand the frustration

If you can provide your account information in an email to me, as well as any information regarding which tab you're requesting from and what URL you are querying for and if you were applying any filters.

Thanks!

Carin

Adwise_Internetmarketing

I'm quite sure I only requested most of the ones pending ones, not a second time. Only a view of them to try out. Like they said they are working on it.

blocker0408

In exactly the same situation, may be something to do with requesting the same report a few times because it didn't come through first time ? Looks like it's close to being fixed though by the Moz team.

blocker0408

Hi Carin

Not being difficult but pushed for time, can you not simply access my account and have a look yourself ?

Thanks & Regards

Adwise_Internetmarketing

I can confirm all except one which were on finalizing are done now. Thanks! the other has the same issue now as addressed below.

There are still like 11 reports starting from scratch every time I visit the csv export page without coming further than around 30%. Others with exactly the same issue are finished though. So it's a bit random why it works for the one and not the other.

I'm not doing anything related to link building today so I've got all patience to wait till it's resolved

carinoverturf

Hey! Can you give me some more information so I can dig into this? Looks like the last batch of 100 reports is crunching through now, but I'd still like to find out why you're not getting yours.

Can you send me some info on the request like: the site searched, any filters used and from which tab.

Thanks!

Carin

blocker0408

Just checked, still no change with the pending reports at my end.

Thanks

carinoverturf

Hey guys!

I wanted to jump in here and give you all the lastest on the CSV download issue. We were finally able to clear through the backlog of CSV reports about 7 pm PST last night, however, there were about 3,000 jobs that were still in a finalizing status and just hanging. We were able to work a quick fix to get these last remaining reports out today. The fix was such a great idea, we've decided to make it a permanent feature in Open Site Explorer!

Since the new launch of OSE, we've had reports of users requesting reports that end up hanging during high peak times. The fix we added today will help in those scenarios by re-queueing the report if it is hanging for a long period of time.

I'm hoping this helped get the last of the missing reports out, but please let me know if you guys are still seeing pending or hanging requests.

Thanks!

Carin

randfish

1:46am - I'll sleep when OSE is doing its job for you!

Adwise_Internetmarketing

Thanks for the response. The issues are worth the improvements. Looking at it long term, a lot has become better Some reports are in, others still pending. I can wait a couple days. Thanks again.

blocker0408

Just checked, some have completed, others still pending that I ordered about 48 hours ago.

What time is it there ? Do you sleep ? you're crazier than me !

Regards

randfish

If you're not getting them, you should probably try re-filing. Reports should be taking <6 hours at the very most. We were seeing many that were <1 hour.

I'll ask the team to hop in this thread, too, in case I've gotten any details conveyed incorrectly.

blocker0408

Thanks Rand, I am sure I speak for the others with this problem when I say many thanks for personally looking at this. As always, excellent service.

Just to be clear, does this mean that the pending reports clogging up my downloads will be cancelled or automatically generated ? Not received any of them yet.

Warm regards

randfish

Hey gang - sorry for my delay getting in here. We had a crazy day.

Here's what happened and why OSE report downloads have been slow:

Last week, we had some volume spikes. The new OSE V3 offers a lot more download functionality, and everyone's been using that functionality a lot (awesome, but also a big load)
We had some technical operational issues that slowed things up on OSE for about 24 hours, creating a huge backlog of reports
We tried to simultaneously scale the capacity and segment the downloaded requests so they wouldn't interfere with load on the rest of the platform
Today, we finally cleared the queue fully and reports should be back to fairly speedy

I'm really sorry about this. The tech behind scaling is challenging and our engineering team worked their butts off, but I know there's no excuse when you need a report or to do some work. We're going to work very hard over the next few weeks to try and make sure we get better with uptime/responsiveness/speed/etc.

Thanks for the patience - and keep your eyes out for more improvements/upgrades in data quality, size and speed coming in the next few months.

Cheers,

Rand

Adwise_Internetmarketing

I've got an email back from Aaron from seomoz with an answer. (I also submitted the issue with the feedback button);

It looks like we're having some troubles getting caught up on the many reports that were generated while our servers were running amiss last week, which is why reports and the UI are wonky today. It may take another day or two for the reports to finally generate. I'm really sorry for the inconvenience; we hope to have OSE and the Linkscape data fully operational in the next couple days or so. Let me know if you're still not able to get your reports by then or if there's anything else I can do to help you.

Have a great week!
Aaron

__

So a couple days patience and everything should be fine. Thanks Aaron for the response

Maybe that also includes the info Rand wanted to say?

KeriMorgret

Actually, Rand tried to respond to this last night, but it looks like Roger must have gone and done something with his response. I've let Rand know his reply didn't make it, and he'll be back in later this morning with a reply. Thanks for your patience!

Aeronet

We have the same problem

Several reports made the 24th August are still "Finalizing**"**, but one made the 26th is complete and we could download it.

blocker0408

looks like this is a significant issue - anyone from Moz listening ?

Adwise_Internetmarketing

Here as well big problems. I'm stuck the whole day with a certain task because the backlink exports aren't coming in. They get stuck at around 30% or something. When I reload the page it starts generating again as off 0%. It just won't finish.

5 days ago (the 24th) I also did a bunch of exports and none of them have finished up till now. It says finalizing for 5 days now and I don't get the needed csv exports. This is an urgent issue, because I'm quite dependent on OSE as link builder.

I really hope this get solved asap. I love OSE when it works though

gq3bB.png

blocker0408

BTW your attached report is EXACTLY what I am also getting, loads of "pending".

blocker0408

Have to say I agree 100%. I love SEOMoz but the new OSE is a problem, and it doesn't seem to be being taken seriously. I asked Rand about this via twitter last night, was reluctant to do so, have also emailed the helpdesk, but still the same problem today. the old method, perhaps more basic of downloading yourself to xl, worked. Paying a lot for a subscription service that doesn't work is annoying.

C'mon Moz, sort it please 1

blocker0408

Have to say I agree 100%. I love SEOMoz but the new OSE is a problem, and it doesn't seem to be being taken seriously. I asked Rand about this via twitter last night, was reluctant to do so, have also emailed the helpdesk, but still the same problem today. the old method, perhaps more basic of downloading yourself to xl, worked. Paying a lot for a subscription service that doesn't work is annoying.

C'mon Moz, sort it please 1

ColumbusAustralia

Hi,

I have been having HUGE problems with OSE for the last few days.

It is getting to the point where I will be looking to stop using my SEO moz account and looking for alternant options with other providers.

It is sooo buggy.

what are the team doing to fix it apart from directing us to a video of a dog? I mean Funny video but in all seriousness I just want the reports so I can carry on with business.

osek.jpg