Portal Home > Knowledgebase > Industry Announcements > Web Hosting Main Forums > Providers and Network Outages and Updates > OVH outage?


OVH outage?




Posted by Martin-D, 08-29-2013, 02:17 PM
Anyone else seeing problems with servers in OVH?

Nothing on their status page, they wont answer the phones and I can't submit an incident report because the options are disabled.

Posted by Mastermind Networks, 08-29-2013, 02:22 PM
Our servers in Canada and the UK DCs are running just fine at this very moment.

Where are yours located ?

Posted by Martin-D, 08-29-2013, 02:23 PM
They don't have a UK DC, and it's RBX.

hmm: http://forum.ovh.co.uk/showthread.php?t=7212

Posted by srsales, 08-29-2013, 02:34 PM
My kimsufi which is located in France, is down, too
I requested a reboot. Remote Monitoring has no access to server, ping gets lost. No change since 15 minutes.

Posted by Mastermind Networks, 08-29-2013, 02:37 PM
Thanks for the update - we only have a happy meal box with them in the RBX via Kimsufi. That's up for us and so are the servers in Quebec.

Again where are you experiencing the outage ?

EDIT: We do seems to have some problems with our Kimsufi box. Not sure if it's completely dead.

Posted by Martin-D, 08-29-2013, 02:39 PM
Quote:
Originally Posted by srsales
My kimsufi which is located in France, is down, too
I requested a reboot. Remote Monitoring has no access to server, ping gets lost. No change since 15 minutes.
Exactly the problems I'm having. I can't open an incident ticket either as the 'manager' is convinced there's an open ticket/incident... when there isn't.

Seems there's an issue with Ip's somewhere.

I sent a reboot request in 45 minutes ago, just received this:

Dear Sir or Madam,

At 2013-08-29 19:46:32 you've demanded hardware reboot of your
server ks.kimsufi.com.

Our system has detected a bug in your distant reboot system
(P14074/12). As a consequence of your demand hardware reboot
couldn't be finished.

An intervention is being automatically sent to our technicians,
and should start in few minutes from this moment. You'll be
warned by mail of its beginning and its end.

Posted by Danoidx, 08-29-2013, 03:16 PM
Yep, looks like two of my servers are down, however one in the same DC (RBX) is still online. Could be a switch issue?

Posted by Martin-D, 08-29-2013, 03:24 PM
Seems back up now...

Posted by 7x24-Vincent, 08-29-2013, 03:26 PM
Additional IP's on our old Kimsufi boxes are all down.

Main IPs work fine, but the additionals not.

Posted by Danoidx, 08-29-2013, 03:30 PM
http://travaux.ovh.com/?do=details&id=9224

Translation from last post:

"we ended routers vlan 1 (70 routers)
but there is nothing wrong. OSPF process not want to go back. it is going to simplify the configuration of annocer avoid all LSA then restart the routers planted. we already have some routers UP. but much remains to be done."

Doesn't sound good?

Posted by F-DNS, 08-29-2013, 03:31 PM
Quote:
Originally Posted by Martin-D
I can't submit an incident report because the options are disabled.
Kimsufi support is via the Kimsufi forum now unless you pay (I think) £15 a month for support. If the server(s) you have a problem with show up as grey in OVH Manager then you need to head on over to the forum if you have a hardware problem.

As for the "outage", it's not exactly that. They appear to be performing a rolling software patch/upgrade to their DDoS equipment which is causing "brief" connectivity losses to certain subnets which can last 1 to 10 minutes each.

There's 2 relevant threads on OVH's status pages - This one outlines what they're doing, and this one details a few problems they had along the way.

I woudn't get anxious unless you're not able to reach your server for more than, say, 20 minutes.

Posted by Martin-D, 08-29-2013, 03:34 PM
Thanks for that unnecessary insight.

I've been around long enough to know that complaining or moaning after 10 minutes is pointless. After an hour is understandable. 2 hours of an outage isn't acceptable.

Perhaps you can tell me where exactly these 1-10 minute outages where? Perhaps if you'd bothered to check the OVH forum yourself you'd see there was and is a much bigger issue going on.

Posted by 7x24-Vincent, 08-29-2013, 03:35 PM
@F-DNS,

2 servers additional IP's are down more than 3 hours.

Obviously something is wrong out there.

Posted by srsales, 08-29-2013, 03:35 PM
RBX1 has status Maintainance. I can't post links, maybe you know the page where you see the status of ongoing tasks

Maintenance 0 FS#9224 — RBX1 internal network In progress 0% complete
5277 Maintenance 0 FS#9200 — PeakFlow et TMS In progress 0% complete

Posted by CymraegWalesHosting, 08-29-2013, 03:45 PM
Quote:
Originally Posted by F-DNS
Kimsufi support is via the Kimsufi forum now unless you pay (I think) £15 a month for support. If the server(s) you have a problem with show up as grey in OVH Manager then you need to head on over to the forum if you have a hardware problem.

As for the "outage", it's not exactly that. They appear to be performing a rolling software patch/upgrade to their DDoS equipment which is causing "brief" connectivity losses to certain subnets which can last 1 to 10 minutes each.

There's 2 relevant threads on OVH's status pages - This one outlines what they're doing, and this one details a few problems they had along the way.

I woudn't get anxious unless you're not able to reach your server for more than, say, 20 minutes.
This is more than a 20 minute software update. Something has gone wrong somewhere.

We have been having issues across all our RBX servers since 4pm UK time today and it's still on going. I.e 1 minute there up. Next minute there not. For the record we have about 3 dozen servers with them. 20ish are in RBX.

Kind Regards,

Posted by F-DNS, 08-29-2013, 04:04 PM
Quote:
Originally Posted by Martin-D
Thanks for that unnecessary insight.
Feel free to ignore it in future

Quote:
Originally Posted by Martin-D
Perhaps you can tell me where exactly these 1-10 minute outages where?
We've seen it mostly in RBX1 and RBX3, and switched to failovers in OVH Strasbourg as a result to stay out of it for now.

Quote:
Originally Posted by Martin-D
Perhaps if you'd bothered to check the OVH forum yourself you'd see there was and is a much bigger issue going on.
I have, but thanks for the unnecessary insight.

Posted by Martin-D, 08-29-2013, 04:07 PM
Not unnecessary when it relates directly to the issue at hand.

Don't know why you mentioned a few minutes or not classing it as an outage. If you had read the threads in question, as you claimed, you'd know it was hours and indeed an actual 'outage'.

Thanks.

Posted by F-DNS, 08-29-2013, 04:10 PM
Quote:
Originally Posted by Martin-D
If you had read the threads in question, as you claimed, you'd know it was hours and indeed an actual 'outage'.
I can only cite our own experience (xxx servers spread across OVH EU, ignoring Canada).

We're seeing typically connections dropping for a few minutes, not anything measured in hours. RBX1 and RBX3 mostly, RBX4 to a lesser degree, nothing at all in Strasbourg or Gravelines.

Posted by TrentaHost, 08-29-2013, 04:18 PM
I have a dedicated with them for the last 6 months, it's been down all day today... it was down and up earlier this morning but now has been down for the last few hours.

Posted by ricktza, 08-29-2013, 04:41 PM
Their forums appear down also now :|

Posted by Joose, 08-29-2013, 05:00 PM
My server just came back up now, looking at its uptime it looks like it has been on this whole time, just missing connectivity. The connection seems a bit flaky though, dropping ping packets every now and then.

Posted by ricktza, 08-29-2013, 05:02 PM
Mine came on also then died like 5 minutes later.

Posted by MAXZEUS, 08-29-2013, 05:05 PM
As always and not surprisingly I am having issues too, many of the servers having routing issues and users not being to reach it.

Anyways I am not using OVH for anything serious anymore, because it doesn't worth the risk .

Cheap servers = Cheap Services...

Posted by srsales, 08-29-2013, 05:06 PM
I'm back online!

Page loads quick as ever.

Have a nice day!

Posted by F-DNS, 08-29-2013, 05:18 PM
Quote:
Originally Posted by ricktza
Their forums appear down also now :|
Back up.

We're currently showing green lights for everything we have bar one in 5.135.151.###

EDIT: Oh, ignore that IP - It's a VPS that's been having kittens for 2 days

Posted by ricktza, 08-29-2013, 05:26 PM
Everything for me seems fine now.

hope everyone's servers are back online!

Posted by Joose, 08-29-2013, 05:43 PM
Aaaand down it goes again.

edit: Nevermind, that was a short cut.

Posted by alex-developer, 08-29-2013, 05:54 PM
their forum is down, the network up and down every other minutes and the issue is Anti-DDoS configuration:
http://status.ovh.co.uk/?do=details&id=5263

Posted by alex-developer, 08-29-2013, 05:56 PM
the Anti-DDoS is behind the scheduler as supposed to be up and running by 1st of September, but they forgot to tune / configure and adjust it to their DCs.

Posted by alex-developer, 08-29-2013, 06:02 PM
currently more than 25 servers are down at RBX-1:
http://status.ovh.co.uk/vms/index_rbx.html

Posted by TrentaHost, 08-29-2013, 06:03 PM
Came up went back down and now up again, I hope it stays this way...

Posted by mustardman, 08-29-2013, 06:26 PM
If this is DDoS all I can say is that it's probably just the beginning of your problems and you haven't seen anything yet with all the gamers they are signing up. Down for a few minutes then back up when the detection kicks in and null routes then back down again when the attack is on something else is classic DDoS.

Posted by F-DNS, 08-29-2013, 06:56 PM
Failover IPs seem to be mixed up in this too. I was going to try to move a spare failover IP back from SBG to RBX to see how it would ping back in RBX, but it's not showing up against the SBG server I moved it to (and pings fine at) so I can't flick it back

EDIT: The IP I wanted to test traces London > RBX > FRA > SBG so it's definitely in the right place.

Posted by Servode, 08-29-2013, 07:08 PM
http://status.ovh.co.uk/?do=details&id=5263

Posted by Servode, 08-29-2013, 07:12 PM
http://status.ovh.co.uk/?do=details&id=5301

rbx-7/8/9/10/11/12/14/15/16/17-m1/m2: done
there is some card damage on rbx-14, rbx-4, rbx-3.
we are replacing with spares.

Posted by WII-Aaron, 08-29-2013, 07:14 PM
Quote:
Originally Posted by Servode
http://status.ovh.co.uk/?do=details&id=5301

rbx-7/8/9/10/11/12/14/15/16/17-m1/m2: done
there is some card damage on rbx-14, rbx-4, rbx-3.
we are replacing with spares.
Strange. I wonder if they mean physical damage or if it's a bad translation.

Posted by Servode, 08-29-2013, 07:15 PM
Quote:
Originally Posted by WII-Aaron
Strange. I wonder if they mean physical damage or if it's a bad translation.
I was just wondering that my self,

I do give them credit for being a budet provider,

They have one epic status page.

Posted by F-DNS, 08-29-2013, 07:21 PM
Quote:
Originally Posted by WII-Aaron
Strange. I wonder if they mean physical damage or if it's a bad translation.
Sometimes you have to read between the lines - For example domage in French = Shame in English.

Quote:
Originally Posted by Servode
They have one epic status page.
They're 100% transparent - trouble is, the transparency often gets typed up after the event, and the local offices rely on that and Ole's tweets to get info from

If there's nothing on the status pages and Ole's not tweeting about it you might as well go ask Mystic Meg.

Posted by quicksilver04, 08-30-2013, 08:50 AM
Quote:
Originally Posted by mustardman
If this is DDoS all I can say is that it's probably just the beginning of your problems and you haven't seen anything yet with all the gamers they are signing up. Down for a few minutes then back up when the detection kicks in and null routes then back down again when the attack is on something else is classic DDoS.
I've never been confident in their ability to properly configure their DDoS protection, nor their outgoing email scanner, and thus I consider myself lucky to have canceled my Kimsufi just yesterday.

Good luck to those staying with them, though, you'll need a lot of patience in the next months.

Posted by CraftingServers, 08-31-2013, 05:04 AM
I have a small dedicated server there for testing/private use, haven't noticed any downtime/outage



Was this answer helpful?

Add to Favourites Add to Favourites    Print this Article Print this Article

Also Read
Mediatemple outage (Views: 857)
1and1.com down? (Views: 1087)
levelhosting.ca (Views: 885)


Language: