Shared Hosting
Shared HostingKnowledgebase
Portal Home > Knowledgebase > Industry Announcements > Web Hosting Main Forums > Providers and Network Outages and Updates > PowerVPS down
PowerVPS down
 |
 |
 |
Posted by Ulysses, 05-29-2013, 07:31 AM PowerVPS down since 11:59am GMT.
The nameservers for it are not responding http://www.intodns.com/deftechgroup.com
Any info would be good.
Posted by MatthewN, 05-29-2013, 07:41 AM Down for me too. I tried a lot of Powervps.com domains and cannot contact anything. Part of me is wondering if this is related to the very short notice outage recently where they gave us 24 hours notice saying they were moving all equipment to another location... are they struggling?
Posted by hostingvince, 05-29-2013, 07:45 AM Also no updates on their Twitter feed doesn't help in situations like this :-(
https://twitter.com/PowerVPS
Vince
Posted by HostingOwner-SS, 05-29-2013, 07:47 AM Looks down for me too, Hope so you will get response from the company very soon.
Posted by icarus2004, 05-29-2013, 07:48 AM Problem seems to be on Ashburn location, we are able to reach our Chicago server.
Posted by idimensionz, 05-29-2013, 08:00 AM My server is in VA too and not accessible. I agree with the person that mentioned the recent "migration"...this has me concerned that the company is not doing well. I contacted Virtacore (their parent or sister company) via phone and Twitter and am waiting for a response.
Posted by tgraphics, 05-29-2013, 08:00 AM I just noticed one of my servers are down too (1 of 3). No heads up from Defender/Virtacore. Hard to say if email delivery is broken, but I have not received an auto-reply from their ticketing system. Of course, it's served by a script hosted on a website that is experiencing the same problems, so that may not mean much.
I've been with Defender for about 7 years. Service has been very reliable, although this year has seen a bit of unexpected downtime.
I'm sifting through old emails trying to find Rob's cell phone number. (Hopefully he is still with the company - I haven't had any correspondence with him since May of last year.)
Posted by jrepetto, 05-29-2013, 08:10 AM I called their 877 number and had to leave a voicemail. Not what I expect at all. At the very least I'd want some information on the voicemail message.
Posted by winger, 05-29-2013, 08:28 AM down from here too, also the helpdesk is down...
Posted by stevendbrady, 05-29-2013, 08:31 AM Same here. My VPS and sites are down, Ashburn hosted, and I've also left a phone message. It seems that their phone support isn't even available until 7am PST, which I find insane.
And I'm mad enough that I signed up just to complain here.
Posted by mediagirlnm, 05-29-2013, 08:32 AM I called (888)573-7837 & got a live person at the sales extension.
He said the issue is from a hardware change. They are on it apparently. I suggested he get info posted here and to Twitter ASAP so we aren't all in the dark! He took the IPs for my 3 servers and my phone number.
Anna
Posted by cpartsenidis, 05-29-2013, 08:34 AM I've been with PowerVPS/Defender hosting for over 7 years and I believe this is the first time we've had such a major outage!
Perhaps the worst is that I am not able to contact anyone to find out what is happening, emails seem to be offline, their website and of course, phone number goes to an answering machine - so much for the 24/7 support that includes telephone (+18 184351968 / +18779050168).
I am very upset to see that there is no way to contact the company or support help desk during these critical hours, and there also has been no update from them anywhere.
Does anyone else have any idea on what on earth is going on?
Thanks
Chris.
Posted by mblendinger, 05-29-2013, 08:36 AM somebody get some ETA information ?
Posted by mediagirlnm, 05-29-2013, 08:38 AM No ETA from the guy I just talked to at their sales line. He suggested it wouldn't be much longer but there is no way he can really know that IMO.
Posted by cpartsenidis, 05-29-2013, 08:41 AM Anna,
Thanks for posting your update - however I really don't buy their story. Obviously this is an unscheduled event, which means they have a failure that has brought down almost all VPSs hosted in the Ashburn datacenter, along with the powervps website, deftechgroup website and support help desk.
It sounds to me more like a major issue - typically disguised by sales people as a 'minor' hardware issue etc.
I don't like at all the way they are dealing with this - they haven't even bothered to reach out to their affected customers and let them know what's happening and how long they are expecting the outage to last. We are left the in DARK.
Nice going PowerVPS.
Posted by mediagirlnm, 05-29-2013, 08:46 AM @cpartsenidis I completely agree. There is no way this was anything but unplanned.
I'm setting up a new server right now at LiquidWeb myself.
Posted by jrepetto, 05-29-2013, 08:53 AM It is ridiculous that a "cloud" company doesn't have a mirror of their tech support site, email, and sites in general. Very disappointed. Will be moving away from them for sure. I'm assuming it could be a backbone issue to be affecting so many individual nodes.
Posted by spiros, 05-29-2013, 08:54 AM Same problem with me. I can see they have a twitter account https://twitter.com/PowerVPS which has not been posted to since 2011. The Virtacore one https://twitter.com/virtacore mentions nothing. I wonder whether this is the best way to (not) communicate with one's clients in emergency situations?
I have been a client for 6-7 years now, and sadly this is not the first time something like this happens.
Posted by Ulysses, 05-29-2013, 08:57 AM Thanks Anna for the update.
I too think they have a major problem upstream, or their own sites would not be down as well.
Anyone know these people at Virtacore? Maybe woth a direct InMail via LinkedIn?
Posted by mediagirlnm, 05-29-2013, 09:06 AM For what it's worth, I've had people highly recommending LiquidWeb for awhile now because their support/service is solid. I just got off chat with them and they do the migration for you. As soon as my servers are up, I'm starting my moves. Way too much downtime at PowerVPS this year.
Posted by tgraphics, 05-29-2013, 09:07 AM
I'm setting up a new server right now at LiquidWeb myself.
Anyway, I will probably give PowerVPS the benefit of the doubt (one more time) because their support has been amazing the past 7 years. This year has been different, so I'm watching to see if this trend continues. I may just have them migrate stuff from VA to CA data center -- haven't had any problems over there (yet).
Posted by mblendinger, 05-29-2013, 09:09 AM I found various of the support team in google+ and send them messages but still no reply.
Posted by RofyHost, 05-29-2013, 09:10 AM strange unusual from PowerVPS and very disturbing...
Posted by mediagirlnm, 05-29-2013, 09:14 AM I just got off the phone with the sales guy at 888-573-78374. He says they are still working on it. No other info.
I pointed him to this thread and asked him to get an authorized person to update us ASAP here and on Twitter.
Anna
Posted by mediagirlnm, 05-29-2013, 09:23 AM This isn't an option for me either till the server is back up.
After this outage and the recent equipment move outage, I'm not okay explaining to my clients why their email is down. They are angry at me and I'm powerless to fix things for them!Quote:
Posted by mediagirlnm, 05-29-2013, 09:27 AM FYI... This Twitter update just sent from the @Virtacore account:
https://twitter.com/Virtacore/status/339733276178673665
Posted by purpledobster, 05-29-2013, 09:31 AM Just spoke to someone in sales (after support numbers went to voicemail) who assured me it would be back up within the hour and was due to hardware move.
I've been with them about 9 years, and haven't seen such a big outage before.
Posted by mediagirlnm, 05-29-2013, 09:34 AM These kinds of outages make me want to drink at 7:30am!
Posted by stevendbrady, 05-29-2013, 09:35 AM @virtacore is finally responding ... and only saying:
We are currently working on the issue. Will have a status soon. Thank you for your patience.
Posted by andyforkgen, 05-29-2013, 09:36 AM Hi All, thanks for all the updates here - good to know we're not alone! We also had a mail outage today but our mail provider, Cobweb Systems, have a Service Status Page that sits on a completely different network, server and location so it always stays up when everything else is down. It probably costs them less than $50 a month to run.
We also keep all our customers updated via our support site, the homepage of which is fed by a twitter feed with the hashtag #GlobalizeMeStatus - really simple yet effective.
Hopefully PowerVPS wil learn from this - usually their support is excellent but in this case non-existent (perhaps due to system issues) and not backed up by good communication.
Will keep checking this post for the REAL storyCheers all from the UK.
Posted by mblendinger, 05-29-2013, 09:40 AM
10:40am for me
Posted by cpartsenidis, 05-29-2013, 09:52 AM I know this is probably not the best time or thread, but can someone recommend a couple of VPS providers?
Many thanks.
chris.
Posted by mediagirlnm, 05-29-2013, 09:58 AM I've had multiple colleagues suggest liquidweb.com which is where I'm going to be moving. They have 24/7 manned phone/chat/email support and very quick response times from what I've already experienced. I was on chat with Sales in no time and my questions about backup and migration were answered quickly. Quote:
Many thanks.
chris.
Posted by Ulysses, 05-29-2013, 09:59 AM
Many thanks.
chris.
Posted by mediagirlnm, 05-29-2013, 10:02 AM These updates just posted by @virtacore on Twitter:
"We are experiencing issues with our network provider and DNS services as a result. The provider is working on this as a priority issue."
https://twitter.com/Virtacore/status/339742828282400768
------
"We expect to have the network provider issue resolved in the next 45 minutes. But some residual issues may occur after that time."
https://twitter.com/Virtacore/status/339743515963686912
------
"As soon as we have more definitive information, we will post it immediately. Thank you again for your patience."
https://twitter.com/Virtacore/status/339743638709993473
Posted by aww, 05-29-2013, 10:09 AM Confirmed, no site, powervps, virtacore, or deftechgroup.
Cannot reach via 69.65.x.x network or 74.200.x.x network
That move kinda destroyed their network reliability eh?
Posted by mediagirlnm, 05-29-2013, 10:13 AM And this update on Twitter...
"This issue is impacting our inbound phone systems, website and email systems. So our ability to communicate is limited at the moment."
https://twitter.com/Virtacore/status/339745716022951936
Posted by andyforkgen, 05-29-2013, 10:14 AM My services are back up now...how about the rest of you?
Posted by mediagirlnm, 05-29-2013, 10:16 AM My 3 VPS are still down here. Quote:
Posted by zz99, 05-29-2013, 10:16 AM This is not just a DNS issue, I can't get through by IP to my CP either. PowerVPS has a habit of just saying anything to shut people up.
Unfortunately I have had more than one experience like this with them, one lasting days, and I was constantly told a new story until I flipped out on them, threated to come here and tell the story, and suddenly things got fixed.
Posted by zz99, 05-29-2013, 10:19 AM Seriously, hosting your main corporate site in a place that will go down if your client's sites go down seems insane. Suddenly, when you need it most there is no status page, no support tickets, no nothing. Looks like the entire company has vanished. Put your main site on a squarespace site or something.
Posted by AlessioIT, 05-29-2013, 10:29 AM Hello, I'm in the same situation....
I've been with PowerVPS/Defender hosting for over 7 years and this is not the first time something like this happens.
Actually all my sites are still down.... I'm planning to move elsewhere from about 5 or 6 months, now I think I'll do it.
Posted by rick02840, 05-29-2013, 10:29 AM All came back up for me at 10am. Down for 3 hours. If anyone hears what happend would be curious.
Posted by andyforkgen, 05-29-2013, 10:30 AM I use Alertra to constantly monitor our site - they also have a handy spot check utility if ever in doubt. Strangely, their London node is reporting our server as still down but it's visible from elsewhere - I see it though here some 35 miles away in Buckinghamshire. Nodes like Stockholm and even Washington are reporting outage still. Very odd - must be a DNS thing.
Posted by ohmoigowd, 05-29-2013, 10:33 AM well i have just signed up with fasthosts in the UK, rather than a vps i get a dedicated server mirrored drives and much more of everything, even wait for it, someone on the phone ! its also marginally cheaper too in the UK..
I cant believe why any company could not even update within minutes of this outage.. for that reason you have lost a customer who pays you over the odds for the service you provide. I would not reccommend using them for hosting any ecommerce business or anything that you might want to rely on to be up..
There has been 3 major outages for us this year so far, thats 3 too many especially as virtacore claim to have a cloud system for small businesses. What a load of bull%hit.
im backing up and getting out. epic fail on everylevel.. it wont happen again..
im so pi$$ed off its untrue...
Posted by mblendinger, 05-29-2013, 10:33 AM http://www.virtacore.com/network-outage/
Posted by jackkros, 05-29-2013, 10:36 AM
Posted by cpartsenidis, 05-29-2013, 10:41 AM Im in the 74.200 range as well and still offline. We've been in the dark for 3,5 hours now, along with all our clients.
This was no small network outage. God knows what happened.
For what its worth, try performing a traceroute to your server and see what you get back. I see network loops within the 154.54.31.X network, which points me to a major routing issue.
I'm already looking for an alternative provider - I'm out!!
Posted by purpledobster, 05-29-2013, 10:41 AM
I cant believe why any company could not even update within minutes of this outage.. for that reason you have lost a customer who pays you over the odds for the service you provide. I would not reccommend using them for hosting any ecommerce business or anything that you might want to rely on to be up..
There has been 3 major outages for us this year so far, thats 3 too many especially as virtacore claim to have a cloud system for small businesses. What a load of bull%hit.
im backing up and getting out. epic fail on everylevel.. it wont happen again..
im so pi$$ed off its untrue...
Posted by mblendinger, 05-29-2013, 10:42 AM I'm still down too (like 40 VPS offline)
Posted by zz99, 05-29-2013, 10:43 AM I have 2 complete large nodes offline, both with lots of ecommerce sites.
Posted by AlessioIT, 05-29-2013, 10:44 AM
Posted by mediagirlnm, 05-29-2013, 10:44 AM This update on Twitter... but I can't load the URL they are pointing to here in New Mexico:
https://twitter.com/Virtacore/status/339750777868406784
Posted by jackkros, 05-29-2013, 10:47 AM Here is a traceroute to our server. Have a look at where it times out. Most likely the picture for all that are still down:
74.200.89.65 is from United States(US) in region North America
TraceRoute from Network-Tools.com to 74.200.89.**
Hop (ms) (ms) (ms) IP Address Host name
1 1 0 0 8.9.232.73 xe-5-3-0.edge3.dallas1.level3.net
2 1 0 0 4.69.145.133 ae-33-80.car3.dallas1.level3.net
3 3 3 1 4.68.110.110 cogent-comm.car3.dallas1.level3.net
4 2 2 2 154.54.7.45 be2031.ccr21.dfw01.atlas.cogentco.com
5 7 7 7 154.54.0.137 te0-1-1-3.ccr21.iah01.atlas.cogentco.com
6 21 21 20 154.54.42.210 te0-2-0-2.ccr21.atl01.atlas.cogentco.com
7 34 33 34 154.54.28.213 te0-0-0-7.ccr21.dca01.atlas.cogentco.com
8 33 34 34 154.54.1.118 te0-3-0-7.ccr21.iad02.atlas.cogentco.com
9 Timed out Timed out Timed out -
10 39 Timed out Timed out 154.54.31.221 te0-0-0-6.ccr21.iad02.atlas.cogentco.com
11 Timed out Timed out Timed out -
12 Timed out 33 Timed out 154.54.31.221 te0-0-0-6.ccr21.iad02.atlas.cogentco.com
13 Timed out Timed out Timed out -
14 40 33 33 154.54.31.221 te0-0-0-6.ccr21.iad02.atlas.cogentco.com
15 Timed out Timed out Timed out -
16 Timed out 46 40 154.54.31.221 te0-0-0-6.ccr21.iad02.atlas.cogentco.com
17 Timed out Timed out Timed out -
18 Timed out Timed out 37 154.54.31.221 te0-0-0-6.ccr21.iad02.atlas.cogentco.com
19 Timed out Timed out Timed out -
20 Timed out Timed out Timed out -
21 Timed out Timed out Timed out -
22 Timed out 33 33 154.54.31.221 te0-0-0-6.ccr21.iad02.atlas.cogentco.com
23 Timed out Timed out Timed out -
24 33 33 33 154.54.31.221 te0-0-0-6.ccr21.iad02.atlas.cogentco.com
25 Timed out Timed out Timed out -
26 Timed out Timed out Timed out -
27 Timed out 37 Timed out 154.54.31.222 te1-6.ccr01.iad01.atlas.cogentco.com
28 Timed out 33 Timed out 154.54.31.221 te0-0-0-6.ccr21.iad02.atlas.cogentco.com
Trace complete
Posted by mblendinger, 05-29-2013, 10:48 AM his url point to this notice: Quote:
«
29 May 13
Network Outage
Update: 5/29/2013 – 10:22 AM Eastern Standard Time
This morning between 6 AM and 7 AM Virtacore experienced an issue with our network provider and DNS services. As a result some of our customers experienced trouble with access to hosting environments. The systems and data were not impacted by this issue. All systems and data were up during the period of the issue.
During the network outage we had issues with our own phone, email and website systems. As a result Virtacore had a limited ability to communicate with customers.
Our technical team is working with our network provider to completely correct the issue, and prevent this from occurring again.
As soon as we have more information, we will be contacting our customers directly.
We apologize for any inconvenience this may have caused to our existing customers.
Thank you for your patience.
Virtacore
Posted by cpartsenidis, 05-29-2013, 10:53 AM mblendinger, you have 40 VPSs down at the moment? My God, and I thought having 3 VPSs down was a nightmare!
Posted by mediagirlnm, 05-29-2013, 10:54 AM Amen! This would be so much easier if it was "our" server and not those of clients. Quote:
Posted by cpartsenidis, 05-29-2013, 10:56 AM purpledobster, Fasthosts seems a good alternative, but I don't see them offering Cpanel - which is a pity as I am a Cpanel fan
Posted by mblendinger, 05-29-2013, 10:58 AM
But I have email services and dns service setup in other different providers so I'M ABLE TO COMUNICATE WITH MY OWN CUSTOMERS
Posted by jackkros, 05-29-2013, 11:04 AM
But I have email services and dns service setup in other different providers so I'M ABLE TO COMUNICATE WITH MY OWN CUSTOMERS
So it appears that Defenderhosting clients are more important than PowerVPS I don't know if to laugh or cry cuz I'm on PowerVPS
Posted by ohmoigowd, 05-29-2013, 11:05 AM
Virtacore boast disaster recovery, the first thing i would suggest is that the communicate with your customers by any means necessary, they should have this in place already within minutes, text, sms, secondary email... where is there DR ??? what a load of toss.... Have they not been able to log onto facebook for 3 years? or twitter for 12 months?. No forum, no nothing, it is no longer the company that it was, but outsourced the chaps in India..
5 years ago i was very happy with powervps, over the last 12 months i havent been, there are better offers out there and they have lost me some business today which i cannot afford and they do not respond..
I signed up for a dedicated server with fasthosts with twice the resources of the vps.. Powervps have not moved forward, failed on all levels here, this outage is the last one for me with powervps..
put it this way, if virtacore or powervps were within 200 miles of me right now, they would be able to feel my rage...
Posted by slowmail, 05-29-2013, 11:20 AM My VPS were down from 3AM to 7AM PST, and they just fell over again (8.15AM).
After their last (sudden) relocation, they left my VPS in the stopped state without starting it back up. I was away at that time with no reliable internet access - it wasn't till 3 days later that I was able to get online and hit 'start vps' on my VZPP panel.
I left them a ticket about it (#KDU-979978), but they simply deleted it.
At this time, I'd like to move. =(
Posted by tgraphics, 05-29-2013, 11:23 AM
But I have email services and dns service setup in other different providers so I'M ABLE TO COMUNICATE WITH MY OWN CUSTOMERS
How much better is it to have email hosted separately? It sounds good, but more servers = more points of failure. I suppose it depends more on the specific needs of each client though.
Posted by mblendinger, 05-29-2013, 11:27 AM google apps for email prove me in various years to be very trustee.
no matter if the server goes down, as I have dns for my main business domain hosted with an external dns service provider, I still can access directly to google apps to check the email accounts and reply my customers, and all the emails with @mydomain are still fully operative. Facebook too, so my clients are not in the dark like here.
Posted by jackkros, 05-29-2013, 11:34 AM For those who are wondering what your clients see when sending you an email. They are getting bounces with server not reachable. The messages are not even staying in queue which is horrible...FUC&^*%*%
Posted by AlessioIT, 05-29-2013, 11:43 AM Probably today I've lost a good client ... this is the second time in few months and he's very disappointed. I really hope to hear something from PowerVps, I haven't received any comunication, any ETA..nothing
Posted by andyforkgen, 05-29-2013, 11:44 AM It's for these exact reasons that I have next-to-no clients (including ourselves) on apache-based email services now. Add to that the recent spate of Wordpress hacks causing all sorts of blacklisting and other issues, this makes email hosted on web servers a complete no-no for anyone serious about maintaining business continuity.
In order of preference, we're helping clients to migrate to:
1) Microsoft hosted email (365)
2) 123-reg's own mail services
3) Google apps
All very reliable and mainly depends on what the customer wants - ranges from £1-3 per month per mailbox, less than a Latte
We are currently on Cobweb hosted exchange but will probably move to 365 soon.
Posted by jackkros, 05-29-2013, 11:51 AM
Posted by tgraphics, 05-29-2013, 12:00 PM
no matter if the server goes down, as I have dns for my main business domain hosted with an external dns service provider, I still can access directly to google apps to check the email accounts and reply my customers, and all the emails with @mydomain are still fully operative. Facebook too, so my clients are not in the dark like here.
Posted by zz99, 05-29-2013, 12:03 PM
I literally had a node down for 9 days at one point, and every time I asked the answer was "shortly".
I am switching my accounts today, after many years with them, it is just too lackadaisical for the premium I pay them.
google "powervps down 9 days" to see blog posts and threads about the massive downtime last year.
Posted by Wolf1, 05-29-2013, 12:07 PM I am really frustrated. I have been with these guys for almost 8 years, and until the last few months, they have been great. But this multi day outage a month or 2 back, then move a week later that took everything down again during normal business hours here in the US, and now this outage.
Communication is horrible from these guys when they are down. The outage a couple of months ago, they had nobody staffing the online chat.
I really don't want to move everything, have IP addresses re white-listed and all the other crap associated with it, but this is bunk.
Is there no redundancy in the DNS set up if the problem is as they explain? Can't they reroute and point to a new DNS quickly? I know they have more than 1 network provider connecting them (or they should)
"Some of our customers are still experiencing issues. (Everyone in Ashburn/Sterling!) We are working with the network provider to find out why this issue is causing additional problems. Our technicians have identified this as a routing issue with the network provider. (Only 1 network provider into the NOC? Really? And they can't reroute?)
Our network provider has not given us a definitive time window of when they will be able to resolve this yet. We are waiting on additional information from them about the nature and depth of the problem and how to resolve it."
Is their new NOC in Bob's basement in Sterling or Ashburn with a single Verizon FIOS line? WTF?
This is a joke. Ever since Kiblin sold, it seems to have gone in the crapper.
Posted by stevendbrady, 05-29-2013, 12:08 PM I'm back up! On a 74.200 IP.
Posted by andyforkgen, 05-29-2013, 12:11 PM
Posted by mblendinger, 05-29-2013, 12:14 PM not here... 74.200* too
Posted by purpledobster, 05-29-2013, 12:18 PM back up (but slow) on 74.200. IP
Posted by andyforkgen, 05-29-2013, 12:18 PM It's still very geographical for me - and not region based either, I am on a 74.200 IP too. LA and Orlando are down for example, Chicago okay. Intermittent results in Asia and Europe. All very odd.
Alertra copy-and-paste below....
Response Location Result Time DNS Con TTFB kB Mbit/S
Response > London GBR Error 0.21 0.14 0.08 n/a 0.1 n/a
Response > Los Angeles USA Error 0.37 0.31 0.06 n/a 0.2 n/a
Response > Orlando USA Error 0.51 0.46 0.04 n/a 0.1 n/a
Response > Chicago USA OK 0.83 0.41 0.04 0.33 22.8 3.2
Response > Stockholm SWE OK 0.95 0.00 0.21 0.41 22.8 0.6
Response > Washington, D.C. USA Error 1.03 0.00 1.03 n/a 0.1 n/a
Response > Hong Kong CHN OK 2.10 0.62 0.46 0.54 22.8 0.4
Response > Shanghai CHN OK 2.88 0.41 0.85 0.76 22.8 0.2
Response > Rotterdam NLD Error 7.09 0.00 7.09 n/a 0.1 n/a
Posted by Virtacore, 05-29-2013, 12:19 PM We are still working with our network provider to resolve the issue. There is no threat to data or existing systems. This is strictly a routing problem that one of our network providers is having but is impacting customers on all of our networks.
Here is the latest update that we posted on our website. We will post updates on this thread, on twitter and our website as we have them.
--------------------------------------
Update: 5/29/2013 - 11:33 AM Eastern Standard Time
New Information:
Some of our customers are still experiencing issues. We are working with the network provider to find out why this issue is causing additional problems. Our technicians have identified this as a routing issue with the network provider.
Our network provider has not given us a definitive time window of when they will be able to resolve this yet. We are waiting on additional information from them about the nature and depth of the problem and how to resolve it.
Previous Post (10:22 AM):
-----------------------------
This morning between 6 AM and 7 AM Virtacore experienced an issue with our network provider and DNS services. As a result some of our customers experienced trouble with access to hosting environments. The systems and data were not impacted by this issue. All systems and data were up during the period of the issue.
During the network outage we had issues with our own phone, email and website systems. As a result Virtacore had a limited ability to communicate with customers.
Our technical team is working with our network provider to completely correct the issue, and prevent this from occurring again.
As soon as we have more information, we will be contacting our customers directly.
We apologize for any inconvenience this may have caused to our existing customers.
Thank you for your patience.
Virtacore
Posted by aww, 05-29-2013, 12:22 PM Looks like we are back.
Posted by Wolf1, 05-29-2013, 12:24 PM I am not back.... 74.200. IP here...
I think I am on Node 7 or something....
Posted by AlessioIT, 05-29-2013, 12:25 PM 74.204. and 74.200. ip range still down.
Posted by tgraphics, 05-29-2013, 12:26 PM 74.200.* Some websites are up, but others are still down (same VPS).
Posted by jackkros, 05-29-2013, 12:26 PM
Posted by TomK, 05-29-2013, 12:31 PM
This is a joke. Ever since Kiblin sold, it seems to have gone in the crapper.
Wolf1, do I know you? PM or email me.
Also, for the messages I have received - I haven't been with the company in a long time; I wish there was something I could do to help everyone out, but I do not know the technical team running things now, sorry.
Tom
Posted by andyforkgen, 05-29-2013, 12:31 PM Still a bit patchy according to Alertra - but it seems to be getting better!
Response Location Result Time DNS Con TTFB kB Mbit/S
Response > Washington, D.C. USA Error 0.01 0.00 0.00 n/a 0.1 n/a
Response > Rotterdam NLD Error 0.10 0.00 0.10 n/a 0.1 n/a
Response > Strasbourg FRA Error 0.41 0.31 0.10 n/a 0.5 n/a
Response > Las Vegas USA Error 0.63 0.56 0.08 n/a 0.1 n/a
Response > Orlando USA Error 0.71 0.67 0.04 n/a 0.1 n/a
Response > Chicago USA OK 0.74 0.33 0.04 0.33 23.2 4.9
Response > Stockholm SWE OK 0.84 0.00 0.21 0.41 22.8 0.9
Response > Los Angeles USA OK 0.99 0.37 0.13 0.37 22.9 1.5
Response > Hong Kong CHN OK 1.81 0.34 0.46 0.53 23.0 0.4
Response > Shanghai CHN OK 6.57 1.07 3.89 0.74 23.0 0.2
Posted by marked, 05-29-2013, 12:32 PM I agree, I've been down all morning as well (along with all of my clients). When they did the server move a few months back they took down dns then as well! during east coast business hours. How was dns not being replicated on a server they could keep up until all of their network equipment was up at the new datacenter? They keep touting "no data loss, everything will be intact" they really don't seem to understand they many people host dns at the cpanel/whm/hosting level and when it goes down email stops flowing in a normal way.
Posted by aww, 05-29-2013, 12:39 PM Yeah I've noticed not all my servers can yet ping my powervps.
So it's definitely not 100% solved.
Posted by dcsit, 05-29-2013, 12:41 PM This really sucks and loath not being able to talk to someone with information about the issue. All of our servers have been unreachable for almost 6 hours now!!!!
I've at least being given a little more info from thier team...
I'm told that they are working with their upstream data provider to diagnose the issue. They think that this is all caused by a routing issue and are pointing fingers at Cogent. I'm assuming this means that it is possibly routing or BGP.
My traceroute results seem to support that claim. My upstream brings me directly to cogent after 5 hops and them just seems to bounce around in their 154.54.31.0/24 network until I cancel it. Can anyone else confirm this?6 te0-0-0-16.ccr21.jfk04.atlas.cogentco.com (38.104.73.237) 5.523 ms 5.553 ms 5.563 ms
7 te0-6-0-5.ccr21.jfk02.atlas.cogentco.com (154.54.47.21) 5.785 ms
te0-6-0-0.ccr21.jfk02.atlas.cogentco.com (154.54.47.17) 5.728 ms 5.823 ms
8 te0-3-0-6.ccr21.dca01.atlas.cogentco.com (154.54.41.5) 12.276 ms
te0-2-0-7.ccr21.dca01.atlas.cogentco.com (154.54.41.1) 12.954 ms
te0-0-0-2.ccr21.dca01.atlas.cogentco.com (154.54.25.238) 12.309 ms
9 te0-3-0-7.ccr21.iad02.atlas.cogentco.com (154.54.1.118) 13.244 ms
te0-0-0-2.ccr21.iad02.atlas.cogentco.com (154.54.1.42) 13.000 ms
te0-3-0-5.ccr21.iad02.atlas.cogentco.com (154.54.41.230) 14.023 ms
10 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 13.284 ms
te0-0-0-0.ccr22.iad02.atlas.cogentco.com (154.54.31.86) 13.173 ms
te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 17.750 ms
11 te0-1-0-6.ccr21.iad02.atlas.cogentco.com (154.54.31.225) 20.309 ms * *
12 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 13.533 ms
te0-0-1-2.ccr22.iad02.atlas.cogentco.com (154.54.31.193) 13.138 ms
te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 14.105 ms
13 te0-1-0-6.ccr21.iad02.atlas.cogentco.com (154.54.31.225) 13.173 ms
te0-0-0-4.ccr21.iad02.atlas.cogentco.com (154.54.31.105) 13.412 ms
te0-1-0-6.ccr21.iad02.atlas.cogentco.com (154.54.31.225) 13.277 ms
14 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 16.349 ms
te0-0-0-0.ccr22.iad02.atlas.cogentco.com (154.54.31.86) 13.475 ms
te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 27.520 ms
15 te0-1-0-6.ccr21.iad02.atlas.cogentco.com (154.54.31.225) 13.245 ms * 14.907 ms
16 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 13.224 ms *
te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 13.407 ms
17 te0-1-0-6.ccr21.iad02.atlas.cogentco.com (154.54.31.225) 13.201 ms * 15.288 ms
18 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 15.942 ms
te0-0-0-0.ccr22.iad02.atlas.cogentco.com (154.54.31.86) 13.314 ms
te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 13.549 ms
19 * * te0-1-0-6.ccr21.iad02.atlas.cogentco.com (154.54.31.225) 15.279 ms
20 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 16.832 ms
te0-0-0-6.mpd22.iad02.atlas.cogentco.com (154.54.31.173) 19.298 ms
te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 19.567 ms
21 te0-1-0-6.ccr21.iad02.atlas.cogentco.com (154.54.31.225) 16.179 ms
te0-0-0-4.ccr21.iad02.atlas.cogentco.com (154.54.31.105) 112.798 ms
te0-1-0-6.ccr21.iad02.atlas.cogentco.com (154.54.31.225) 13.399 ms
22 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 13.463 ms
te0-0-0-0.ccr22.iad02.atlas.cogentco.com (154.54.31.86) 13.526 ms
te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 13.314 ms
23 * * te0-1-0-6.ccr21.iad02.atlas.cogentco.com (154.54.31.225) 13.454 ms
24 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 13.528 ms
te0-0-0-6.mpd22.iad02.atlas.cogentco.com (154.54.31.173) 13.637 ms
te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 42.339 ms
25 te0-1-0-6.ccr21.iad02.atlas.cogentco.com (154.54.31.225) 14.523 ms * 13.562 ms
26 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 13.353 ms
te0-0-0-0.ccr22.iad02.atlas.cogentco.com (154.54.31.86) 17.635 ms
te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 13.538 ms
27 * * te0-1-0-6.ccr21.iad02.atlas.cogentco.com (154.54.31.225) 13.489 ms
28 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 13.404 ms
te0-1-0-6.ccr22.iad02.atlas.cogentco.com (154.54.31.233) 63.945 ms
te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 13.786 ms
29 * * te0-1-0-6.ccr21.iad02.atlas.cogentco.com (154.54.31.225) 16.941 ms
30 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 17.923 ms
te0-0-1-2.ccr22.iad02.atlas.cogentco.com (154.54.31.193) 14.245 ms
te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 13.755 ms
31 * * *
32 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 13.672 ms
te0-0-0-6.mpd22.iad02.atlas.cogentco.com (154.54.31.173) 13.457 ms
te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 16.248 ms
33 te0-1-0-6.ccr21.iad02.atlas.cogentco.com (154.54.31.225) 20.811 ms * 13.617 ms
34 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 13.685 ms
te0-0-0-0.ccr22.iad02.atlas.cogentco.com (154.54.31.86) 13.678 ms
te0-0-1-2.ccr22.iad02.atlas.cogentco.com (154.54.31.193) 14.364 ms
35 te0-0-0-4.ccr21.iad02.atlas.cogentco.com (154.54.31.105) 13.717 ms * *
36 * te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 13.651 ms
te0-0-1-2.ccr22.iad02.atlas.cogentco.com (154.54.31.193) 13.725 ms
37 te0-2-0-0.ccr21.iad02.atlas.cogentco.com (154.54.31.101) 13.675 ms * *
38 * te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 16.581 ms
te0-0-0-0.ccr22.iad02.atlas.cogentco.com (154.54.31.86) 13.766 ms
39 te0-2-0-0.ccr21.iad02.atlas.cogentco.com (154.54.31.101) 15.970 ms
te0-1-0-6.ccr21.iad02.atlas.cogentco.com (154.54.31.225) 19.314 ms *
40 * * te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 14.257 ms
41 * * *
42 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 13.706 ms
te0-0-0-0.ccr22.iad02.atlas.cogentco.com (154.54.31.86) 13.932 ms
te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 13.672 ms
43 te0-1-0-6.ccr21.iad02.atlas.cogentco.com (154.54.31.225) 15.270 ms * *
44 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 15.970 ms
te0-1-0-6.mpd22.iad02.atlas.cogentco.com (154.54.31.213) 14.342 ms
te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 15.155 ms
45 te0-1-0-6.ccr21.iad02.atlas.cogentco.com (154.54.31.225) 14.721 ms * *
46 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 13.870 ms
te0-0-0-0.ccr22.iad02.atlas.cogentco.com (154.54.31.86) 13.958 ms
te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 13.873 ms
47 te0-1-0-6.ccr21.iad02.atlas.cogentco.com (154.54.31.225) 13.935 ms * 15.384 ms
48 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 16.818 ms
te0-1-0-6.mpd22.iad02.atlas.cogentco.com (154.54.31.213) 13.819 ms
te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 15.633 ms
49 * te0-0-0-4.ccr21.iad02.atlas.cogentco.com (154.54.31.105) 14.065 ms
te0-1-0-6.ccr21.iad02.atlas.cogentco.com (154.54.31.225) 14.025 ms
50 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 13.940 ms
te0-0-1-2.ccr22.iad02.atlas.cogentco.com (154.54.31.193) 14.963 ms
te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 15.621 ms
51 te0-1-0-6.ccr21.iad02.atlas.cogentco.com (154.54.31.225) 15.398 ms * 14.033 ms
52 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 14.108 ms *
te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 14.173 ms
53 te0-1-0-6.ccr21.iad02.atlas.cogentco.com (154.54.31.225) 13.970 ms 16.484 ms *
54 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 14.136 ms
te0-1-0-6.ccr22.iad02.atlas.cogentco.com (154.54.31.233) 15.090 ms
te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 14.021 ms
55 * * *
56 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 17.156 ms
te0-1-0-6.ccr22.iad02.atlas.cogentco.com (154.54.31.233) 18.352 ms
te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 33.269 ms
57 * * te0-1-0-6.ccr21.iad02.atlas.cogentco.com (154.54.31.225) 14.389 ms
58 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 14.052 ms
te0-0-0-0.ccr22.iad02.atlas.cogentco.com (154.54.31.86) 14.058 ms
te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 14.222 ms
59 te0-1-0-6.ccr21.iad02.atlas.cogentco.com (154.54.31.225) 14.230 ms * 14.211 ms
60 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 14.181 ms
te0-0-0-6.mpd22.iad02.atlas.cogentco.com (154.54.31.173) 14.059 ms
te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 14.130 ms
61 * * *
62 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 16.732 ms
te0-0-0-0.ccr22.iad02.atlas.cogentco.com (154.54.31.86) 14.284 ms
te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 14.084 ms
63 te0-1-0-6.ccr21.iad02.atlas.cogentco.com (154.54.31.225) 14.289 ms * *
64 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 14.389 ms *
te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 14.306 ms
Posted by Wolf1, 05-29-2013, 12:44 PM
Wolf1, do I know you? PM or email me.
Also, for the messages I have received - I haven't been with the company in a long time; I wish there was something I could do to help everyone out, but I do not know the technical team running things now, sorry.
Tom
We emailed a bit and talked on the phone a few times when I set up my account originally over at PowerVPS / Defender almost 8 years ago. I was originally dealing with Petersen @ MyriadNetwork and you helped me out.
Can't PM you yet as I had to make a new account here, because I did not remember my password for my old account, and the password reminder was going to my email on my PowerVPS server.
Thanks!
Posted by marked, 05-29-2013, 12:45 PM There should be redundancy here, this should not happen when one provider goes down. Correct me if I'm wrong, but isn't our DNS propagating as "gone" this will take more time to get it back? I can see at a few client sites using different dns providers for ISP (google, comcast, opendns) that different things are loading. I can live with websites being down but all information about domain is GONE as far as the rest of the internet is concerned.
Posted by jackkros, 05-29-2013, 12:48 PM
I've at least being given a little more info from thier team...
I'm told that they are working with their upstream data provider to diagnose the issue. They think that this is all caused by a routing issue and are pointing fingers at Cogent. I'm assuming this means that it is possibly routing or BGP.
My traceroute results seem to support that claim. My upstream brings me directly to cogent after 5 hops and them just seems to bounce around in their 154.54.31.0/24 network until I cancel it. Can anyone else confirm this?6 te0-0-0-16.ccr21.jfk04.atlas.cogentco.com (38.104.73.237) 5.523 ms 5.553 ms 5.563 ms
7 te0-6-0-5.ccr21.jfk02.atlas.cogentco.com (154.54.47.21) 5.785 ms
te0-6-0-0.ccr21.jfk02.atlas.cogentco.com (154.54.47.17) 5.728 ms 5.823 ms
8 te0-3-0-6.ccr21.dca01.atlas.cogentco.com (154.54.41.5) 12.276 ms
te0-2-0-7.ccr21.dca01.atlas.cogentco.com (154.54.41.1) 12.954 ms
te0-0-0-2.ccr21.dca01.atlas.cogentco.com (154.54.25.238) 12.309 ms
SHORTENED
61 * * *
62 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 16.732 ms
te0-0-0-0.ccr22.iad02.atlas.cogentco.com (154.54.31.86) 14.284 ms
te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 14.084 ms
63 te0-1-0-6.ccr21.iad02.atlas.cogentco.com (154.54.31.225) 14.289 ms * *
64 te0-0-0-4.mpd22.iad02.atlas.cogentco.com (154.54.31.106) 14.389 ms *
te0-2-0-0.mpd22.iad02.atlas.cogentco.com (154.54.31.102) 14.306 ms
Yes the same here
Posted by jackkros, 05-29-2013, 12:51 PM
Posted by Garrymc, 05-29-2013, 12:52 PM Yeah I can now also access my sites from some ip addresses but not my own.
Posted by spiros, 05-29-2013, 12:56 PM What really upsets me is the effect this would have to one's rankings and to clients' rankings (or other possible damages due to non access to e-mail accounts and sites), and the fact that nobody takes the responsibility for this one way or another. At the end of the day, we have to accept the fact and pay the same hosting fees despite the prolonged outage. And this is not the first time. Does this sound fair to you?
Posted by Myopinion, 05-29-2013, 12:56 PM my vps still down
Posted by dcsit, 05-29-2013, 12:58 PM It's pretty obvious that this isn't DNS. They just happen to thing such as their help desk and other services in the network as our services.
After and during the last outage I took time to make tertiary for important domains with primary DNS services on PVPS hosted servers. This is the only thing saving me from pissing off several important customers that have other services and on premises server infrastructure that depend on the domains.
If you are CPanel's default configuration for DNS you likely have zero redundancy. If you're using some virtacore/pvps DNS server that I'm unaware of, I'd hope they have some kind of redundancy but I would be surprised if they didn't. DNS is often neglected even in large/important networks.Quote:
Communication is horrible from these guys when they are down. The outage a couple of months ago, they had nobody staffing the online chat.
I really don't want to move everything, have IP addresses re white-listed and all the other crap associated with it, but this is bunk.
Is there no redundancy in the DNS set up if the problem is as they explain? Can't they reroute and point to a new DNS quickly? I know they have more than 1 network provider connecting them (or they should)
"Some of our customers are still experiencing issues. (Everyone in Ashburn/Sterling!) We are working with the network provider to find out why this issue is causing additional problems. Our technicians have identified this as a routing issue with the network provider. (Only 1 network provider into the NOC? Really? And they can't reroute?)
Our network provider has not given us a definitive time window of when they will be able to resolve this yet. We are waiting on additional information from them about the nature and depth of the problem and how to resolve it."
Is their new NOC in Bob's basement in Sterling or Ashburn with a single Verizon FIOS line? WTF?
This is a joke. Ever since Kiblin sold, it seems to have gone in the crapper.
Posted by Aeronautic, 05-29-2013, 01:03 PM I'm much more of a filmmaker than computer science major so I'm at a loss to understand how their network (I'm down too folks) could not have redundant DNS.
Like the others who posted on the first couple of pages, I've been with them a very long time. I remember Rob's excellent support.
This event, coming after the short notice middle of the North American business day migration a month or so ago really makes me worry about the health of the company.
Can anyone explain why this single point of failure is taking so many of us out?
I've traced both my domains (nada) and IPs (sketchy). Not understanding this at all.
Posted by marked, 05-29-2013, 01:08 PM The bottom line is, it shouldn't be up to us to build DNS redundancy into this equation. I could setup my own server, host all the domains and build everything from scratch but I'm paying them so I don't have to. I should have known better after the last move though. They probably had a hardware failure at the ONE provider servicing their area of the datacenter and it completely took them and all their clients (us) down. If they had more than one pipe and redundant dns it might be mitigated by just taking some sites offline or individual servers, not the "brain" of their operation that tells everyone and everything how to find our domains.
Posted by slowmail, 05-29-2013, 01:11 PM I use my registrar's DNS servers, so this outage wasn't just due to DNS falling over.
As others have mentioned, GoogleApps has been fantastic for emails. Prior to that, I was using ZoneEdit's BackupMX and Tertiary DNS services.
Posted by Virtacore, 05-29-2013, 01:12 PM Update: 5/29/2013 - 12:59 PM Eastern Standard Time
We apologize for the continuing issue with our network. We have learned that our network provider is currently trying to solve a problem with the routes looping in their network. We have raised this issue to the highest level of escalation with the company and they have informed us that they are working aggressively on the issue. This is causing connectivity issues for some of our clients, intermittent issues for others and some customers are not experiencing issues at all.
Unfortunately, our network provider has not given us a firm time frame of when we can expect a resolution. We are looking into our redundant providers to minimize, and potentially eliminate, the problem as we continue to wait for the network provider.
Again, we would like to underscore the fact that the data and systems are in no way compromised or impacted by this issue.
As soon as we have more information we will post it immediately.
Previous Post (11:33 AM):
-----------------------------
Some of our customers are still experiencing issues. We are working with the network provider to find out why this issue is causing additional problems. Our technicians have identified this as a routing issue with the network provider.
Our network provider has not given us a definitive time window of when they will be able to resolve this yet. We are waiting on additional information from them about the nature and depth of the problem and how to resolve it.
Previous Post (10:22 AM):
-----------------------------
This morning between 6 AM and 7 AM Virtacore experienced an issue with our network provider and DNS services. As a result some of our customers experienced trouble with access to hosting environments. The systems and data were not impacted by this issue. All systems and data were up during the period of the issue.
During the network outage we had issues with our own phone, email and website systems. As a result Virtacore had a limited ability to communicate with customers.
Our technical team is working with our network provider to completely correct the issue, and prevent this from occurring again.
As soon as we have more information, we will be contacting our customers directly.
We apologize for any inconvenience this may have caused to our existing customers.
Thank you for your patience.
Virtacore
Posted by webcomke, 05-29-2013, 01:12 PM What are some recommendations for another provider? Ive been wanting to move for a while, in fact last week I suspended my auto-bill so I can move and not get billed for two servers. I have my own ideas but Im open to suggestions...I pay way too much for my service with PowerVPS/Virtacore to deal with this kind of insanity. I know for a fact I could have a dedicated server for the cost of my service with them, shame on me for not wanting to deal with migration.
My margins are already tight with my hosting service and Im sure this outage will send more clients packing to greener pastures, they've put up with me putting up with PowerVPS long enough. And yes, that mid-day migration was super-fishy! WTF?? Its gotten bad with these guys, time to move on.
Posted by Wolf1, 05-29-2013, 01:13 PM
We apologize for the continuing issue with our network. We have learned that our network provider is currently trying to solve a problem with the routes looping in their network. We have raised this issue to the highest level of escalation with the company and they have informed us that they are working aggressively on the issue. This is causing connectivity issues for some of our clients, intermittent issues for others and some customers are not experiencing issues at all.
Unfortunately, our network provider has not given us a firm time frame of when we can expect a resolution. We are looking into our redundant providers to minimize, and potentially eliminate, the problem as we continue to wait for the network provider.
Again, we would like to underscore the fact that the data and systems are in no way compromised or impacted by this issue.
As soon as we have more information we will post it immediately.
Posted by marked, 05-29-2013, 01:14 PM I don't think this is just a dns issue either, but if their ONE dns server goes offline (for whatever reason) it seems to take everything down. IN the same way I replicate active directory to multiple servers on a LAN in case one goes down - the rest of the company will still be able to login to the network/domain.
Posted by Aeronautic, 05-29-2013, 01:15 PM Excerpt from another update on their news blog: Redundant? Right.Quote:
Unfortunately, our network provider has not given us a firm time frame of when we can expect a resolution. We are looking into our redundant providers to minimize, and potentially eliminate, the problem as we continue to wait for the network provider.
Posted by Wolf1, 05-29-2013, 01:17 PM
Posted by marked, 05-29-2013, 01:19 PM
We apologize for the continuing issue with our network. We have learned that our network provider is currently trying to solve a problem with the routes looping in their network. We have raised this issue to the highest level of escalation with the company and they have informed us that they are working aggressively on the issue. This is causing connectivity issues for some of our clients, intermittent issues for others and some customers are not experiencing issues at all.
Unfortunately, our network provider has not given us a firm time frame of when we can expect a resolution. We are looking into our redundant providers to minimize, and potentially eliminate, the problem as we continue to wait for the network provider.
Again, we would like to underscore the fact that the data and systems are in no way compromised or impacted by this issue.
As soon as we have more information we will post it immediately.
Previous Post (11:33 AM):
-----------------------------
Some of our customers are still experiencing issues. We are working with the network provider to find out why this issue is causing additional problems. Our technicians have identified this as a routing issue with the network provider.
Our network provider has not given us a definitive time window of when they will be able to resolve this yet. We are waiting on additional information from them about the nature and depth of the problem and how to resolve it.
Previous Post (10:22 AM):
-----------------------------
This morning between 6 AM and 7 AM Virtacore experienced an issue with our network provider and DNS services. As a result some of our customers experienced trouble with access to hosting environments. The systems and data were not impacted by this issue. All systems and data were up during the period of the issue.
During the network outage we had issues with our own phone, email and website systems. As a result Virtacore had a limited ability to communicate with customers.
Our technical team is working with our network provider to completely correct the issue, and prevent this from occurring again.
As soon as we have more information, we will be contacting our customers directly.
We apologize for any inconvenience this may have caused to our existing customers.
Thank you for your patience.
Virtacore
Posted by Aeronautic, 05-29-2013, 01:21 PM
I'm a US customer hosting in a US data center. I want my site up during my biz day. No sale on that line of nonsense to me either. Who did they think they were fooling? Glad I was part of a chorus, not a solo, on that one. Bet they are not happy we are discussing all of this now. Time for their act to clean the heck up.
Posted by dm-9, 05-29-2013, 01:26 PM
Thanks.
Posted by bern1, 05-29-2013, 01:31 PM This is the 5th time Virtacore/PowerVPS are down this year.
It looks like the company hired inexperienced network engineers or the good people left the company.
No serious hosting company goes down for a total of 23 hrs (and counting) in 3 months. Network redundancy should have been in place quite a while ago.
Posted by AlessioIT, 05-29-2013, 01:31 PM
Thanks.
Posted by marked, 05-29-2013, 01:32 PM I'm hearing good things about liquidweb and they will help with the migration..anybody know of them?
Posted by marked, 05-29-2013, 01:36 PM Also, I wonder if we could all approach one company as a group and get better pricing? hmmm
Posted by mediagirlnm, 05-29-2013, 01:37 PM This is where I'm moving. I have several web developer colleagues who highly recommend them for managed VPS. They say their support is great which in the end is what is most important to me. They will help with the migration as well. Quote:
Posted by jackkros, 05-29-2013, 01:38 PM Before I make a move to another host I think I will do what others have suggested. Move email to Google, have the DNS at the registrar and then I will look for an alternative.
Ok so now it's 1:40 p.m. most of the workday is gone, I have no idea how many people have tried to email me or what is happening. This is a cluster **** if I ever saw one.
Posted by marked, 05-29-2013, 01:39 PM
Posted by Myopinion, 05-29-2013, 01:42 PM How much time remains until servers back to work We are tired of waiting This downtime will negatively affects sites and rank seo ...etc
Posted by marked, 05-29-2013, 01:42 PM
Ok so now it's 1:40 p.m. most of the workday is gone, I have no idea how many people have tried to email me or what is happening. This is a cluster **** if I ever saw one.
Posted by mediagirlnm, 05-29-2013, 01:46 PM Yeah, I'm @mediagirl on Twitter. 3 servers still down. Quote:
Posted by mediagirlnm, 05-29-2013, 01:50 PM So I contacted LiquidWeb to see if they had any promotions... they don't.
Posted by Virtacore, 05-29-2013, 01:51 PM Update: 5/29/2013 - 1:47 PM Eastern Standard Time
We are still working on the issue. We have been asked about our redundant network providers. Our redundant network providers are currently functioning without problems. Which explains why we have many of our customers functioning without issues. Unfortunately, we are having difficulties separating the traffic currently routed through that provider. So we are working on ways to fix the situation independent of the network provider trying to resolve the issue.
We will keep you posted on time frames as soon as we provide one with certainty.
We apologize for any troubles this has caused our customers.
Previous Post (12:59 PM):
----------------------------
We apologize for the continuing issue with our network. We have learned that our network provider is currently trying to solve a problem with the routes looping in their network. We have raised this issue to the highest level of escalation with the company and they have informed us that they are working aggressively on the issue. This is causing connectivity issues for some of our clients, intermittent issues for others and some customers are not experiencing issues at all.
Unfortunately, our network provider has not given us a firm time frame of when we can expect a resolution. We are looking into our redundant providers to minimize, and potentially eliminate, the problem as we continue to wait for the network provider.
Again, we would like to underscore the fact that the data and systems are in no way compromised or impacted by this issue.
As soon as we have more information we will post it immediately.
Previous Post (11:33 AM):
-----------------------------
Some of our customers are still experiencing issues. We are working with the network provider to find out why this issue is causing additional problems. Our technicians have identified this as a routing issue with the network provider.
Our network provider has not given us a definitive time window of when they will be able to resolve this yet. We are waiting on additional information from them about the nature and depth of the problem and how to resolve it.
Previous Post (10:22 AM):
-----------------------------
This morning between 6 AM and 7 AM Virtacore experienced an issue with our network provider and DNS services. As a result some of our customers experienced trouble with access to hosting environments. The systems and data were not impacted by this issue. All systems and data were up during the period of the issue.
During the network outage we had issues with our own phone, email and website systems. As a result Virtacore had a limited ability to communicate with customers.
Our technical team is working with our network provider to completely correct the issue, and prevent this from occurring again.
As soon as we have more information, we will be contacting our customers directly.
We apologize for any inconvenience this may have caused to our existing customers.
Thank you for your patience.
Virtacore
Posted by Myopinion, 05-29-2013, 01:53 PM i will move to softlayer
Posted by jackkros, 05-29-2013, 01:56 PM What a day...wow...I wonder if we calculate all the business that has been lost by all of us, what the total would be
Posted by mblendinger, 05-29-2013, 01:59 PM All my 74.200* servers still inaccessible.
Posted by mediagirlnm, 05-29-2013, 02:00 PM I can't agree more. One client is in their busy sales period leading up to Father's Day. Many, many sales lost.
We're on the 205.234* servers here...Quote:
Posted by Wolf1, 05-29-2013, 02:01 PM
We are still working on the issue. We have been asked about our redundant network providers. Our redundant network providers are currently functioning without problems. Which explains why we have many of our customers functioning without issues. Unfortunately, we are having difficulties separating the traffic currently routed through that provider. So we are working on ways to fix the situation independent of the network provider trying to resolve the issue.
We will keep you posted on time frames as soon as we provide one with certainty.
We apologize for any troubles this has caused our customers.
How many network providers do you have coming into Ashburn? We know Chicago is not offline so "many customers functioning without issue" does not mean many customers in Ashburn/Sterling functioning without issue, right? What percent of Ashburn is up and running without issue? 50%? 0%?
"We are having difficulties separating the traffic currently routed through that provider" Poor network design with the smack dab in the middle of the business day move?
"We apologize for any troubles this has caused our customers." Looks like you are loosing a lot of customers.... Any plans to do anything to try and keep them?
Posted by mblendinger, 05-29-2013, 02:05 PM
good point.
Posted by jackkros, 05-29-2013, 02:10 PM
"We are having difficulties separating the traffic currently routed through that provider"
Posted by vicjalan, 05-29-2013, 02:19 PM I'm still down as well..
I swear Paetec and PowerVPS are in cahoots. Been having outages for a long time from both parties. I'm also looking into moving. I've been looking at FutureHosting and LiquidWeb. LiquidWeb being the pricier one out of the two.
Posted by mediagirlnm, 05-29-2013, 02:26 PM Can anyone interpret these Virtacore status updates for me? I don't understand anything they are saying. Going on 7 hours of downtime here! How is their server up and not ours?
virtacore.com/network-outage/
Posted by Aeronautic, 05-29-2013, 02:28 PM Sorry if it seems like I'm kicking them while down, but I anticipate they will be doing the same if and when things are back up...
Which is the pre-amble to:
Any guesses how long it will take them to hide behind some obscure clause in the SLA to avoid compensation?
I say it 'cause I've seen this movie before and I don't like the ending.
Posted by marked, 05-29-2013, 02:29 PM
virtacore.com/network-outage/
Posted by mediagirlnm, 05-29-2013, 02:31 PM But they say they have redundant "water" service... why isn't it kicking in? Their Virtacore site was down earlier but now is working fine. They have to be in the same datacenter so what the heck! They're getting water... I want water too!! After 7 hours, I'm thirsty! Quote:
Posted by dcsit, 05-29-2013, 02:32 PM
Redundant? Right.
Posted by Wolf1, 05-29-2013, 02:34 PM
I think they are going to lose a lot of business unless the are proactive in offering compensation to everyone effected and clearly explaining what they did to correct this issue so it won't happen again, instead of some fluff piece.
If it wasn't happening to me, I would say it is comical.
Posted by marked, 05-29-2013, 02:35 PM
Posted by dcsit, 05-29-2013, 02:40 PM
Which is the pre-amble to:
Any guesses how long it will take them to hide behind some obscure clause in the SLA to avoid compensation?
I say it 'cause I've seen this movie before and I don't like the ending.
Posted by mediagirlnm, 05-29-2013, 02:44 PM You were compensated for the server move outage?
What the heck! I had 3 servers down 8 hours that day and no mention of compensation at all.Quote:
Posted by marked, 05-29-2013, 02:45 PM
Posted by dcsit, 05-29-2013, 02:45 PM
Posted by Wolf1, 05-29-2013, 02:47 PM
What the heck! I had 3 servers down 8 hours that day and no mention of compensation at all.
I am getting to the point of no return... these outages are KILLING it.
Posted by dcsit, 05-29-2013, 02:51 PM
Posted by mblendinger, 05-29-2013, 02:51 PM
What the heck! I had 3 servers down 8 hours that day and no mention of compensation at all.
another good point, I have > 40 servers in PVPS and no one talk about compensation with the awesome downtimes
Posted by mediagirlnm, 05-29-2013, 02:55 PM Any you move files from your backup? How about email? Quote:
Posted by jackkros, 05-29-2013, 02:57 PM Yup that's it for me too...entire working day, is just not kosher, I was giving them the benefit of doubt as things and accidents happen, but for a business that guarantees uptime, and has hundreds if not thousands of people relying on that service guarantee, this is just too much.
Posted by Myopinion, 05-29-2013, 03:01 PM now 8 Hrs gone server still down i Just need to get backups of my websites do not need to wait more
I do not know how long it may take to resolve this problem and there is no determining how much time will take to fix it
If the problem is not resolved quickly please give us solutions to move our data to another provider
Thanks
Posted by spiros, 05-29-2013, 03:02 PM Their support site is still down.
virtacoresupport.com
Posted by tgraphics, 05-29-2013, 03:03 PM
It looks like the company hired inexperienced network engineers or the good people left the company.
No serious hosting company goes down for a total of 23 hrs (and counting) in 3 months. Network redundancy should have been in place quite a while ago.
It seems like their turnover rate is increasing, and that's never a good thing in a service-based industry.
Posted by mblendinger, 05-29-2013, 03:04 PM If you had to vote, how long would you say we will need to wait for a solution? 2 hours more? +12 hours ? Tomorrow ?
Posted by dcsit, 05-29-2013, 03:06 PM
If I didn't implement tertiary DNS on the more important domains I'd be writing hundreds of DNS zones from memory but with the outage this far along I'm still left picking up the pieces.
Posted by tgraphics, 05-29-2013, 03:09 PM
Posted by mixxin, 05-29-2013, 03:17 PM All of my sites are down as well. After all of the downtime in the last few months, I am moving once I can download my backup!
Posted by Wolf1, 05-29-2013, 03:22 PM "Our apologies. We do not have a status update yet from our engineering team. As soon as we know more, we will post that information."
Posted by cpartsenidis, 05-29-2013, 03:24 PM I've decided to move my VPS to another provider. After 8 years of service from PVPS and today's 8 hours (so far) of waiting, damage and frustration, I think its time to move on.
Can someone recommend a VPS provider?
I'm looking for a fully managed VPS, 3-4G memory, 40Gigs Space, 2TB Bandwidth, CentOS, WHM/Cpanel for around $80 USD.
Any recommendations?
Futurehosting seems like a good one, but I'd rather trust feedback from this community, instead of advertising banners
Thanks,
Posted by marked, 05-29-2013, 03:24 PM
Posted by Myopinion, 05-29-2013, 03:26 PM ah i am very angry
Posted by Virtacore, 05-29-2013, 03:27 PM Update: 5/29/2013 - 3:21 PM Eastern Standard Time
Virtacore would like to apologize to all of the existing customers. We wanted to provide you with latest information on our network issues:
One of Virtacore's primary network providers is experiencing a failure within their core infrastructure. Virtacore is trying to re-advertise the IPs that are impacted at a higher priority. This is being done to bypass the network provider that is having the problems. We are doing this as we work with the provider to resolve the issue. According to our network provider this is something they have not experienced so it is difficult for them to give us any firm estimates of when the issue might be fixed.
Our engineering team is working as quickly as possible to resolve this issue on many fronts. As soon as we know more, we will keep you informed.
Thank you again for your patience.
Previous Post (1:47 PM):
---------------------------
We are still working on the issue. We have been asked about our redundant network providers. Our redundant network providers are currently functioning without problems. Which explains why we have many of our customers functioning without issues. Unfortunately, we are having difficulties separating the traffic currently routed through that provider. So we are working on ways to fix the situation independent of the network provider trying to resolve the issue.
We will keep you posted on time frames as soon as we provide one with certainty.
We apologize for any troubles this has caused our customers.
Previous Post (12:59 PM):
----------------------------
We apologize for the continuing issue with our network. We have learned that our network provider is currently trying to solve a problem with the routes looping in their network. We have raised this issue to the highest level of escalation with the company and they have informed us that they are working aggressively on the issue. This is causing connectivity issues for some of our clients, intermittent issues for others and some customers are not experiencing issues at all.
Unfortunately, our network provider has not given us a firm time frame of when we can expect a resolution. We are looking into our redundant providers to minimize, and potentially eliminate, the problem as we continue to wait for the network provider.
Again, we would like to underscore the fact that the data and systems are in no way compromised or impacted by this issue.
As soon as we have more information we will post it immediately.
Previous Post (11:33 AM):
-----------------------------
Some of our customers are still experiencing issues. We are working with the network provider to find out why this issue is causing additional problems. Our technicians have identified this as a routing issue with the network provider.
Our network provider has not given us a definitive time window of when they will be able to resolve this yet. We are waiting on additional information from them about the nature and depth of the problem and how to resolve it.
Previous Post (10:22 AM):
-----------------------------
This morning between 6 AM and 7 AM Virtacore experienced an issue with our network provider and DNS services. As a result some of our customers experienced trouble with access to hosting environments. The systems and data were not impacted by this issue. All systems and data were up during the period of the issue.
During the network outage we had issues with our own phone, email and website systems. As a result Virtacore had a limited ability to communicate with customers.
Our technical team is working with our network provider to completely correct the issue, and prevent this from occurring again.
As soon as we have more information, we will be contacting our customers directly.
We apologize for any inconvenience this may have caused to our existing customers.
Thank you for your patience.
Virtacore
Posted by tgraphics, 05-29-2013, 03:29 PM A quick Google search "liquidweb down" (search tools | past month):
(not able to provide direct links)
6 days ago:
www webhostingtalk com/showthread.php?t=1268955
About 1 month ago:
www warriorforum com/main-internet-marketing-discussion-forum/785383-liquidweb-has-been-going-down-lot-lately.html
Just food for thought...
Posted by Aeronautic, 05-29-2013, 03:37 PM
Virtacore would like to apologize to all of the existing customers. Quote:
Virtacore would like to apologize to all of our soon to be ex-customers.
Posted by Myopinion, 05-29-2013, 03:42 PM
yes +1 ...
Posted by dcsit, 05-29-2013, 03:47 PM
(not able to provide direct links)
6 days ago:
www webhostingtalk com/showthread.php?t=1268955
About 1 month ago:
www warriorforum com/main-internet-marketing-discussion-forum/785383-liquidweb-has-been-going-down-lot-lately.html
Just food for thought...
So I have the option of having a direct relationship with cpanel or find another VPS provider. I'd to try another provider first just so I can still have diversity but the market is messy. It's so hard to tell who these companies are and how good they actually are. I couldn't even find the physical addresses of the last three I looked at!
Posted by Throtex, 05-29-2013, 03:47 PM I use the service for personal stuff with low traffic, so I'm not in the same boat with you guys who are losing valuable business because of this. My sympathies for having to deal with this.
Even given my usage, I also started looking for other providers. However, I have to wonder whether having had this kind of massive failure means they'll learn their lesson and be more responsive in the future than a provider who hasn't had this kind of screw up before. On the other hand, it could be that the other providers just know what they're doing and wouldn't let this happen in the first place.
Any recommendations for a low-cost VPS for light usage? I saw someone else recommend futurehosting.com, and the price certainly looks right.
Just had to get an account to join the commiserating
Posted by lionlink-dot-net, 05-29-2013, 03:48 PM Sad to see this happening. DTG used to be fantastic... sad to see this happening since Virtacore took over.
I've already had several people come get quotes from me because of this outage... everything from dedicated servers, colo, and VPS.
Posted by dcsit, 05-29-2013, 03:53 PM
I've already had several people come get quotes from me because of this outage... everything from dedicated servers, colo, and VPS.
I see you guys are using Cogent? Are you having any problems with them? Are you in the same Equinix building?
Posted by webhosteria, 05-29-2013, 03:53 PM Since 2004 i am customer of Powervps....this is first time that i face so serious problem. I hope tomorrow morning (i am writing from Italy, cause of the time zone i had limited problems with customers) everything is solved. Before today i never had problem with PVPS....so i am confident that they will able to come out of this problem. GOOD LUCK and GOOD WORK.
Posted by mblendinger, 05-29-2013, 03:54 PM Well, I hope PVPS learn about this and do the neccesary moves to avoid this from happening again.
I love the PVPS performance from 2005-2012, If they can assure the same service quality as they have in Chicago, I will be happy to continue supporting these guys. Today is a "hate day" but I must accept than support has been very colaborative all time but today due to this big issue.
I will send some love to this people, COME ON YOU CAN FIX IT AND PREVENT THIS FROM HAPPENING AGAIN!
Posted by dcsit, 05-29-2013, 03:57 PM
Even given my usage, I also started looking for other providers. However, I have to wonder whether having had this kind of massive failure means they'll learn their lesson and be more responsive in the future than a provider who hasn't had this kind of screw up before. On the other hand, it could be that the other providers just know what they're doing and wouldn't let this happen in the first place.
Any recommendations for a low-cost VPS for light usage? I saw someone else recommend futurehosting.com, and the price certainly looks right.
Just had to get an account to join the commiserating
The learning is everything from technical, support, management or even billing. Ugh!
Posted by lionlink-dot-net, 05-29-2013, 03:59 PM We haven't had any problems with Cogent today. We are primarily built in at Ragingwire, however, the traffic does flow through Equinix for Cogent, and we have not had any issues.
If we did have issues though, we would just route around cogent... Shut down session with Cogent until the issue was resolved and only advertise to other providers - - only logical.
(apologies for any spelling errors. I'm on android)
Posted by Wolf1, 05-29-2013, 04:01 PM
If we did have issues though, we would just route around cogent... Shut down session with Cogent until the issue was resolved and only advertise to other providers - - only logical.
(apologies for any spelling errors. I'm on android)
Posted by Throtex, 05-29-2013, 04:07 PM
The learning is everything from technical, support, management or even billing. Ugh!
Posted by marked, 05-29-2013, 04:08 PM
Posted by powerlessVPS, 05-29-2013, 04:09 PM They are just blowing smoke up our asses.
see status.cogentco.com
Posted by kish, 05-29-2013, 04:12 PM Hi all
Something which may help those of you suffering today:
One of my VPS's is on a 74.200 IP range, and so has been unavailable all day like the rest of you. Haven't been able to route to it from three locations (home, work, cell). HOWEVER, I tried to connect to it through a VPN that I have access to (from this company https://www.privateinternetaccess.com/ ) . I connected to their US East location, and routed all my traffic through there. For whatever reason, that location is able to connect directly to the 74.200 IP.
So, right now I can connect to my.ip/whm and I can also SSH to it. I am currently using the SSH command line to generate cpbackup files, then using an SFTP client to download the backup files to my local computer.
So, advice to you all - try and connect to your server, via all of your IPs, from as many locations as you have access to. If you're desperate, then try a VPN service and connect from their locations. Hopefully you'll get lucky too!
Posted by Myopinion, 05-29-2013, 04:23 PM 9 hours ago // still down
Posted by Myopinion, 05-29-2013, 04:29 PM guys vps up now and working
Posted by akoss, 05-29-2013, 04:30 PM We're another long time PowerVPS customer, but like others have said they are NOT the company they once were. After the previous full day of downtime, it time to move to a new host, probably LiquidVPS.
We're still happy with ServInt if anyone wants a different recommendation.
Posted by Aeronautic, 05-29-2013, 04:32 PM I'm still offline.
Posted by mediagirlnm, 05-29-2013, 04:33 PM My 3 VPS are up!!!!!!!!!!
I flushed DNS and did a hard browser cache clearing to get the sites to load. I started getting email so I knew things were back online.
Posted by jackkros, 05-29-2013, 04:33 PM
Posted by tgraphics, 05-29-2013, 04:34 PM
Posted by dcsit, 05-29-2013, 04:34 PM I'm able to connect to one of my VPS boxes on the 69.65 network. Ironically it's the old one I'm trying to terminate due to age but it's better then nothing. I'm able to connect though multiple IP providers on the east coast.
Posted by vicjalan, 05-29-2013, 04:35 PM I'm still down...here is a clue, can anyone else see it? Code:1 9 ms <1 ms <1 ms 192.168.1.1 2 38 ms 37 ms 60 ms 50.160.200.1 3 11 ms 10 ms 24 ms xe-10-1-0-32767-sur01.d1stonemtn.ga.atlanta.comcast.net [68.85.32.225] 4 19 ms 17 ms 15 ms xe-6-0-3-0-ar01.d1stonemtn.ga.atlanta.comcast.net [68.85.172.49] 5 35 ms 11 ms 11 ms ae-2-0-ar01.b0atlanta.ga.atlanta.comcast.net [68.85.109.241] 6 16 ms 15 ms 15 ms he-5-12-0-0-11-cr01.56marietta.ga.ibone.comcast.net [68.86.95.197] 7 14 ms 15 ms 17 ms pos-0-10-0-0-pe01.56marietta.ga.ibone.comcast.net [68.86.88.182] 8 251 ms 53 ms 240 ms te4-2.ccr01.atl02.atlas.cogentco.com [154.54.10.233] 9 59 ms 37 ms 37 ms te0-0-0-1.ccr21.atl01.atlas.cogentco.com [154.54.0.165] 10 38 ms 38 ms 42 ms te0-4-0-7.ccr21.dca01.atlas.cogentco.com [154.54.42.189] 11 57 ms 48 ms 48 ms te0-1-0-5.ccr21.iad02.atlas.cogentco.com [154.54.2.50] 12 47 ms 52 ms 51 ms te0-0-0-4.mpd22.iad02.atlas.cogentco.com [154.54.31.106] 13 72 ms 34 ms * te0-0-0-4.ccr21.iad02.atlas.cogentco.com [154.54.31.105] 14 43 ms 41 ms 39 ms te0-0-0-4.mpd22.iad02.atlas.cogentco.com [154.54.31.106] 15 47 ms 53 ms 31 ms te0-0-0-4.ccr21.iad02.atlas.cogentco.com [154.54.31.105] 16 47 ms 48 ms 56 ms te0-0-0-4.mpd22.iad02.atlas.cogentco.com [154.54.31.106] 17 * * 127 ms te0-0-0-4.ccr21.iad02.atlas.cogentco.com [154.54.31.105] 18 41 ms 54 ms 43 ms te0-0-0-4.mpd22.iad02.atlas.cogentco.com [154.54.31.106] 19 30 ms 32 ms * te0-0-0-4.ccr21.iad02.atlas.cogentco.com [154.54.31.105] 20 104 ms 44 ms 39 ms te0-0-0-4.mpd22.iad02.atlas.cogentco.com [154.54.31.106] 21 * 34 ms * te0-0-0-4.ccr21.iad02.atlas.cogentco.com [154.54.31.105] 22 60 ms 50 ms 55 ms te0-0-0-4.mpd22.iad02.atlas.cogentco.com [154.54.31.106] 23 30 ms * 30 ms te0-0-0-4.ccr21.iad02.atlas.cogentco.com [154.54.31.105] 24 54 ms 49 ms 48 ms te0-0-0-4.mpd22.iad02.atlas.cogentco.com [154.54.31.106] 25 38 ms 43 ms 49 ms te0-0-0-4.ccr21.iad02.atlas.cogentco.com [154.54.31.105] 26 47 ms 56 ms 48 ms te0-0-0-4.mpd22.iad02.atlas.cogentco.com [154.54.31.106] 27 33 ms * 28 ms te0-0-0-4.ccr21.iad02.atlas.cogentco.com [154.54.31.105] 28 46 ms 46 ms 51 ms te0-0-0-4.mpd22.iad02.atlas.cogentco.com [154.54.31.106] 29 * * 36 ms te0-0-0-4.ccr21.iad02.atlas.cogentco.com [154.54.31.105] 30 48 ms 63 ms 55 ms te0-0-0-4.mpd22.iad02.atlas.cogentco.com [154.54.31.106] Trace complete.
Posted by Myopinion, 05-29-2013, 04:36 PM
yes i use hotspot and its work
try to restart dns service
Posted by webhosteria, 05-29-2013, 04:36 PM .....my vps 74.200...... still down nor https://my.powervps.com/cp/ is working here from italy
Posted by Wolf1, 05-29-2013, 04:39 PM
But, but, there are multiple network providers...
Posted by akoss, 05-29-2013, 04:40 PM Interestingly I can connect to my WHM and my sites that use the shared IP, but I still cant get to the 74.200. sites
Posted by dcsit, 05-29-2013, 04:41 PM
Posted by dcsit, 05-29-2013, 04:50 PM SSH one host is up... time to start transferring backups
Posted by Zur13, 05-29-2013, 04:51 PM
17 147 ms 136 ms 138 ms te0-1-0-0.ccr22.iad02.atlas.cogentco.com [154.54.31.90]
18 * * * Request timed out.
19 * * * Request timed out.
20 133 ms 134 ms 135 ms te0-1-0-6.ccr21.iad02.atlas.cogentco.com [154.54.31.225]
21 137 ms 136 ms 136 ms te0-1-0-0.ccr22.iad02.atlas.cogentco.com [154.54.31.90]
22 * * * Request timed out.
23 * * * Request timed out.
24 138 ms 136 ms 135 ms te0-1-0-6.ccr21.iad02.atlas.cogentco.com [154.54.31.225]
25 137 ms 136 ms 137 ms te0-1-0-0.ccr22.iad02.atlas.cogentco.com [154.54.31.90]
26 * * * Request timed out.
27 * * * Request timed out.
28 134 ms 133 ms 135 ms te0-1-0-6.ccr21.iad02.atlas.cogentco.com [154.54.31.225]
29 137 ms 134 ms 134 ms te0-1-0-0.ccr22.iad02.atlas.cogentco.com [154.54.31.90]
30 * * * Request timed out.
Posted by lionlink-dot-net, 05-29-2013, 04:59 PM
Posted by tgraphics, 05-29-2013, 05:04 PM Hey guys,
I found a 70% off coupon for the first month of service at FutureHosting.com:
WHT70
I'm using it now. It works.
Posted by lionlink-dot-net, 05-29-2013, 05:07 PM
I found a 70% off coupon for the first month of service at FutureHosting.com:
WHT70
I'm using it now. It works.
Posted by vicjalan, 05-29-2013, 05:08 PM Irony:
Virtacore's Linkedin ProfileQuote:
Virtacore Tired of power outages, problems with your network and outages you can't explain? Perhaps it is time to move some, or all, of your infrastructure to the cloud. At Virtacore we can help you migrate your infrastructure and leave outages behind! Visit our website to learn more and reach out to us. The staff at Virtacore is ready to help you. less
Posted by AlessioIT, 05-29-2013, 05:09 PM I tried with no luck from : I'm very disappointed and I start to think we will have to wait a lot of time.
- Italy
- Vancouver, Canada
- Mumbai, India
- São Paulo, Brazil
- Sydney, Australia
- London, UK
- Dallas, USA
Posted by vicjalan, 05-29-2013, 05:14 PM
I found a 70% off coupon for the first month of service at FutureHosting.com:
WHT70
I'm using it now. It works.Oh well. My monthly bill will still be cheaper than PowerVPS, so I guess that's a win still.
Posted by tgraphics, 05-29-2013, 05:18 PM Perhaps just ask them if your new account is eligible for the promo. Hopefully they will credit you (fingers crossed for ya)
Posted by Aeronautic, 05-29-2013, 05:18 PM
We operate in the most secure and reliable data centers with 99.999% SLA uptime guarantees.
...
Virtacore’s cloud solutions are extremely reliable, secure, scalable, and easy to manage.
...
Virtacore is wholly owned by IKANO Communications
To confirm it is not a local cache issue (for me at least as some seem to have come back), I sent a test e-mail from another e-mail provider which bounced hard due to missing MX records (and A records).
Posted by mixxin, 05-29-2013, 05:23 PM Still down
Posted by dcsit, 05-29-2013, 05:25 PM
I found a 70% off coupon for the first month of service at FutureHosting.com:
WHT70
I'm using it now. It works.
Pings are about 3-4 high to futurehosting in Chicago over PVPS.
Any other recommendations?
Posted by marked, 05-29-2013, 05:25 PM I just signed up for liquidvps
man I'm not looking forward to migration
any trips or trick to migrating sites running mysql databases?
Posted by marked, 05-29-2013, 05:28 PM IKANO communications appears down as well. i'm starting to think they all just packed up and left (seriously)
Posted by jackkros, 05-29-2013, 05:30 PM
Posted by lionlink-dot-net, 05-29-2013, 05:31 PM
Posted by tgraphics, 05-29-2013, 05:31 PM
Any other recommendations?
Posted by mediagirlnm, 05-29-2013, 05:33 PM I don't know if this works...
But for anyone looking at LiquidWeb:
Just enter in code: "WHT10OFFVPS" in the comments section of the order form to get $10/month off a Liquid Web VPS account, for the lifetime of the account.
Posted by mixxin, 05-29-2013, 05:34 PM
Posted by MMK, 05-29-2013, 05:40 PM Another 74.200 down here, been down for a minimum of six hours (no idea how long it had been down before then). Thinking about futurehosting, they are looking really good... does anyone have any real experience with them? I see some of you signing up, but I'm looking for people who have been with them for more than a few hours.
And damn, I just realized I've been a member on here for over ten years. Wow, time flies.
Edit #2, I also just realized that one of my last threads was... uh, a glowing review of PowerVPS, hah.
http://www.webhostingtalk.com/showthread.php?t=417573
Posted by lionlink-dot-net, 05-29-2013, 05:43 PM
Posted by tgraphics, 05-29-2013, 05:44 PM
man I'm not looking forward to migration
any trips or trick to migrating sites running mysql databases?
Something like this on existing host:
#tar -czf -u mysite_wordpress -p mysite_wordpress > migrate.sql
<enter><db pass><enter>
#tar -czf mysite.tar.gz * . && rm -Rf migrate.sql
Create the DB at the new host, then log into new SSH:
#cd ~mynewhost/public_html
#wget myoldhost.com/mysite.tar.gz
#tar zxvf mysite.tar.gz && rm -Rf mysite.tar.gz
#mysql -u mysite_wordpress -p mysite_wordpress < migrate.sql
<enter><db pass><enter>
#rm -Rf migrate.sql
Then test out the new site via IP or whatever and check the error logs. If all looks good, then switch the DNS. Don't forget to recreate the email accounts.
That's it, (more or less). Hope that helps!
Posted by lionlink-dot-net, 05-29-2013, 05:46 PM
And damn, I just realized I've been a member on here for over ten years. Wow, time flies.
I also recommend Preetam @ BitCable for KVM based Virtualization.
We (LionLink) are also thinking about spinning up some infrastructure temporarily just to help people get back online in interim while they (customers) find a new provider or revert back to Virtacore once they are back online.
Posted by mediagirlnm, 05-29-2013, 05:48 PM More LiquidWeb coupon options:
retailmenot.com/view/liquidweb.com
Posted by webhosteria, 05-29-2013, 05:51 PM I would like to have some updates ....directly from powervps. Thanks. I guess i do not ask too much.....
How much time will occur ? Wich is your prevision ? 1 Hour more------- two ----four ------full tomorrow too-------please let inform us about it.
Posted by jrepetto, 05-29-2013, 05:55 PM So I guess now it's passed their office hours and no one will update us till tomorrow at 9am ET, which is when twitter updates started today. Great. Just great. I managed to ssh using a vpn but I still can't access email and of course email is not being delivered. Can't access WHM either. It just times out.
Posted by jackkros, 05-29-2013, 05:55 PM Just bring up email service It's all I need to survive
Posted by mblendinger, 05-29-2013, 06:11 PM
I think it is obvious they will work 24 hours to fix this issue.
Posted by lionlink-dot-net, 05-29-2013, 06:12 PM
Posted by spiros, 05-29-2013, 06:15 PM I think working 24 hours to fix this issue is the only logical thing. It would be callous and unintelligent to walk out on an issue affecting thousands of your clients.
Posted by mediagirlnm, 05-29-2013, 06:16 PM What I don't understand is why some servers are online while others aren't.
Seems they are manually making changes per VPS, no?
Posted by mixxin, 05-29-2013, 06:17 PM Their tech support is outsourced (India). I really hope they have good local network engineers to remedy this issue ASAP.
Posted by dookie287, 05-29-2013, 06:17 PM I will fill some people in on what's going on at PowerVPS.
Almost a year and a half ago, PowerVPS (actually Virtacore), purchased a new datacenter suite with Equinix that was slated to consolidate a massive number cages across several Equinix facilities into one massive colocation suite.
The new suite was purchased in early Spring of 2012, and finished being built out with power and basic infrastructure around May that same year. Originally, the plan was to migrate all the customers to the new facility over a period of six months as Equinix was allowing them time to clear all of their other cages. Unfortunately, mismanagement at the executive level and a lack of knowledge and skill after the original Virtacore team left for better opportunities caused delay, after delay, after delay in this migration.
It is to the best of my knowledge that Virtacore has failed to disclose the truth and communicate with customers not only regarding the migration to DC10 (which was in planning for a YEAR beforehand, but on these "outages" they are blaming providers for. In fact, these outages people are experiencing over these past months are from a lack of understanding of their "old" infrastructure and failure of contractors and employees of how the "new" infrastructure needs to be setup to handle the migration.
The new Virtacore team and management seems to not know how their old infrastructure works, and because of this is unable to build or configure new infrastructure in the proper manner to facilitate a problem-free migration to the new facility.
For example - I have several VPS servers at PowerVPS (which are down by the way), that have historically been able to be migrated over the wire via what their support techs call "vzmigrate". Instead of doing migrations for PowerVPS servers this way, the company chose to (literally) pick up and move the servers. Complete with less than a week's notice of downtime. If I recall correctly, I received my e-mail approximately two days prior to the move. This is very unprofessional in my opinion.
From my understanding during my time today in the Equinix campus, they are again moving more equipment (some of which seemed to be critical infrastructure like switches - I cannot confirm this myself). However, the lack of communication, downed websites, and no support seems to point towards the migration of critical company infrastructure.
I'm already looking at a new provider since I cannot handle anymore downtime, or lack of communication by a company I've trusted with my businesses over the last few years.
Posted by mixxin, 05-29-2013, 06:28 PM
Almost a year and a half ago, PowerVPS (actually Virtacore), purchased a new datacenter suite with Equinix that was slated to consolidate a massive number cages across several Equinix facilities into one massive colocation suite.
The new suite was purchased in early Spring of 2012, and finished being built out with power and basic infrastructure around May that same year. Originally, the plan was to migrate all the customers to the new facility over a period of six months as Equinix was allowing them time to clear all of their other cages. Unfortunately, mismanagement at the executive level and a lack of knowledge and skill after the original Virtacore team left for better opportunities caused delay, after delay, after delay in this migration.
It is to the best of my knowledge that Virtacore has failed to disclose the truth and communicate with customers not only regarding the migration to DC10 (which was in planning for a YEAR beforehand, but on these "outages" they are blaming providers for. In fact, these outages people are experiencing over these past months are from a lack of understanding of their "old" infrastructure and failure of contractors and employees of how the "new" infrastructure needs to be setup to handle the migration.
The new Virtacore team and management seems to not know how their old infrastructure works, and because of this is unable to build or configure new infrastructure in the proper manner to facilitate a problem-free migration to the new facility.
For example - I have several VPS servers at PowerVPS (which are down by the way), that have historically been able to be migrated over the wire via what their support techs call "vzmigrate". Instead of doing migrations for PowerVPS servers this way, the company chose to (literally) pick up and move the servers. Complete with less than a week's notice of downtime. If I recall correctly, I received my e-mail approximately two days prior to the move. This is very unprofessional in my opinion.
From my understanding during my time today in the Equinix campus, they are again moving more equipment (some of which seemed to be critical infrastructure like switches - I cannot confirm this myself). However, the lack of communication, downed websites, and no support seems to point towards the migration of critical company infrastructure.
I'm already looking at a new provider since I cannot handle anymore downtime, or lack of communication by a company I've trusted with my businesses over the last few years.
Posted by dookie287, 05-29-2013, 06:30 PM
Although the engineering and datacenter guys are actual local employees (I've worked in the same building).
Posted by dcsit, 05-29-2013, 06:31 PM
Posted by Aeronautic, 05-29-2013, 06:31 PM
Almost a year and a half ago, PowerVPS (actually Virtacore), purchased a new datacenter suite with Equinix that was slated to consolidate a massive number cages across several Equinix facilities into one massive colocation suite.
The new suite was purchased in early Spring of 2012, and finished being built out with power and basic infrastructure around May that same year. Originally, the plan was to migrate all the customers to the new facility over a period of six months as Equinix was allowing them time to clear all of their other cages. Unfortunately, mismanagement at the executive level and a lack of knowledge and skill after the original Virtacore team left for better opportunities caused delay, after delay, after delay in this migration.
It is to the best of my knowledge that Virtacore has failed to disclose the truth and communicate with customers not only regarding the migration to DC10 (which was in planning for a YEAR beforehand, but on these "outages" they are blaming providers for. In fact, these outages people are experiencing over these past months are from a lack of understanding of their "old" infrastructure and failure of contractors and employees of how the "new" infrastructure needs to be setup to handle the migration.
The new Virtacore team and management seems to not know how their old infrastructure works, and because of this is unable to build or configure new infrastructure in the proper manner to facilitate a problem-free migration to the new facility.
For example - I have several VPS servers at PowerVPS (which are down by the way), that have historically been able to be migrated over the wire via what their support techs call "vzmigrate". Instead of doing migrations for PowerVPS servers this way, the company chose to (literally) pick up and move the servers. Complete with less than a week's notice of downtime. If I recall correctly, I received my e-mail approximately two days prior to the move. This is very unprofessional in my opinion.
From my understanding during my time today in the Equinix campus, they are again moving more equipment (some of which seemed to be critical infrastructure like switches - I cannot confirm this myself). However, the lack of communication, downed websites, and no support seems to point towards the migration of critical company infrastructure.
I'm already looking at a new provider since I cannot handle anymore downtime, or lack of communication by a company I've trusted with my businesses over the last few years.
As I stated earlier, I too experienced that biz day migration. The event and the explanation they provided was mind boggling in its unprofessionalism.
Posted by dookie287, 05-29-2013, 06:33 PM
Posted by dcsit, 05-29-2013, 06:36 PM
Posted by Aeronautic, 05-29-2013, 06:38 PM The nighttime team is very spotty except for Manu who typically provides excellent support.
Posted by dookie287, 05-29-2013, 06:40 PM
Posted by dcsit, 05-29-2013, 06:42 PM
Posted by mblendinger, 05-29-2013, 06:44 PM No news about the provider and I'm asking quotes here and there.
Posted by dcsit, 05-29-2013, 06:46 PM Anyone ever use sparknode.com?
Posted by mediagirlnm, 05-29-2013, 06:47 PM I've liked the support very much myself and I haven't seen lots of different names. It's usually the same couple guys (Manu and Prasul) and I thank them for their many years of hand holding. <3
Posted by Eased, 05-29-2013, 06:50 PM deftechgroup.com is online, but powervps is not. Any news at all?
Posted by dcsit, 05-29-2013, 06:51 PM I have one VPS up and one down: I see now that I can access the downed server (74.200.x.x) from the one that is up (69.65.x.x). So I can get files and transfer accounts if needed.
It's lame to have to do something like that but it's better then nothing.
Posted by dm-9, 05-29-2013, 06:51 PM
I have also contacted liquidweb com and hetzner de to see if they can help but only Liquidweb have replied.
I hate having to find a provider again, I was very pleased with PVPS until today.
Posted by ohmoigowd, 05-29-2013, 06:52 PM well my vps seems to be on for now, although im getting no email or able to send, its as though its all going down one big hole?
and when i try and ping my domain it comes back with no dns ?
i was using localmailserver on my vps, exim fails to start in whm.
i have no idea whats going on, why would email not work if the vps is now back on?
can i do anything to fix my email, or should i just go and smoke a giant dooby and go to bed ?
Posted by Ulysses, 05-29-2013, 06:55 PM Anyone up with IPs starting with 74.XX ?
Posted by Aeronautic, 05-29-2013, 07:14 PM The entirety of my experience with singlehop.com is adding their IPs and ranges to CSF due to various abuse offenses. No like at all.
Posted by trecmc, 05-29-2013, 07:16 PM 1/2 and 1/2. One up and one down. We are in the 74.200 neighborhood...
I think that after many comfortable years, it's time to migrate to greener pastures. Since at least January, things have been hovering somewhere between slightly unsteady and nonfunctional.
Does anyone have nice things to say about MediaTemple, which has been under consideration.
Posted by AlessioIT, 05-29-2013, 07:18 PM
I have also contacted liquidweb com and hetzner de to see if they can help but only Liquidweb have replied.
I hate having to find a provider again, I was very pleased with PVPS until today.
Posted by mblendinger, 05-29-2013, 07:19 PM I get now various of my servers on, I have not verified all them
Posted by dcsit, 05-29-2013, 07:23 PM
Now I have to spend my evening untangling DNS workarounds AGAIN! LAME
From what I see it never went down: uptime 50+days.
Posted by ohmoigowd, 05-29-2013, 07:25 PM looks like manu or prasul has just plugged the server back in..
now to download / back up / transfer and get the hell out of there..
dear god.. now for that big dooby !
Posted by tgraphics, 05-29-2013, 07:26 PM
Posted by dcsit, 05-29-2013, 07:26 PM
....
Posted by AlessioIT, 05-29-2013, 07:29 PM Some of my sites are online again, 74.204. and 74.200. ip range.
Posted by dcsit, 05-29-2013, 07:29 PM
Posted by mblendinger, 05-29-2013, 07:33 PM
Posted by tgraphics, 05-29-2013, 07:35 PM Everything appears to be working for me now, so apparently...
1.) It was actually just a full system cache flush! Yay! It's faster than ever. Shall we schedule this maintenance procedure for Monday morning of each week? Or...
2.) Only fast because there's very little website traffic right now. Or...
3.) Manu and Prasul really did just plug the server back in.
Posted by Wolf1, 05-29-2013, 07:42 PM I just had installed a VPN and it started to work (emails started to come in), thought it was the VPN connection, til I got a message that VPN did not connect....
Now to find the best way to back it all up (download it) from WHM in one big zip... Suggestions? The back up feature does not appear to give you a downloadable file.
Posted by Aeronautic, 05-29-2013, 07:42 PM Subject to confirmation but it just may be I'm back too. Also in the 74.200.. range.
Yet no update on Twitter, here or their website for hours. Shameful.
Posted by mixxin, 05-29-2013, 07:53 PM Sites are up now, conveniently after being down during peak business hours. Loss of thousands of dollars today. i'll take some of the blame for not having a redundancy plan and/or moving my VPS when I started to see Power VPS faltering in the last few months.
Posted by AlessioIT, 05-29-2013, 07:55 PM
Posted by ohmoigowd, 05-29-2013, 07:57 PM if anyone has any migration tips for moving servers, i think this would be a good place to post them. i know this will be my next job.
i will probably do full back ups of 32 accounts and restore to a new vps, individually test then switch the ns..only thing is moving from cpanel to plesk, but time for something completely different, out with the old and in with the new...
Posted by MMmmGood, 05-29-2013, 07:57 PM
Almost a year and a half ago, PowerVPS (actually Virtacore), purchased a new datacenter suite with Equinix that was slated to consolidate a massive number cages across several Equinix facilities into one massive colocation suite.
The new suite was purchased in early Spring of 2012, and finished being built out with power and basic infrastructure around May that same year. Originally, the plan was to migrate all the customers to the new facility over a period of six months as Equinix was allowing them time to clear all of their other cages. Unfortunately, mismanagement at the executive level and a lack of knowledge and skill after the original Virtacore team left for better opportunities caused delay, after delay, after delay in this migration.
It is to the best of my knowledge that Virtacore has failed to disclose the truth and communicate with customers not only regarding the migration to DC10 (which was in planning for a YEAR beforehand, but on these "outages" they are blaming providers for. In fact, these outages people are experiencing over these past months are from a lack of understanding of their "old" infrastructure and failure of contractors and employees of how the "new" infrastructure needs to be setup to handle the migration.
The new Virtacore team and management seems to not know how their old infrastructure works, and because of this is unable to build or configure new infrastructure in the proper manner to facilitate a problem-free migration to the new facility.
For example - I have several VPS servers at PowerVPS (which are down by the way), that have historically been able to be migrated over the wire via what their support techs call "vzmigrate". Instead of doing migrations for PowerVPS servers this way, the company chose to (literally) pick up and move the servers. Complete with less than a week's notice of downtime. If I recall correctly, I received my e-mail approximately two days prior to the move. This is very unprofessional in my opinion.
From my understanding during my time today in the Equinix campus, they are again moving more equipment (some of which seemed to be critical infrastructure like switches - I cannot confirm this myself). However, the lack of communication, downed websites, and no support seems to point towards the migration of critical company infrastructure.
I'm already looking at a new provider since I cannot handle anymore downtime, or lack of communication by a company I've trusted with my businesses over the last few years.
Posted by mblendinger, 05-29-2013, 08:05 PM Do you think Chicago servers will be eventually migrated to DC10 ?
Posted by Aeronautic, 05-29-2013, 08:10 PM
Posted by powerlessVPS, 05-29-2013, 08:23 PM
Posted by Ulysses, 05-29-2013, 08:33 PM As OP of this thread and having been up all night watching and checking status/progress, I thought PowerVPS/Virtacore managed the situation quite well. It was a scary slow start, but once they explained the problem it made sense and it was a matter of waiting for the upstream supplier to sort out their problem.
We won't be moving, but will use this experience to be better prepared when such a thing happens again.
Posted by AlessioIT, 05-29-2013, 08:57 PM
Posted by MMmmGood, 05-29-2013, 08:58 PM
Posted by jackkros, 05-29-2013, 09:28 PM Yup I'm back up. It's rather slow for now, but at least some messages email got through, now I have to figure out who didn't get through etc. etc.
Also time to make appropriate plan b's.
Posted by tgraphics, 05-29-2013, 09:47 PM
How do you prepare? If such a shame happens again you can only prepare to loose clients and money, but you really can do nothing.
I think we can all agree that it's up to us to figure out a backup plan since PowerVPS doesn't seem to be helping us in that dept.
This is sort of "off the cuff"...
I sure do wish I could stay with PowerVPS. I'm more loyal to Manu/Prasul/Prasad than I am PowerVPS as a whole. THEIR support which someone mentioned in an earlier post "thanks for holding my hand all these years" (which is my sentiments exactly)... THEY are the reason I loved PowerVPS so much.
Anyway, how exactly do you "really" prepare for a future, similar incident? It does seem inevitable, don't you think? I ask this question in a "someone please chime in" fashion, because I'd really like to know.
My guess is that it would take:
1.) Setting up a secondary server (different facility, or different provider)
2.) To keep costs low, lease an additional server that is the bare minimum cost (just a bit more capacity than what you need for offsite backups), then if you need to make the switch in an emergency, you can have the backup server resources upgraded at the same time.
3.) Then have cPanel's auto-backups automatically synced with the "new" backup server. (this is where it gets questionable). Does WHM/cPanel have a function for automatic remote backups? Or do you need to implement rsync (I think that's the right term.), Or do you need to set up a script on each user's account that automatically backs up files/dbs and pushes them via SFTP(?) to the backup server, along with a nightly cron job? (this last option would be a pain to set up and maintain, and I highly doubt that it would do much of anything for the cPanel-based email accounts)
Thought: Best option to get around the email account part of #3 would be to set up all the email accounts on a separate mail service (like GA/365 or w/e), along with DNS entries set at the registrar, so that cPanel is never used for mail services.
That's pretty much all I can think of, short of collocation (which I'm not experienced with whatsoever). I hear it's tough to configure and maintain, and also pretty expensive.
In any case, this "redundancy" isn't quick or easy... and definitely not free!
Anyone care to chime in? I'm sure we would all love to know... especially after today's fiasco!
Posted by dookie287, 05-29-2013, 11:18 PM
Regarding management - when a manager (and furthermore, the CTO) lies to you about why your services are offline, yes I believe the management is incompetent.
Also, the last time I checked Virtacore/PowerVPS was a multi-homed provider with several bandwidth providers. If a single provider was able to knock the entire network / services / servers offline for 13 hours, what does that tell you about their engineering department? If in fact they only have ONE provider for bandwidth, then they are lying as well.
That's just my take on it.
Posted by Aeronautic, 05-30-2013, 12:58 AM Anyone who dropped a support ticket when it started get the boilerplate apology e-mail?
As I predicted, they referenced the SLA in the one I received.
Posted by mixxin, 05-30-2013, 01:14 AM Power VPS used to be a solid company, with an envious up-time. It's unfortunate to see that it has spiraled downwards in the last few months. That said, their Support people in India (Manu etc) are to be commended for their prompt responses per usual. There's so much the support people can do if Mgmt isn't providing the resources on the back-end. After two major 12-14 hour crashes within a couple months, I have lost confidence in Power VPS. I am looking at alternatives as we speak.
Posted by Wolf1, 05-30-2013, 07:28 AM
As I predicted, they referenced the SLA in the one I received.
Hello,
First off, we apologize for the massive delay in communication. The issue that affected your server also affected our e-mail ability and we were unable to receive or send communications with clients. There was a wide spread issue with one of our providers, Cogent, that affected not only us but multiple companies as well. Every level of management was alerted to this issue, and they are working with Cogent to completely correct this issue. Services are coming up now, however we do not have an ETA when all services will be restored. Once your service is up it will remain stable and responding.
We sincerely apologize for this outage. We all thank you for your patience, and apologize once again for any inconvenience this caused!
Best Regards,
Prasad S
Technical Support Analyst
Virtacore Systems/PowerVPS Support
And this time, their excuses are total BS.
This:Quote:
Posted by stevendbrady, 05-30-2013, 09:07 AM
Posted by Wolf1, 05-30-2013, 09:13 AM
If you did open a ticket and did not even get a response, that is not good.
Posted by vicjalan, 05-30-2013, 09:32 AM I think only the people who submitted a ticket got a response. I got the same response as well.
I knew the issue was serious when the support ticket was bounced back to me because their mail servers couldn't be reached lol.
Posted by aww, 05-30-2013, 09:41 AM Seeing an alert just now from one of my testing routes, though I personally can reach the server just fine.
Anyone else seeing "blips" this morning?
Posted by dcsit, 05-30-2013, 09:41 AM
I knew the issue was serious when the support ticket was bounced back to me because their mail servers couldn't be reached lol.
Posted by Info232, 05-30-2013, 09:56 AM What a shame this happened. I have a friend who has space there and he was in the same boat.
Considering the cost of locating in an Equinix facility one wouldnt expect any downtime, much less this many in such a short time.
I hope everyone is back up by now.
Posted by stevendbrady, 05-30-2013, 10:43 AM
Posted by lionlink-dot-net, 05-30-2013, 10:44 AM
Posted by MMmmGood, 05-30-2013, 10:44 AM
Regarding management - when a manager (and furthermore, the CTO) lies to you about why your services are offline, yes I believe the management is incompetent.
Also, the last time I checked Virtacore/PowerVPS was a multi-homed provider with several bandwidth providers. If a single provider was able to knock the entire network / services / servers offline for 13 hours, what does that tell you about their engineering department? If in fact they only have ONE provider for bandwidth, then they are lying as well.
That's just my take on it.
Posted by lionlink-dot-net, 05-30-2013, 10:46 AM
Posted by MMmmGood, 05-30-2013, 10:48 AM
Has anyone gotten any additional information as to what happened? As lionlink pointed out, nothing has been said on their network status page or twitter feed for almost 19 hours.
Posted by PersonalJ, 05-30-2013, 11:19 AM
Also time to make appropriate plan b's.
Posted by AlessioIT, 05-30-2013, 11:37 AM
Posted by PersonalJ, 05-30-2013, 11:43 AM
Posted by AlessioIT, 05-30-2013, 11:48 AM
Posted by mediagirlnm, 05-30-2013, 12:33 PM With this new info coming out that the outage was caused by an unscheduled equipment move, has anyone been offered compensation for the outage? Has anyone contacted a lawyer?
Posted by Wolf1, 05-30-2013, 12:42 PM
Posted by Virtacore, 05-30-2013, 12:44 PM To our valued customers:
Virtacore would like to apologize for what happened during the outage period that began in the morning of May 29, 2013.
Yesterday, our Tier 1 upstream network provider, which provides public routing to the Virtacore network, experienced problems with routing IP addresses. They experienced a routing loop which prevented network traffic from getting through the upstream provider network. Our engineers discovered the issue and immediately notified our provider of the issue. The issue impacted some of our Hosting and PowerVPS customers. Virtacores private cloud services were not impacted as they reside on a separate network. Our redundant network provider, was not able to route the impacted IP addresses as the Tier 1 upstream provider has priority and pulled all network traffic back onto its network.
We worked closely with them to isolate and resolve the primary issue so that traffic could then resume to our data centers. At no time during this event was any of the data or systems compromised or in jeopardy.
As with all cloud providers, Virtacore is not immune to internet outages.
We thank all of our customers for their understanding of this 3rd party provider issue. We regret any inconvenience this may have caused.
Posted by mediagirlnm, 05-30-2013, 12:47 PM I'm referring to posts in this thread by folks near the facily who've indicated there was an equipment move. I was also contact by a couple people offline who said equipment was moved which started the issues.
This hasn't been communicated by Virtacore though and isn't anything I can concretely substantiate yet.
Posted by MMmmGood, 05-30-2013, 12:59 PM
This hasn't been communicated by Virtacore though and isn't anything I can concretely substantiate yet.
My favorite is the last line:See! It's okay because others have problems too!Quote:
As with all cloud providers, Virtacore is not immune to internet outages.
Posted by mediagirlnm, 05-30-2013, 01:14 PM I was contacted yesterday by the CTO of a hosting company I have enormous respect for and who knows his ****... after reading the official status updates he felt something else was going on that wasn't being communicated. Enough so that he took the time to contact me directly to let me know... I'm not technical enough to know either way frankly but this is a guy who I feel would know if anyone would.
**** happens. I know that more than anyone. I can't say for certain if there is deception going on here... but I do feel that there is more to the story and I'm sorry we can't be trusted enough to hear it. I have many many years of loyalty to this company as do many posting on this thread. Loyal customers can handle a lot if everything is clearly on the table without the ********.
Posted by MMmmGood, 05-30-2013, 01:18 PM
I'd link to some Netflix/Amazon RFOs but apparently I need more posts. Those statements are multi-page, highly detailed with timestamps, explaining what actually happened and when, what actions were taken during the event, and what is being done to make sure it never happens again.
Posted by d0nt, 05-30-2013, 01:18 PM
Virtacore would like to apologize for what happened during the outage period that began in the morning of May 29, 2013.
Yesterday, our Tier 1 upstream network provider, which provides public routing to the Virtacore network, experienced problems with routing IP addresses. They experienced a routing loop which prevented network traffic from getting through the upstream provider network. Our engineers discovered the issue and immediately notified our provider of the issue. The issue impacted some of our Hosting and PowerVPS customers. Virtacore’s private cloud services were not impacted as they reside on a separate network. Our redundant network provider, was not able to route the impacted IP addresses as the Tier 1 upstream provider has priority and pulled all network traffic back onto its network.
We worked closely with them to isolate and resolve the primary issue so that traffic could then resume to our data centers. At no time during this event was any of the data or systems compromised or in jeopardy.
As with all cloud providers, Virtacore is not immune to internet outages.
We thank all of our customers for their understanding of this 3rd party provider issue. We regret any inconvenience this may have caused.
And one more thing, while I agree Virtacore is not immune to internet outages, had Virtacore taken the proper steps to ensure carrier redundancy, this would have not occurred -- at least that is the conclusion I come to when reading your "RFO".
Posted by AllenB, 05-30-2013, 01:43 PM Hello all,
Oye, what a rough couple of days. Nice to learn though that Tequila does mix w/ Cabernet when needed.
I’ve been with DTG since 2004 and have more than a few servers and appliances colocated w/ them. The number increases every year and lately every month. DTG built a solid reputation that is not easy to come by in the industry. IMHO, that came about due to their dedication which then produces good infrastructure, services and support. I cannot talk highly enough re their service and their support teams (how did y’all forget Pooja and lately Patty, Robert and Joe?). No worries though as I’ve forgotten to mention some as well – My apologies DTG folks and too busy today (and forgetful) to list them all. I’ll remain a client though also definitely recognizing and planning re the recent issues. Should incidents and poor handling of them continue, well…
This has been a rough year for me and those clients that I have utilizing DTG in Equinix VA. The two previous migrations were a debacle and almost inexcusable re the short notices given. Was I upset? Yes. Were some of my clients livid? Yes. However, there are (and have been) some pretty good clues (some good ones in this thread) that helped me to realize what was happening and what they are going through. When I dealt w/ Tom, Rob and others at DTG it was a pleasure not only on the technical side, but also professionally. They were honest, ethical, a pleasure and a breath of fresh air compared to most I deal with in the services and support arena. IMHO, they built and managed a fairly complicated infrastructure to support the thousands and probably tens of thousands of VMs that I believe they had when they sold the company. I’m not that happy w/ everything that has happened since then, but I can realize how much work it would be to come in and manage an infrastructure like that. Perhaps, not an easy task even when there is not a management and engineering staff change. Especially given the pace at which the industry moves. Kudos perhaps, to the current team for keeping it up and growing while deciphering the complexity.
I agree that their management needs to start doing some things better and some things differently. I did not like what I saw w/ the last two migrations. Communicating issues (let’s not even mention the timely migration notices) w/ their clients needs vast improvement. Once I move up the ladder this communication seems to falter some. Given that though, I reached out to their CTO yesterday morning at approximately 7:00AM EST (UT-5) and he made himself available to discuss this. Could the talk have gone better? Yes, but it says a lot to me when their senior management will talk w/ a small-fry like me at 7:00AM in the morning.
I am not “happy”, but I am not leaving yet either. This, IMHO, is a timely test to see if they step up to the bat and right some of the wrongs that they have struggled with of late. If I do decide to leave, it will be after careful consideration and planning as I believe I do a disservice to my clients should I get upset and leave without thorough research and a good plan. Things have been rocky of late. Let me now see how things may change and what the near future brings. I would like to see better communications w/ their clients. I would like to see better notices when things go wrong (they always do, IMHO, when complex systems and or humans are involved). My clients realize things can/will go wrong because I emphasize the difficulty (impossibility?) of 100% uptime. I believe and stress that it is as important how things are then handled vs. what just went wrong. This current issue was not handled the best, but I will give them some leeway in hopes of seeing some changes (and some money back now LOL) being implemented and better communications when issues occur. Perhaps they start w/ this one…
Best wishes,
Posted by d0nt, 05-30-2013, 01:58 PM
Oye, what a rough couple of days. Nice to learn though that Tequila does mix w/ Cabernet when needed.
Ive been with DTG since 2004 and have more than a few servers and appliances colocated w/ them. The number increases every year and lately every month. DTG built a solid reputation that is not easy to come by in the industry. IMHO, that came about due to their dedication which then produces good infrastructure, services and support. I cannot talk highly enough re their service and their support teams (how did yall forget Pooja and lately Patty, Robert and Joe?). No worries though as Ive forgotten to mention some as well My apologies DTG folks and too busy today (and forgetful) to list them all. Ill remain a client though also definitely recognizing and planning re the recent issues. Should incidents and poor handling of them continue, well
This has been a rough year for me and those clients that I have utilizing DTG in Equinix VA. The two previous migrations were a debacle and almost inexcusable re the short notices given. Was I upset? Yes. Were some of my clients livid? Yes. However, there are (and have been) some pretty good clues (some good ones in this thread) that helped me to realize what was happening and what they are going through. When I dealt w/ Tom, Rob and others at DTG it was a pleasure not only on the technical side, but also professionally. They were honest, ethical, a pleasure and a breath of fresh air compared to most I deal with in the services and support arena. IMHO, they built and managed a fairly complicated infrastructure to support the thousands and probably tens of thousands of VMs that I believe they had when they sold the company. Im not that happy w/ everything that has happened since then, but I can realize how much work it would be to come in and manage an infrastructure like that. Perhaps, not an easy task even when there is not a management and engineering staff change. Especially given the pace at which the industry moves. Kudos perhaps, to the current team for keeping it up and growing while deciphering the complexity.
I agree that their management needs to start doing some things better and some things differently. I did not like what I saw w/ the last two migrations. Communicating issues (lets not even mention the timely migration notices) w/ their clients needs vast improvement. Once I move up the ladder this communication seems to falter some. Given that though, I reached out to their CTO yesterday morning at approximately 7:00AM EST (UT-5) and he made himself available to discuss this. Could the talk have gone better? Yes, but it says a lot to me when their senior management will talk w/ a small-fry like me at 7:00AM in the morning.
I am not happy, but I am not leaving yet either. This, IMHO, is a timely test to see if they step up to the bat and right some of the wrongs that they have struggled with of late. If I do decide to leave, it will be after careful consideration and planning as I believe I do a disservice to my clients should I get upset and leave without thorough research and a good plan. Things have been rocky of late. Let me now see how things may change and what the near future brings. I would like to see better communications w/ their clients. I would like to see better notices when things go wrong (they always do, IMHO, when complex systems and or humans are involved). My clients realize things can/will go wrong because I emphasize the difficulty (impossibility?) of 100% uptime. I believe and stress that it is more important how things are then handled vs. what just went wrong. This current issue was not handled the best, but I will give them some leeway in hopes of seeing some changes (and some money back now LOL) being implemented and better communications when issues occur. Perhaps they start w/ this one
Best wishes,
DTG was built on a solid foundation that is dwindling very quickly. There network used to be solid -- optimized by FCP Appliances, multiple carriers like nLayer, PCCW, Cogent, ServerCentral, Hurricaine, etc. But now, they decided that it would be better to just have Cogent and Sidera -- and from what I can tell, in a type of active/passive configuration.
Based on what little information Virtacore is providing, it seems as though that this issued could have been mitigated simply by shutting down their session with Cogent and routing via alternate providers -- but that relies on them having alternate providers available. The excuse of oh well the Tier 1 takes priority and that was the problem is incorrect. If you shutdown the session with Cogent then traffic is not flowing through them anymore. So now the question is, were they concerned about a capacity issue by moving traffic over solely to Sidera?
ht_tp://bgp.he.net/AS14383
Posted by Rocket17, 05-30-2013, 03:14 PM
Posted by MMmmGood, 05-30-2013, 03:53 PM
Is that what all those outages were last year?
Posted by Rocket17, 05-30-2013, 04:11 PM
Is that what all those outages were last year?
Posted by Wolf1, 05-30-2013, 04:16 PM
WTF is going on there? Sounds like it is coming apart at the seams. Yesterday sounds like a failure of the highest level. You couldn't simply reroute traffic? A poor design, or no other provider to route over to? And a middle of the business day move a month ago was a "good idea" in the company's opinion.
Posted by MMmmGood, 05-30-2013, 04:21 PM
As AllenB said, I just hope we get a little bit more detail as to what is being done to prevent this in the future.
Posted by roger_s, 05-30-2013, 05:44 PM Is there anyone else still suffering from the outage, or am I the only one? Each time I ask for an update, the response is along the lines of "our operations team is actively working on fixing the problem".
My IP is in the 74.200.69.x range.
Regards,
Roger
Posted by mediagirlnm, 05-30-2013, 05:47 PM Holy crap! You're still down!
I'm up on all 3 servers here. Are you able to SSH to the server at all?Quote:
My IP is in the 74.200.69.x range.
Regards,
Roger
Posted by Daniel.L, 05-30-2013, 06:02 PM
This includes myself, Tom and Rob Y, etc who have been gone from Virtacore since 2012 (Tom left in mid/late 2011 if my memory serves me right, I left in early 2012, and Rob left shortly after).
I felt bad reading this thread and hope things get better.
Posted by roger_s, 05-30-2013, 06:06 PM
I'm up on all 3 servers here. Are you able to SSH to the server at all?
Posted by mediagirlnm, 05-30-2013, 06:09 PM Want me to try from this end? feel free to email me... anna (at) mediagirl (dot) com. Quote:
Posted by AlessioIT, 05-30-2013, 06:46 PM
Roger
Posted by slowmail, 05-30-2013, 06:55 PM
Posted by Aeronautic, 05-30-2013, 06:55 PM
This includes myself, Tom and Rob Y, etc who have been gone from Virtacore since 2012 (Tom left in mid/late 2011 if my memory serves me right, I left in early 2012, and Rob left shortly after).
I felt bad reading this thread and hope things get better.
Posted by slowmail, 05-30-2013, 06:57 PM
Posted by Daniel.L, 05-30-2013, 07:20 PM
Posted by winger, 05-30-2013, 08:17 PM
This includes myself, Tom and Rob Y, etc who have been gone from Virtacore since 2012 (Tom left in mid/late 2011 if my memory serves me right, I left in early 2012, and Rob left shortly after).
I felt bad reading this thread and hope things get better.
Posted by AlessioIT, 05-30-2013, 11:39 PM Hello, I'm trying to migrate some of my domains from PowerVPS, but I'm an old customer and some of my domains are still managed in the old control panel ( deftechgroup.com/billing )... the problem is that I can't do nothing, if I try to change my nameservers and insert my new ip adresses I only receive errors or the page simply won't load.
If I click for making a support ticket I have errors again, so I can't do nothing.
Any suggestions?
Thanks.
Posted by Daniel.L, 05-30-2013, 11:47 PM
If I click for making a support ticket I have errors again, so I can't do nothing.
Any suggestions?
Thanks.
Make sure to indicate you are on the "legacy" billing system. Hope they can take care of you.
Posted by AlessioIT, 05-31-2013, 12:14 AM Hello Daniel, thanks :-) nice to see you again , I also miss Robert... you guys were a great team
Posted by roger_s, 05-31-2013, 08:04 AM
Posted by AlessioIT, 05-31-2013, 08:49 AM
AlessioIT, try emailing billing@powervps.com or opening a "Billing" ticket through the helpdesk at [....
Make sure to indicate you are on the "legacy" billing system. Hope they can take care of you.
Posted by jackkros, 05-31-2013, 09:29 AM
Posted by Aeronautic, 05-31-2013, 10:37 AM
contact.management AT powervps.com
Of course, remove the AT and replace with @ and put it all together.
On a related note, the "News" blog post that had the status notes - until they stopped them - has been removed and replaced (re-write history shall we?) with the RFO post that blames the upstream:That's just a partial quote. Beyond the hard to read punctuation, as others have noted in this thread, I don't comprehend how they could not - or did not - turn off the session with this unnamed Tier 1 provider. In other places they blame Cogent. I put it to them on Twitter - copying Cogent - that Cogent's status said all was well at the time of the outage.Quote:
Our redundant network provider, was not able to route the impacted IP addresses as the Tier 1 upstream provider has priority and pulled all network traffic back onto its network.
Both Cogent and Virtacore ignored me.
Given the level of technical expertise in this forum, and how much interest there is in this issue based on the view count, I suggest Virtacore, if it values its reputation at all, get back in this thread and engage us with a detailed explanation and answer questions posed in equal detail.
Posted by tgraphics, 05-31-2013, 10:46 AM I signed up for Futurehosting yesterday(about a $220/month package) -- slightly better specs than what I have at PVPS -- but I ran into a problem already.
I won't get into the details about the quality of the server, but let's just say that I'm not impressed with the performance. (very slow compared to PVPS)
Anyway, I host quite a few websites, and separating my clients by IP address is important for a lot of reasons. But at Futurehosting, they only provide a single IP address for your entire server, and they make it very difficult to add more.
Here is what they told me a few minutes ago:They should have mentioned that during the order process. Oh well. I have already canceled service and a refund is on the way.Quote:
Thank you for contacting us. We have received your request for an additional IP address. We understand that you may have previously been able to receive IPs generally without much effort; however, as the IPv4 pool is nearly depleted, we are required to collect additional information regarding your IP request usage by ARIN and RIPE.
At this time, we are only allowed to allocate IPs for technical reasons that require the use of a dedicated IP address such as for an SSL Certificate.
If this is an IP for SSL purposes, please note that we allocate IPs only for domains that have a SSL certificate already issued. If you have one, please let us know and the domain associated so we can move forward with your IP request.
Also, please confirm you understand that additional IP addresses are $2.00/mo/IP.
We thank you for your cooperation in this matter.
Thank you,
Moe
Just thought you guys might like to know!
Posted by AlessioIT, 05-31-2013, 10:58 AM
contact.management AT powervps.com
Of course, remove the AT and replace with @ and put it all together.
...
Posted by AlessioIT, 05-31-2013, 11:06 AM
If you need more than 8 ip adressess I think you will run in the same problems at futurehosting, from my control panel I can only buy 8 ip adresses.
Posted by Aeronautic, 05-31-2013, 11:10 AM @AlessioIT
My pleasure - I'm sorry for the trouble you continue to have.
I've just replied to one of ticket-related e-mails and asked them to get back in this thread and provide a full and detailed explanation.
I'm not holding my breath.
Hopefully it will bring your plight to their attention such that they will at least help you.
Posted by tgraphics, 05-31-2013, 11:54 AM
If you need more than 8 ip adressess I think you will run in the same problems at futurehosting, from my control panel I can only buy 8 ip adresses.
Posted by HalfDollarHosting, 05-31-2013, 11:57 AM
If you need more than 8 ip adressess I think you will run in the same problems at futurehosting, from my control panel I can only buy 8 ip adresses.
p.s. LW choice is nice!
Posted by tgraphics, 05-31-2013, 12:08 PM
p.s. LW choice is nice!
It's tough to stay on top of this kind of thing (especially when some clients have low budgets and don't want to upgrade Joomla 1.5 or w/e until after the damage has been done), so the best way I found to limit collateral damage is to keep everyone on their own IP, then I only have to deal with 1 frustrated client at a time, rather than dozens. Know what I mean?
I'm open to suggestions!
Posted by vicjalan, 05-31-2013, 12:55 PM
I won't get into the details about the quality of the server, but let's just say that I'm not impressed with the performance. (very slow compared to PVPS)
Anyway, I host quite a few websites, and separating my clients by IP address is important for a lot of reasons. But at Futurehosting, they only provide a single IP address for your entire server, and they make it very difficult to add more.
Here is what they told me a few minutes ago:
They should have mentioned that during the order process. Oh well. I have already canceled service and a refund is on the way.
Just thought you guys might like to know!
futurehosting.com/legal/ip-address-policy/
Luckily for me I don't need more than 1 IP for that account so I'm fine.
Posted by tgraphics, 05-31-2013, 01:02 PM
futurehosting.com/legal/ip-address-policy/
Luckily for me I don't need more than 1 IP for that account so I'm fine.
Good to know. Thanks!
Posted by roger_s, 05-31-2013, 06:31 PM
Posted by AlessioIT, 05-31-2013, 08:27 PM
Posted by dcsit, 06-06-2013, 02:53 PM Any one else?
I started a new thread called: Some servers unreachable on PowerVPS again!
Sorry no link, the forum won't let me post links yet.
Posted by mblendinger, 08-20-2013, 09:19 AM Hello, it's all down for you too right now ? I can't reach vps servers nor the powervps website.
Posted by dcsit, 08-20-2013, 11:22 AM Yep down again for almost apx. 25 minutes, starting just after 09:00 EDT. Legacy and new VPSs were down. No sign of a reboot from inside the VM. Disappointing for sure Quote:
Posted by getronic, 10-18-2013, 09:28 AM Does anyone else have new issues? All our VPSs are not accessible.
Posted by hostingvince, 10-18-2013, 10:04 AM yep, up and down for last 3 hours!
:-(
Posted by aww, 10-19-2013, 03:40 AM Down again?
Posted by andyforkgen, 10-19-2013, 03:56 AM Yes, we also had about an hour of downtime on our vps yesterday too - was discussed in a separate thread.
Posted by hostingvince, 10-19-2013, 04:58 AM seems to be happening again this morning :-(
Posted by RofyHost, 10-19-2013, 05:12 AM same here, all my vps are down
Posted by Ulysses, 10-19-2013, 05:47 AM All down here again too.
Where are they posting updates to?
Posted by fandoms, 10-19-2013, 06:30 AM My site is up just now!
Posted by andyforkgen, 10-19-2013, 06:33 AM They never post updates, all we get is the updates from the support desk once we post a ticket - pretty ineffective.
Posted by andyforkgen, 11-15-2013, 02:36 AM PowerVPS down yet again - mutiple VPSs it seems. Anyone else?
Cheers, Andy.
Posted by dcsit, 11-15-2013, 02:38 AM
Cheers, Andy.
Posted by andyforkgen, 11-15-2013, 02:48 AM Thanks, will check it out and move to that thread (y)
Posted by hostingvince, 11-15-2013, 04:40 AM Here we go again.
Almost 4 hours, you'd think they would have noticed and updated us by now?
:-(
Posted by vc293, 11-15-2013, 11:11 PM Sorry for the cross-post, hopefully you will understand. This was written in response to the other thread about today's downtime causing customers to look elsewhere....
This is going to be hard for me to ask, and I am fully prepared for the deservedly harsh response but...I hope that you will reconsider, or at least give us another chance.
Why?
Because we are truly actively trying to change and improve all aspects of the all of the PowerVPS service. These changes started with my recent arrival, and as much as I know you are going to want to hold me accountable for the downtime and terrible (non-existent) communication over the past year, I cannot do anything but apologize on my predecessor's behalf and tell you that I can only move this business forward.
Let's start with today. Today's downtime was a result of a DDoS attack. Not just any DDoS attack, this one was special. I cannot go into details, but I can say that there were companies that specialize in DDoS mitigation that were severely challenged. This wasn't just us. I think that you can all understand that this is an inherent risk due to the nature of the VPS business and that we should have been able to mitigate this faster - you are correct. Those changes are in process but they are not overnight successes. It will take some time. I can tell you that our response to these types of attacks will be far more rapid than even in the past few weeks.
Communication. Lack of it. This will end too. We will be better about communicating via support, Twitter, and this forum. Again, moving forward.
Nobody understands the cost of downtime better than me. I understand that you will feel the need to do what you have to do to protect your businesses, but I can assure you that if you will give us a chance we will right the wrongs and improve the issues from the past year. If not, I wish you the best and understand.
Posted by icarus2004, 11-17-2013, 11:28 AM First of all, could you place a name on that post? Since You are talking in fist person but no name is attached.
I'm being customer for almost 9 years, and have no problem to give you another chance. Mostly because in all these years, the problems only arise in the past year. Yes big problems, a lot of downtime, buy only in Ashburn datacenter. Chicago facility where I have a couple VPS never had a problem. (knock on wood for that ...). So, if a new guy is in charge and offers me to solve this issues, I'll give you that chance.
I hope communication really improves, mostly because we are providers too, and our clients collapse our phone/cell lines and we don't have answers for them.
Thanks for your sincerity and hope PowerVPS recover the reliability used to have.
Gustavo
Posted by jackkros, 11-26-2013, 10:40 PM Well folks here we go again...we're down about 3 hours now. Looks like the Powervps website is down as well.
Posted by vc293, 11-26-2013, 10:42 PM
Posted by jackkros, 11-26-2013, 10:48 PM Yes, you are correct the problem is on my end somewhere. I cannot log on to powervpsdotcom, or connect to any of our sites or cp. The only way I managed to do it now is via tor. Anyhow FALSEALARM, sorry guys.
Add to Favourites 
Print this Article
Also Read
