Portal Home > Knowledgebase > Industry Announcements > Web Hosting Main Forums > Providers and Network Outages and Updates > EZPZ down and looking like it is staying down
EZPZ down and looking like it is staying down
| Posted by avantRS, 10-27-2010, 04:19 AM |
Has anyone else noticed that node2 of the provider EZPZ Hosting is down and has been down for more than nine hours now? What worries me and gives me the sinking feeling is that the status page says it has been down for 6h44m as of this moment 9.15am UK local time. I know this to be untrue as my first support ticket regarding this was at 23.53 last night, UK local time.
This tells me that the system was recovered and back up about 2.00am then went back down again. This is never a good sign and usually - in my experience anyway - means hardware failure:-((
Does anyone know if it is a routing problem? |
| Posted by Dan_EZPZ, 10-27-2010, 04:20 AM |
Hi avantRS,
We've posted the full details on the outage here: https://clients.ezpzhosting.co.uk/networkissues.php
This is only affecting a small number of VPS customers and we should have it back online very shortly.
Dan |
| Posted by avantRS, 10-27-2010, 04:33 AM |
"This is only affecting a small number of VPS customers and we should have it back online very shortly."
This is exactly the same reply I got at one a.m. local time, eight hours ago. Good job I caught a few hours sleep!
I don't mind a response that is vague, - when they work computers will split the atom, when they break it is sorcery - but i don't care for vague accuracy.
graham. |
| Posted by wlsiew, 10-27-2010, 05:41 AM |
Their website is up and my site is up with EZPZ  |
| Posted by Jennifer Robinson, 10-27-2010, 06:06 AM |
|
Sometimes technical issues do take longer than expected to get resolved and fixed... So probably the best deal as of now for you is to be patient and wait for your host to get your node up... Good luck.. |
| Posted by avantRS, 10-27-2010, 07:28 AM |
"online very shortly"
"shortly" applies to a better interest rate, the second coming of Christ and my missus getting ready to go out. Used in the context of server outage it is just unneccesary precision.
graham.
(you guessed it. still down!) |
| Posted by MikeDVB, 10-27-2010, 08:33 AM |
Quote:
|
Originally Posted by avantRS
"online very shortly"
"shortly" applies to a better interest rate, the second coming of Christ and my missus getting ready to go out. Used in the context of server outage it is just unneccesary precision.
graham.
(you guessed it. still down!)
|
From what I understand in speaking with Dan is that the server's file system went read-only and the server has been running file system checks all night. It's apparently taking multiple passes to clean the file system. I mean, they could have brought it back online for you in a jiffy but chances are that it would have gone read-only on you again in short order and you wouldn't have been able to write anything and most services wouldn't have worked (as most require the ability to write).
My advice is to give them some time to fix the issue. |
| Posted by kimper, 10-27-2010, 09:42 AM |
I know that is not easy to affirme but we have to say it : What kind of service do you expect from a webhost that can provide a VPS at 9.99 $ ?
I am not 100 % sure but I can confirm that they are overselling VPS's on one single machine or two... |
| Posted by Dan_EZPZ, 10-27-2010, 09:51 AM |
A £9.99 VPS isn't cheap when you consider some of the hosts in the offers section - the nodes are not oversold and we have several high end machines.
We're working as quickly as we can to bring it all back online I can assure you. Updates are still being posted to the network issues of our website and SLA credit is already being added. |
| Posted by avantRS, 10-27-2010, 09:54 AM |
Quote:
|
Originally Posted by MikeDVB
From what I understand in speaking with Dan is that the server's file system went read-only and the server has been running file system checks all night. It's apparently taking multiple passes to clean the file system. I mean, they could have brought it back online for you in a jiffy but chances are that it would have gone read-only on you again in short order and you wouldn't have been able to write anything and most services wouldn't have worked (as most require the ability to write).
My advice is to give them some time to fix the issue.
|
Time, at this moment, on those domains, is something in very short supply. I have lost two whole days now and Dan is probably excruciatingly aware that I was not best please with the level of service as of yesterday morning. I probably have the biggest reason to scream the block down off the back of that experience alone, never mind the 13+ hours without email or hosting.
It is words like "soon" "shortly" "small number" the latter being the most odious, as if the "small number" - me in this instance - is just insignificant. A negligable faction. Let's see how insignificant we are when the account is left unpaid. I would bet the farm we would garner some real attention.
Quote:
I know that is not easy to affirme but we have to say it : What kind of service do you expect from a webhost that can provide a VPS at 9.99 $ ?
I am not 100 % sure but I can confirm that they are overselling VPS's on one single machine or two...
|
My monthly bill is substantially more than $9.99
graham. |
| Posted by kimper, 10-27-2010, 09:58 AM |
Quote:
|
Originally Posted by Dan_EZPZ
A £9.99 VPS isn't cheap when you consider some of the hosts in the offers section - the nodes are not oversold and we have several high end machines.
We're working as quickly as we can to bring it all back online I can assure you. Updates are still being posted to the network issues of our website and SLA credit is already being added.
|
Ok sir. Since your network issues page is not available to the public, please explain us what happened to your servers to be unavailable for more than 13 hours. |
| Posted by XTremo, 10-27-2010, 10:17 AM |
Quote:
|
Originally Posted by kimper
I am not 100 % sure but I can confirm that they are overselling VPS's on one single machine or two...
|
On what do you base that assumption? Are you a client of theirs? |
| Posted by kimper, 10-27-2010, 10:20 AM |
On the fact that they are reselling racksrv.com solutions. And I found many posts about racksrv.com on other forums where users confirm that.
Anyway, i said it : I'm not 100% sure. |
| Posted by avantRS, 10-27-2010, 10:21 AM |
Quote:
|
Originally Posted by kimper
Ok sir. Since your network issues page is not available to the public, please explain us what happened to your servers to be unavailable for more than 13 hours.
|
Let me tell you something. I am not, by the wildest stretch of the imagination, a software Guru. But, and this is a big But, there is no hardware I cannot fix/have had experience of - and in my experience, at this level of corruption, there is a disk failure - a hardware failure. I would dearly like to know what the server config is and how big the drives are. We are going to be here all night and at the end of the day, we are restoring backups:-(
Who is going to take my bet?
graham. |
| Posted by XTremo, 10-27-2010, 10:26 AM |
Quote:
|
Originally Posted by kimper
On the fact that they are reselling racksrv.com solutions. And I found many posts about racksrv.com on other forums where users confirm that.
Anyway, i said it : I'm not 100% sure.
|
You said.....I am not 100 % sure but I can confirm that they are overselling VPS's on one single machine or two.
You're not 100% sure.....but you can confirm? That makes no sense....if you're not sure then you can't confirm anything.
And how do you know for sure the server is in racksrv.....you do know they have other locations don't you? And even if it was with racksrv....how does that mean it's oversold? |
| Posted by Dan_EZPZ, 10-27-2010, 11:18 AM |
Quote:
|
Originally Posted by kimper
On the fact that they are reselling racksrv.com solutions. And I found many posts about racksrv.com on other forums where users confirm that.
Anyway, i said it : I'm not 100% sure.
|
Incorrect. It's colocated hardware.
Our priority at the moment is getting everyone online. A full RFO will be issued as soon as we're back and stable. |
| Posted by target, 10-27-2010, 12:58 PM |
Quote:
|
Originally Posted by kimper
I know that is not easy to affirme but we have to say it : What kind of service do you expect from a webhost that can provide a VPS at 9.99 $ ?
I am not 100 % sure but I can confirm that they are overselling VPS's on one single machine or two...
|
A lot of hosters are offering them at these prices (and even lower). Post something when u are sure, in stead of making things up. |
| Posted by [x10]Corey, 10-27-2010, 01:02 PM |
Quote:
|
Originally Posted by avantRS
Let me tell you something. I am not, by the wildest stretch of the imagination, a software Guru. But, and this is a big But, there is no hardware I cannot fix/have had experience of - and in my experience, at this level of corruption, there is a disk failure - a hardware failure. I would dearly like to know what the server config is and how big the drives are. We are going to be here all night and at the end of the day, we are restoring backups:-(
Who is going to take my bet?
graham.
|
Just wanted to say that I've had a server take 6 hours+ to come back online before after 3 passes, no one lost any files but we did end up replacing the drives. I wouldn't lose hope yet 
With the higher end hardware generally you have more people per node which means more files to scan when problems like this happen. |
| Posted by igrove, 10-27-2010, 01:21 PM |
|
Faulty Raid Controller apparently. |
| Posted by avantRS, 10-27-2010, 03:21 PM |
TWENTY ONE HOURS - and counting.
I am very, very unhappy. The Frankfurt 30 hour outage made BIG news, because there were enough people hooting. Right now I have nothing better to do except shout and holler. My problem is that i MUST travel tomorrow so whatever my decision it has to be now - plus I get the treat of working late into the night or staying up late worrying myself sick that the email is going to be down for another protracted period. Of COURSE i have a backup email address but what do you want me to do, get EVERYONE to start emailing me on it to conduct business?
Given the circumstances I believe I am showing admirable restraint. What I really want to know though is: Is it "soon" yet?
graham. |
| Posted by target, 10-27-2010, 03:29 PM |
Quote:
|
Originally Posted by avantRS
TWENTY ONE HOURS - and counting.
I am very, very unhappy. The Frankfurt 30 hour outage made BIG news, because there were enough people hooting. Right now I have nothing better to do except shout and holler. My problem is that i MUST travel tomorrow so whatever my decision it has to be now - plus I get the treat of working late into the night or staying up late worrying myself sick that the email is going to be down for another protracted period. Of COURSE i have a backup email address but what do you want me to do, get EVERYONE to start emailing me on it to conduct business?
Given the circumstances I believe I am showing admirable restraint. What I really want to know though is: Is it "soon" yet?
graham.
|
I agree with u on the fact that when a site is down for more than twenty hours u should get more information about the status.
I am sure they are working on it .. but when there is a downtime that takes so long u should get informed every 2 hours. This way u get understanding customers in stead of frustated people. |
| Posted by MikeDVB, 10-27-2010, 03:32 PM |
EZPZ is already aware of the issue and they've let you know they're working on it. What exactly is your goal by continuing to complain here? I'm not saying you can't, I'm just wondering why? It's not going to make anything happen any faster - if it did... we'd all be complaining all the time
Edit: I just spoke with Dan and all current clients facing the issue are being updated via email, via support tickets that have been opened, and the network status page. If you can't see the network status page or you're not getting these communications then you're either not a client - or you need to get in touch with support to make sure your email address on file is accurate.
Dan told me that the raid controller actually was faulty and corrupted the data on the hard drives - the data is being restored from an R1Soft Backup point and to be honest anybody complaining at this point (in my honest opinion) should stop and just thank their lucky stars that EZPZ pays out of their pocket to back up VPS nodes. I've seen similar things happen to dozens of providers where there were no backups and all data was lost and nothing could be done to recover it.
I'm sure those of you that love to complain, will still continue to do so. I know it's not a good situation but it can happen to any provider, luckily EZPZ has backups of the server.
Ultimately if you cannot stand to have any sort of downtime whatsoever you should look into getting at least a pair of dedicated servers in two separate facilities and setting up some sort of DNS Load Balancing. Even on an expensive VPS, things like this can and ultimately will still happen. It's not a question of if but when and it doesn't matter who the provider is.
Good luck. |
| Posted by CraigMesser, 10-27-2010, 03:39 PM |
|
Showing as up on their service status page. Is it back up now? |
| Posted by MikeDVB, 10-27-2010, 03:51 PM |
Quote:
|
Originally Posted by CraigMesser
Showing as up on their service status page. Is it back up now?
|
The server is online however it's being restored via R1Soft. |
| Posted by Yujin, 10-27-2010, 03:55 PM |
Quote:
|
Originally Posted by MikeDVB
EZPZ is already aware of the issue and they've let you know they're working on it. What exactly is your goal by continuing to complain here? I'm not saying you can't, I'm just wondering why? It's not going to make anything happen any faster - if it did... we'd all be complaining all the time
Edit: I just spoke with Dan and all current clients facing the issue are being updated via email, via support tickets that have been opened, and the network status page. If you can't see the network status page or you're not getting these communications then you're either not a client - or you need to get in touch with support to make sure your email address on file is accurate.
Dan told me that the raid controller actually was faulty and corrupted the data on the hard drives - the data is being restored from an R1Soft Backup point and to be honest anybody complaining at this point (in my honest opinion) should stop and just thank their lucky stars that EZPZ pays out of their pocket to back up VPS nodes. I've seen similar things happen to dozens of providers where there were no backups and all data was lost and nothing could be done to recover it.
I'm sure those of you that love to complain, will still continue to do so. I know it's not a good situation but it can happen to any provider, luckily EZPZ has backups of the server. Ultimately if you cannot stand to have any sort of downtime whatsoever you should look into getting at least a pair of dedicated servers in two separate facilities and setting up some sort of DNS Load Balancing. Even on an expensive VPS, things like this can and ultimately will still happen. It's not a question of if but when and it doesn't matter who the provider is.
Good luck. |
Just want to chime...
Mike don't consider all the post here as complain.
These guys are paying customer with clients and/or business (maybe).
These guys are frustrated and what they are expecting is some update from EZPZ.
I saw K-Disk and Semoweb on this page updating their customer every now and then when they have issue on the service.
Now, it seems that you are the spokesperson of EZPZ then maybe you can update this thread from time to time since you can talk to Dan.
20-hours downtime is no joke and don't just suggest some dedicated server and load balancer stuff, since this is not a calming statement as a matter of fact this is like a sarcasm and you're like blaming the customer back for choosing this provider.
Just my 2 cents. |
| Posted by avantRS, 10-27-2010, 04:02 PM |
Quote:
|
Originally Posted by MikeDVB
EZPZ is already aware of the issue and they've let you know they're working on it. What exactly is your goal by continuing to complain here? I'm not saying you can't, I'm just wondering why? It's not going to make anything happen any faster - if it did... we'd all be complaining all the time
Edit: I just spoke with Dan and all current clients facing the issue are being updated via email, via support tickets that have been opened, and the network status page. If you can't see the network status page or you're not getting these communications then you're either not a client - or you need to get in touch with support to make sure your email address on file is accurate.
Good luck. |
I complain because i am REALLY ticked off with Dan and rather than drag the whole saga through the mud i shall email you privately.
I am NOT a serial complainer and actually i rarely complain and I am pretty pragmatic about things generally, sh*t happens.
However, I am a great beleiever in Karma and on this occassion, what goes around certainly came around.
I see that Dan may have quite possibly emailed everyone or - in between everything else - if I had a chance I could jump online and check the status - which indeed does actually say the server is back online.
However, none of my domains or control panel are accessible, so I am yet to recieve ANY emails!
I once lost data, it was Christmas Eve 1993 in Newcastle upon Tyne.
graham. |
| Posted by MikeDVB, 10-27-2010, 04:07 PM |
Quote:
|
Originally Posted by avantRS
I complain because i am REALLY ticked off with Dan and rather than drag the whole saga through the mud i shall email you privately.
|
You're welcome to discuss it with me in private if you wish. I've known Dan for quite some time and he's always put his customers first for as long as I've known him.
Quote:
|
Originally Posted by avantRS
I am NOT a serial complainer and actually i rarely complain and I am pretty pragmatic about things generally, sh*t happens.
|
I never said you were a serial complainer, just saying that complaining here isn't going to help anything. If EZPZ was not responding to tickets/emails and had appeared to "disappear" then I could definitely see complaining here but since their normal support systems are online and operational, I don't see the point in posting about it here.
Quote:
|
Originally Posted by avantRS
I see that Dan may have quite possibly emailed everyone or - in between everything else - if I had a chance I could jump online and check the status - which indeed does actually say the server is back online.
|
I can tell you for sure that he did email everybody and the status page is just the Pingdom monitoring of the server (to make sure it's online and alive) and is not actually monitoring whether individual VPSs are running or anything else for that matter. It's simply checking to see that the server is powered on and has networking. I can tell you that EZPZ does have internal monitoring set up that is more extensive from monitoring Load, CPU, MySQL Usage, Exim Queue, Disk I/O, Disk Usage, and possibly more as we've discussed it previously.
Quote:
|
Originally Posted by avantRS
However, none of my domains or control panel are accessible, so I am yet to recieve ANY emails!
|
Then you should put in a support ticket, it could be that your email address on file is not accurate or that perhaps your account wasn't marked as being on that server and as such you wouldn't get the notifications. It's not something I can help you with, but EZPZ certainly can.
Quote:
|
Originally Posted by avantRS
I once lost data, it was Christmas Eve 1993 in Newcastle upon Tyne.
|
Live and learn
Quote:
|
Originally Posted by Yujin
Mike don't consider all the post here as complain.
|
I didn't say they were all complaints, but complaining after Dan has come here and posted about the issue doesn't make much sense. It's not like he's going to say "Oh darn, they're posting on WHT so I better actually fix this now." Him and his staff are working on this and from talking to him I can tell you that he's stressed over this as well.
What people don't realize is that yes, your one VPS may be offline... But you have to look at it from Dan's perspective - he has MULTIPLE VPS offline, certainly with each one of those customers complaining and being upset. Yes, you may be making more money off of your VPS than Dan is making off of the node (potentially) if you've got a very profitable site but the point is that Dan/EZPZ are losing money over this as well. Ultimately if you're making enough money on your VPS to be extremely upset, you should have a backup/contingency plan just in case something happens like a hardware failure.
Quote:
|
Originally Posted by Yujin
These guys are frustrated and what they are expecting is some update from EZPZ.
|
They're getting updates if they are clients via the helpdesk, support tickets, and emails. If they're not getting this - then they need to open a ticket and 1) get those updates and 2) find out why they didn't get them via email already.
Quote:
|
Originally Posted by Yujin
I saw K-Disk and Semoweb on this page updating their customer every now and then when they have issue on the service.
|
What if these people were complaining on Twitter, Facebook, WHT, TheAdminZone, HostingDiscussion, and 5 other locations - do you expect Dan to visit ALL of those locations and keep ALL of them up to date? I certainly hope not... he'd have no time for anything else.
Personally I'd rather my provider disperse information in a centralized location such as their Network Status Page (which EZPZ is doing) and via email (which EZPZ is doing).
Quote:
|
Originally Posted by Yujin
Now, it seems that you are the spokesperson of EZPZ then maybe you can update this thread from time to time since you can talk to Dan.
|
I'm no spokesperson for EZPZ - I have just been in this exact same situation myself and I know exactly what the customers and Dan and the rest of EZPZ staff are going through. I've been on both sides of a hardware failure so I can definitely empathize with both. Since I do have communications with Dan and I had a good idea as to what was going on I wanted to correct some of the points made in this thread and make some new things clear.
Quote:
|
Originally Posted by Yujin
20-hours downtime is no joke and don't just suggest some dedicated server and load balancer stuff, since this is not a calming statement as a matter of fact this is like a sarcasm and you're like blaming the customer back for choosing this provider.
|
No, I'm not placing the blame anywhere. What I am saying is that if you cannot afford downtime then you cannot afford to not be on some sort of HA (High Availability) platform. What I said was not meant to be comforting, it's meant to be brutally honest. Again, I'm not a representative of EZPZ so this is just my personal opinion.
I've seen people complain that they're losing $1,000/hour when their $10/month web hosting account is offline and the same premise applies... If you stand to lose $1,000/hour due to downtime you should spend more than $10/month on your hosting. It's not about simply paying more - it's about getting the solution that best fits your needs.
Quote:
|
Originally Posted by Yujin
Just my 2 cents.
|
I consider my response about 5 cents... |
| Posted by avantRS, 10-27-2010, 04:12 PM |
Quote:
|
The server is online however it's being restored via R1Soft
|
Okay, I didn't see that and I apreciate the restore. I did not pay nor contract with EZPZ to backup my data so this is a thoughtful action.
Quote:
|
These guys are paying customer with clients and/or business (maybe).
|
Believe it or not, a COMPLAINT DEPARTMENT website has been down all of this time. Want to hear someone complain? I have heard - seen - it all. Do you have even the remotest idea of what is waiting on the North side of that domain coming back up?
I don't think you do.
graham. |
| Posted by Jon-RackSRV, 10-27-2010, 04:32 PM |
Quote:
|
Originally Posted by kimper
On the fact that they are reselling racksrv.com solutions.
|
This isn't a *fact* at all, Dan owns and operates his own hardware some of which is hosted from within our network. |
| Posted by target, 10-28-2010, 02:47 AM |
|
JUst curieus ... is everything working now ? |
| Posted by dezinerstudio, 10-28-2010, 03:49 AM |
|
any latest updates on how much exactly was the down time |
| Posted by avantRS, 10-28-2010, 03:53 AM |
Quote:
|
Originally Posted by target
JUst curieus ... is everything working now ?
|
Yes it is. Email started to come through about 4.00 am but slowly and right now it is slow logging on.
In Dan's defence nothing has been lost. (and in my case nor would it have been but i cannot speak for the other people affected so there will be a few relieved people).
As for total downtime, my ticket shows 11.53 pm that I filed my first ticket, It had been down a short while before that and it came back up about 11ish last night but not available until well into the nighy. Inaccessible for well over 24 hours
graham. |
| Posted by Gareth-HostRedDragon, 10-28-2010, 06:20 AM |
I am glad that everything is sorted now.
By the looks of it, I apologise if I got this wrong, you didn't receive the emails from ezpz until after your vps came back up? I would suggest using your backup email address for your contact info with ezpz in the future, that way you can receive the service information emails in the event of an outage.
Quote:
|
Originally Posted by kimper
I know that is not easy to affirme but we have to say it : What kind of service do you expect from a webhost that can provide a VPS at 9.99 $ ?
I am not 100 % sure but I can confirm that they are overselling VPS's on one single machine or two...
|
Perhaps you should learn to read?
Their cheapest vps is £9.99 ($15.81) not $9.99 |
| Posted by Dan_EZPZ, 10-28-2010, 07:52 AM |
Everything is indeed back online and we're testing all servers to make sure everything is up and running properly.
All affected clients will also receive 3 months free service which will be applied shortly. |
| Posted by target, 11-03-2010, 09:31 AM |
|
It is up for me. |
| Posted by martina, 11-03-2010, 09:38 AM |
|
Yes, now it's up. |
Add to Favourites 
Print this Article
Also Read
Vooservers (Views: 929)
Shared Hosting
Shared Hosting
