Portal Home > Knowledgebase > Industry Announcements > Web Hosting Main Forums > Providers and Network Outages and Updates > WiredTree downtime?
WiredTree downtime?
| Posted by AS-Richard, 12-11-2010, 04:27 PM |
|
Noticing the same thing here. |
| Posted by ManobanWeb, 12-11-2010, 04:28 PM |
Just got a s*** load of texts from my monitoring company telling me some of our servers are down. Wiredtree website isn't loading for me either.
Can anyone confirm wiredtree is experiencing an outage?
Cheers,
Adam. |
| Posted by Jedito, 12-11-2010, 04:30 PM |
|
Some of our servers with them are down, some other are not. |
| Posted by SwiftModders, 12-11-2010, 04:30 PM |
Having issues accessing my VPS server as well and their website. First time I have experienced downtime in a long time with WT. Hope it's quickly resolved, I was in the middle of developing my site  . |
| Posted by ManobanWeb, 12-11-2010, 04:30 PM |
Posted at the same time as me..
It's down for me too. |
| Posted by Tyler, 12-11-2010, 04:31 PM |
Threads merged. Down for me too.
Grove is coming up it seems, just slow. |
| Posted by defen, 12-11-2010, 04:31 PM |
|
Down for me as well. Their site itself is down as well. |
| Posted by JayNL, 12-11-2010, 04:32 PM |
|
Same here, our VPS is down as well. |
| Posted by Fastian, 12-11-2010, 04:35 PM |
My VPS is down as well.
I hope they will sort it out soon. |
| Posted by Awesys, 12-11-2010, 04:36 PM |
|
My VPS is down with them as well. Also cannot reach their home page. |
| Posted by WiredTree Zac, 12-11-2010, 04:39 PM |
|
We are aware of the network issue effecting a segment of our network and our network engineers are working to fully restore service. |
| Posted by Awesys, 12-11-2010, 04:41 PM |
Thanks Zac, really appreciate the reply and prompt service!  |
| Posted by Fastian, 12-11-2010, 04:41 PM |
Quote:
|
Originally Posted by WiredTree Zac
We are aware of the network issue effecting a segment of our network and our network engineers are working to fully restore service.
|
I hope it will be soon.
Thanks Zac |
| Posted by Kevin K, 12-11-2010, 04:43 PM |
|
Yup down here too. Quite a few issues the last week. I hope the service level restores back to normal. |
| Posted by drepac, 12-11-2010, 04:47 PM |
Same here guys. My VPS has been down since 15:19 EST according to Pingdom (1min check interval)
Let's hope this is resolved quickly.
Zac, more info on what's causing this outage and what you are doing to fix it and prevent it in the future would be appreciated.
Thanks |
| Posted by wirefusemedia, 12-11-2010, 04:47 PM |
My VPS is down, this is the 2nd time within the past 2 days and I am quite frankly tired of their hugely unreliable service. On top of this the server failed just last month and my VPS was down for over 10 hours and when I asked them to issue me a credit they said that hardware failure is not covered in the SLA which is a horrible way to treat your customers, they basically told me to deal with it and not 1 cent was issued. I bet the same is with this downtime as well.
This is the last straw with WiredTree, they have officially lost my business due to their constant network and server outages and unwillingness to work with their clients |
| Posted by Bob30, 12-11-2010, 04:49 PM |
Please does anyone have any information from them as all aveneu to contact them are not working.
Thanks. |
| Posted by JohnDonovan, 12-11-2010, 04:53 PM |
My dedicated server is offline, so I'm dead in the water. traceroute stops at te3-2-10g.ar2.lax2.gblx.net (starting in Orange County, CA) - so there's something going on in the network.
WiredTree is normally very good about these issues - so not sure what we can do now but wait. |
| Posted by srider, 12-11-2010, 04:55 PM |
|
I'm in the same boat. Sorry, no news here. |
| Posted by Kevin K, 12-11-2010, 04:59 PM |
Ya I think it is time they start issuing some credits. Usually I am not too worried about it, but this last week I have seen 4 or 5 different times that my servers were inaccessible do to network issues. All checked to be on their end.
Hopefully they will honor their SLA and be fair otherwise it might be time to move on myself. |
| Posted by neocomp, 12-11-2010, 04:59 PM |
www.wiredtree.com also is down !!!
Quick check for: wiredtree.com (http)
Date City Country Time (s) Result
December 11, 2010 12:57:20 San Francisco United States Failed
December 11, 2010 12:57:44 Chicago United States Failed
December 11, 2010 12:58:08 New York United States Failed |
| Posted by voidix, 12-11-2010, 04:59 PM |
|
Same here. Their phone is busy too. |
| Posted by neocomp, 12-11-2010, 05:01 PM |
From http://twitter.com/wiredtree :
"We are aware of the network issues effecting some clients and our network engineers are working on the issue." |
| Posted by ManobanWeb, 12-11-2010, 05:03 PM |
Quote:
|
Originally Posted by Kevin K
Hopefully they will honor their SLA and be fair otherwise it might be time to move on myself.
|
I shall be joining the band wagon if they don't honor them. It's getting rather annoying now. |
| Posted by frki1, 12-11-2010, 05:03 PM |
Hy,
Yes we are down to...
Is there some ETA on fixing network? |
| Posted by RBurns, 12-11-2010, 05:04 PM |
|
Sorry to hear about this everyone. Goodluck! |
| Posted by wirefusemedia, 12-11-2010, 05:04 PM |
|
Their SLA isn't gonna do anything to help really. Just like most providers they offer you a credit based on how many hours they are down and figure out how much of your monthly bill sums up to those couple hours. So you can expect to receive a $5 credit if that... |
| Posted by neocomp, 12-11-2010, 05:04 PM |
"Update, not a network issue, there is building-wide power issues which has effected some circuits. DC has staff on hand working."
2 minutes ago ... check http://twitter.com/wiredtree |
| Posted by KMyers, 12-11-2010, 05:04 PM |
Quote:
|
Originally Posted by Martie
|
Beat me to it, they also seem to be posting status updates to Twitter - http://twitter.com/wiredtree |
| Posted by ManobanWeb, 12-11-2010, 05:05 PM |
Not a network issue..
Just tweeted: wiredtree - Update, not a network issue, there is building-wide power issues which has effected some circuits. DC has staff on hand working. |
| Posted by WiredTree Zac, 12-11-2010, 05:06 PM |
|
We're working on bringing everything back online we can ASAP while CoreSite works on the power. Sorry for the inconvenience! |
| Posted by wirefusemedia, 12-11-2010, 05:07 PM |
|
Okay, well that SLA is completely out the window LOL. The outage isn't network related but power related, so no credit will be issued. I suppose they might wish to invest in a UPS or two. |
| Posted by Kevin K, 12-11-2010, 05:07 PM |
Quote:
|
Originally Posted by NanoCow
Their SLA isn't gonna do anything to help really. Just like most providers they offer you a credit based on how many hours they are down and figure out how much of your monthly bill sums up to those couple hours. So you can expect to receive a $5 credit if that...
|
The amount it not the main concern, it's more about the principal of the matter. |
| Posted by sross, 12-11-2010, 05:08 PM |
|
For me, any issues have always been extremely rare (dedicated server). As long as it a very rare thing (1-2 issues a year) I'll be sticking around. These things happen no matter where you go. Having switched hosts many times in the past one thing is certain, the grass is not always greener. Often things like this strengthen a host, this will likely identify a weak link in their network which will be corrected, etc. I hate being down as much as the next guy, but when you've been running a site for 10yrs you expect the occasional glitch. |
| Posted by winger, 12-11-2010, 05:09 PM |
|
down from here too. |
| Posted by JonFatino, 12-11-2010, 05:09 PM |
Kevin K is correct.
Its the principal of the matter.
Now that i think about it
anyone know a good "cpanel dns only provider"
looking for at least backup dns now that this problem happened. |
| Posted by Kevin K, 12-11-2010, 05:10 PM |
Their website is now back online.
Edit: Well it was for a second, lol. |
| Posted by winger, 12-11-2010, 05:11 PM |
Quote:
|
Originally Posted by wazzgod
Kevin K is correct.
Its the principal of the matter.
Now that i think about it
anyone know a good "cpanel dns only provider"
looking for at least backup dns now that this problem happened.
|
we use a $5.95 VPS at Burst.net for this |
| Posted by sross, 12-11-2010, 05:12 PM |
|
Looks like things are starting to come back up.. |
| Posted by wirefusemedia, 12-11-2010, 05:13 PM |
|
Not if your on VPS. First the server has to run an fsck which is probably gonna take 5 hours minimum. Then Virtuozzo has to boot each container up individually which can take an hour or more to fully complete. |
| Posted by Awesys, 12-11-2010, 05:14 PM |
Interesting information to hear about the other downtime this week. I noticed some downtime very late evening on December 8 but I thought it was CloudFlare (as they had been DOS attacked earlier) acting up rather than WiredTree.
WiredTree support has been very good to me, this is really the only major downtime I've noticed since December 2009. |
| Posted by BirdBrained, 12-11-2010, 05:15 PM |
|
My dedi is down as are their sites. Right in the middle of streaming a live event. NOT GOOD! |
| Posted by JSCL, 12-11-2010, 05:18 PM |
Per their site:
Toll Free: 1-866-523-8733
Local: +1 312-447-0510
Maybe? |
| Posted by Harzem, 12-11-2010, 05:24 PM |
http://twitter.com/wiredtree
Their DC is having some networking problems, so they are aware of it. My sites are down too, luckily I'm not in a hurry to get them back online. |
| Posted by ellinas, 12-11-2010, 05:25 PM |
3 of my VPSs are now back online (4th never went down).
Dedicated, still down. |
| Posted by Harzem, 12-11-2010, 05:32 PM |
Quote:
|
Originally Posted by NanoCow
Not if your on VPS. First the server has to run an fsck which is probably gonna take 5 hours minimum. Then Virtuozzo has to boot each container up individually which can take an hour or more to fully complete.
|
Not necessarily. From what I understand, it may as well be a power failure of the networking equipment. So when the network gear is up, the servers will be back up immediately.
It may be otherwise too, I'm just making a wish here
Quote:
|
Originally Posted by wazzgod
Now that i think about it
anyone know a good "cpanel dns only provider"
|
Yes that would be great to have |
| Posted by BirdBrained, 12-11-2010, 05:34 PM |
Finally got through on local number, #4 in queue...
Glad they got their servers back. |
| Posted by neocomp, 12-11-2010, 05:38 PM |
my VPS is back online ... VPS was not rebooted !!!
I think was a power failure in internal network equipment ... switches or routers !!! |
| Posted by eva2000, 12-11-2010, 05:39 PM |
yeah one of my servers is down but one isn't affected. nearly all my clients/friends servers are down though on wiredtree.
funnily enough got pingdom alert and went to site to check it and pingdom was down too tracert shows same path as wiredtree so same issue ? |
| Posted by frki1, 12-11-2010, 05:42 PM |
We are still down
Last time we had fsck and it lasted 5,6,7 hours..
Hopfuly this time we will skip it
Does their Hybrid also run fsck? |
| Posted by Fastian, 12-11-2010, 05:44 PM |
Quote:
|
Originally Posted by frki1
Does their Hybrid also run fsck?
|
I hope it wouldn't come to that.
I am on hybrid and its stilldown |
| Posted by neocomp, 12-11-2010, 05:47 PM |
|
Question : switches/routers are not installed in a power protected circuit with UPS + diesel generator ???????? |
| Posted by Tyler, 12-11-2010, 05:47 PM |
|
My VPS is back up, dedicated servers still down. |
| Posted by wirefusemedia, 12-11-2010, 05:47 PM |
|
It depends. If the servers power was dropped suddenly there is likely to be corrupted files in which case the server will want to run an FSCK. They do have the option of foregoing the FSCK before the server boots up but knowing WiredTree they would prefer to let the server do its thing. Of course that is the "right" thing to do but I propose they forgo the FSCK so I can get the hell out of there before more **** goes down. |
| Posted by drepac, 12-11-2010, 05:47 PM |
My VPS Back online.
Downtime from : 12/11/2010 3:19:52PM to 12/11/2010 4:24:52PM => 1h 5m
Uptime : 99.84% this month |
| Posted by winger, 12-11-2010, 05:49 PM |
UP here again, 1 hour down, not too bad  |
| Posted by wirefusemedia, 12-11-2010, 05:49 PM |
The tweet "As soon as power is restored, we'll begin booting up all clients. Unfortunately, there is no ETA. Tons of people are here though."
Confirms that the individual servers themselves are down. |
| Posted by Awesys, 12-11-2010, 05:50 PM |
|
Still no luck on my VPS. Hopefully soon by the looks of things. |
| Posted by JohnDonovan, 12-11-2010, 05:52 PM |
|
my dedicated server has been back online for about 30 minutes now. The server never went down - top is reporting continuous uptime since last (planned) reboot. |
| Posted by Bob30, 12-11-2010, 05:55 PM |
|
This is really unfortunate all my sites down at once. |
| Posted by frki1, 12-11-2010, 05:59 PM |
Quote:
|
Originally Posted by JohnDonovan
my dedicated server has been back online for about 30 minutes now. The server never went down - top is reporting continuous uptime since last (planned) reboot.
|
Glad for you
We are still dow, 1 hour + now |
| Posted by BirdBrained, 12-11-2010, 06:02 PM |
This really shakes my faith in them. Answering service says networking issue and gives 30 min. ETA. Twitter says power issue with no ETA.
If it's a power issue, this is the second or third time this has happened at this facility in the 11 months I've been there. WTF? |
| Posted by Kevin K, 12-11-2010, 06:07 PM |
1 up - 1 down . Let be be 2 up and I will be happy, lol. |
| Posted by ManobanWeb, 12-11-2010, 06:08 PM |
|
Still down too, around 10 minutes away from the two hour mark D: |
| Posted by sross, 12-11-2010, 06:09 PM |
Quote:
|
Originally Posted by winger
UP here again, 1 hour down, not too bad
|
Yeah, I think that's about right for me as well.. probably 1hr of downtime for an entire year. The sky is not falling for me, these things happen occasionally. If I were on a vps I would expect outages even more. There is no such thing as a host or datacenter that delivers 110% perfection like so many expect. |
| Posted by JSCL, 12-11-2010, 06:09 PM |
Quote:
|
Originally Posted by hawkmultimedia
This really shakes my faith in them. Answering service says networking issue and gives 30 min. ETA. Twitter says power issue with no ETA.
If it's a power issue, this is the second or third time this has happened at this facility in the 11 months I've been there. WTF?
|
The VM is probably pre-recorded in advance of such events. |
| Posted by BirdBrained, 12-11-2010, 06:12 PM |
|
Was a live body (Dan, whomever that is), not a recording. |
| Posted by BirdBrained, 12-11-2010, 06:16 PM |
|
Phew, mines back! |
| Posted by remotay, 12-11-2010, 06:22 PM |
My server is back (dedicated) but my site is still down. I'm using the WiredTree nameservers.... It's super frustrating.
When I ping it, it says
img442.imageshack.us/img442/6444/capturefp.jpg
Any ideas? The first IP is my server ip, the second one, I have no idea what it is. Says TTL Expired in transit. Googling shows it's some ip related to WiredTree.com |
| Posted by datamerc, 12-11-2010, 06:28 PM |
I received this reply within 1 minute of opening a ticket:
We appreciate your patience this afternoon. Our datacenter space at Coresite experienced what the engineers are explaining as a ground fault at the main panel. The Coresite engineers are waiting to get clearance to provide full power again. We also have additional staff within the datacenter ready to ensure that each dedicated server, VPS and Hybrid are up and operational. Currently this looks to have affected about 20% of our datacenter space. Our datacenter space: http://www.coresite.com/chicago-data-center.php is protected by UPS and power generators in case of a power failure. Our understanding was that this failure at the main panel prevented those systems from doing their job. We expect to be hearing more and will be reporting more on this issue as we hear from Coresite engineers. We will also report an ETA as soon as we have more information.
Thank you again for your patience and understanding while we work as quickly as possible. Anyone who is not currently online will be placed into an outage queue and will be updated accordingly.
Thanks,
James Webb
www.wiredtree.com
Toll Free: 1-866-523-8733
Local: +1 312-447-0510
Fax: +1 312-447-0514 |
| Posted by frki1, 12-11-2010, 06:30 PM |
Hy,
We are UP
Tnx WT on resolving this quickly as possible and thank good there is no fsck
Unfortunatly this power issues are something that happens, hopfuly not offten. |
| Posted by Fastian, 12-11-2010, 06:32 PM |
|
VPS is back |
| Posted by wirefusemedia, 12-11-2010, 06:40 PM |
|
Still down |
| Posted by frki1, 12-11-2010, 06:43 PM |
We are down again
Was UP but down again |
| Posted by FHDave, 12-11-2010, 06:44 PM |
Quote:
|
Originally Posted by remotay
My server is back (dedicated) but my site is still down. I'm using the WiredTree nameservers.... It's super frustrating.
When I ping it, it says
img442.imageshack.us/img442/6444/capturefp.jpg
Any ideas? The first IP is my server ip, the second one, I have no idea what it is. Says TTL Expired in transit. Googling shows it's some ip related to WiredTree.com
|
How do you know your server is back? You are able to SSH to the server, but simply can't ping? If that's the case, perhaps the ICMP package is being filtered. |
| Posted by Kevin K, 12-11-2010, 06:48 PM |
|
Both servers are now back up!!! |
| Posted by Fastian, 12-11-2010, 06:51 PM |
Quote:
|
Originally Posted by Fastian
VPS is back
|
Spoke too soon.
It went down Again ... |
| Posted by HS Nick, 12-11-2010, 06:52 PM |
|
Server responds to Ping but unable to SSH. Looks like ICMP is the only thing going through |
| Posted by wirefusemedia, 12-11-2010, 06:55 PM |
Super, a little under 3 hours of downtime, only a couple hundred dollars lost...no biggy...
I look forward to that $3 credit from WiredTree. |
| Posted by target, 12-11-2010, 06:56 PM |
Still down .. wil there be no SLA for this downtime ?
Will be looking for a better place to stay than. |
| Posted by sross, 12-11-2010, 07:01 PM |
Quote:
|
Originally Posted by NanoCow
Super, a little under 3 hours of downtime, only a couple hundred dollars lost...no biggy...
I look forward to that $3 credit from WiredTree.
|
Wish my site generated $50,000 a month..
*edit- just curious, if you are making $50k a month why are you on a VPS? |
| Posted by wirefusemedia, 12-11-2010, 07:05 PM |
Because I didn't want to give any of my employees access to the billing, support system etc.. I was hoping I would be able to trust WiredTree with any support issues that might occur on the server without having to rely on my employees to fix the issue.
However this whole incident changes all that and I would much prefer to spend $500 on a big heft server and trust them with access to it. This is by all means a big eye opener. |
| Posted by wirefusemedia, 12-11-2010, 07:05 PM |
|
And the server is down again... |
| Posted by ManobanWeb, 12-11-2010, 07:05 PM |
My site is loading, however it's taking forever for pages to load.. around 80 seconds waiting on whmcs to open up :/
-- appears to be down again |
| Posted by sross, 12-11-2010, 07:09 PM |
Quote:
|
Originally Posted by NanoCow
Because I didn't want to give any of my employees access to the billing, support system etc.. I was hoping I would be able to trust WiredTree with any support issues that might occur on the server without having to rely on my employees to fix the issue.
However this whole incident changes all that and I would much prefer to spend $500 on a big heft server and trust them with access to it. This is by all means a big eye opener.
|
Good idea. I have a beefy raid10 8core box for under $400. I run monitoring from Alertra.com so as soon as Alertra sends me a txt message on my phone about anything, I see what's going on and call/raise a ticket with Wiredtree. This is rare though. |
| Posted by target, 12-11-2010, 07:17 PM |
|
Appears to be up but no access to WHM ... wish they could keep us informed more. |
| Posted by ManobanWeb, 12-11-2010, 07:20 PM |
Quote:
|
Originally Posted by target
Appears to be up but no access to WHM ... wish they could keep us informed more.
|
I managed to get into mine just there, been waiting 2 mins on the page to load though! Would have loved more updates from them however.
- on second views, this is an unholy mess. MySQL has failed on my server. |
| Posted by target, 12-11-2010, 07:22 PM |
Quote:
|
Originally Posted by ManobanWeb
Would have loved more updates from them however.
|
For sure ... |
| Posted by Hendrickson, 12-11-2010, 07:26 PM |
This is shocking. I have been with wiredtree for 3 years almost and their VPS's and support have just been getting slower and slower. Plus more downtime each month.
I get the feeling they are over selling maybe? (I'm on a hybrid VPS) |
| Posted by JonFatino, 12-11-2010, 07:28 PM |
whm will take time to load up
log into ssh
service whm restart.
Wala
My server is back up |
| Posted by remotay, 12-11-2010, 07:30 PM |
|
I can access my WHM fine, but my main site is down. The ip it's on cannot be pinged (I have several dedicated IPs on my account). |
| Posted by WiredTree Zac, 12-11-2010, 07:33 PM |
|
If you are still experiencing issues, please open a ticket. A full RFO will be posted in Grove once we receive one from building engineers. |
| Posted by HS Nick, 12-11-2010, 07:34 PM |
Quote:
|
Originally Posted by Hendrickson
This is shocking. I have been with wiredtree for 3 years almost and their VPS's and support have just been getting slower and slower. Plus more downtime each month.
I get the feeling they are over selling maybe? (I'm on a hybrid VPS)
|
Do not know that this is the issue. I have been experiencing the same results on a dedicated.
Today was power related... Although Its still a mystery (Gen, UPS etc. ??) - Guess the DC didn't realize they have a Single Point of Failure ? |
| Posted by Hendrickson, 12-11-2010, 07:40 PM |
Quote:
|
Originally Posted by wazzgod
whm will take time to load up
log into ssh
service whm restart.
Wala
My server is back up
|
Lucky, I get unable to connect when i try and ssh |
| Posted by Hendrickson, 12-11-2010, 07:42 PM |
Quote:
|
Originally Posted by HS Nick
Do not know that this is the issue. I have been experiencing the same results on a dedicated.
Today was power related... Although Its still a mystery (Gen, UPS etc. ??) - Guess the DC didn't realize they have a Single Point of Failure ?
|
Exactly, what happen to there UPS and apparent generators. Looks like they don't really have them. And the back up network switches etc...
Something isn't right here.
Support still haven't answered me and that was like 40 minutes ago! |
| Posted by HS Nick, 12-11-2010, 07:45 PM |
Quote:
|
Originally Posted by Hendrickson
Exactly, what happen to there UPS and apparent generators. Looks like they don't really have them. And the back up network switches etc...
Something isn't right here.
Support still haven't answered me and that was like 40 minutes ago!
|
I wouldn't jump to that conclusion and accuse the datacenter of that. My guess would be it was something with the buildings wiring internally, thus cutting the Generators/UPS power from getting into the raised floor space ??
Whatever it was it sounds like the buildings electrical wasn't designed as well as it could have been? thus resulting in a Single Point of Failure that could have otherwise been avoided ? |
| Posted by HS Nick, 12-11-2010, 07:46 PM |
Quote:
|
Originally Posted by Hendrickson
Lucky, I get unable to connect when i try and ssh
|
Can you PING but nothing else? If so open a support ticket. I just had this issue and WireTree determined it was a firewall blocking traffic. Once they fixed that everything was back to normal. |
| Posted by Hendrickson, 12-11-2010, 07:57 PM |
Quote:
|
Originally Posted by HS Nick
Can you PING but nothing else? If so open a support ticket. I just had this issue and WireTree determined it was a firewall blocking traffic. Once they fixed that everything was back to normal.
|
No ping either, nothing. My IPs are not on the grid at all Sorry I'm just a little pissed, it just seems to be one thing after another with wiredtree now. I've not had a good run for the last few months. |
| Posted by WiredTree Zac, 12-11-2010, 08:00 PM |
Quote:
|
Originally Posted by Hendrickson
Exactly, what happen to there UPS and apparent generators. Looks like they don't really have them. And the back up network switches etc...
Something isn't right here.
|
There are UPS and Generators. The fault was between them and the servers in the power distribution. Our core network and routers were up the entire time and actually didn't experience any outages - there weren't any issues with the network besides some rack switches losing power, which we rectified quickly. This is why you have seen numerous people post that they had servers which did not go down. The issues only affected clients that were connected to a specific power panel, it was not a complete outage. I'd guess around 20% of servers were affected. |
| Posted by Hendrickson, 12-11-2010, 08:09 PM |
|
Ok thanks for the info. So then why am I and others still offline after 3 hours of being offline? I was told the server is disk checking, does it really take this long? (I'm on a Hybrid VPS) |
| Posted by WiredTree Zac, 12-11-2010, 08:11 PM |
|
Yes, filesystem checking can take that long. We don't have any control over how long it takes, nor can we safely bypass the checks. The checks happen because the filesystem was unmounted uncleanly, so the system needs to check to make sure there isn't any corruption which would cause further issues if left unfixed before you can mount it again. |
| Posted by transmit, 12-11-2010, 08:50 PM |
Quote:
|
Originally Posted by sross
Good idea. I have a beefy raid10 8core box for under $400. I run monitoring from Alertra.com so as soon as Alertra sends me a txt message on my phone about anything, I see what's going on and call/raise a ticket with Wiredtree. This is rare though.
|
How did you get a beefy RAID-10 8core box from WiredTree for under $400? Really interested! |
| Posted by Hendrickson, 12-11-2010, 10:11 PM |
|
Vps still offline, this is a bad joke! Anyone else still effected? |
| Posted by sross, 12-11-2010, 11:12 PM |
Quote:
|
Originally Posted by transmit
How did you get a beefy RAID-10 8core box from WiredTree for under $400? Really interested!
|
paying up front and 10% off coupon "10offdedicated", price is up a little since i signed on. The box is great though, WHM reads as 8 cores, etc
Xeon
$411.50 Monthly
* 6GB DDR3 ECC
* 4x500GB 7.2k RPM SATAII 16MB Cache
* 500GB 7.2k RPM SATAII 16MB Cache
* 10TB Premium Transfer
* $199 Setup Fee |
| Posted by BrianLayman, 12-11-2010, 11:36 PM |
Note that all hybrids and vps's are down right now due to them putting in the new wiring per the earlier email..
_________________________________
Dear Valued WiredTree Customer.
This is an emergency notice to inform you that the power that feeds the rack that your server is in will be undergoing emergency maintenance starting at 9:00PM CDT tonight ( Saturday, 12/11/2010 ). The issue is due to the ground fault power problem that CoreSite ( WiredTree's datacenter provider ) suffered this afternoon. CoreSite needs to shut down the circuits that power your servers and switch them over to new ones. This is a proactive replacement to ensure that your servers are being fed by stable power. They are pre-wriring the replacement circuits at this time and we will be issuing power down commands to your server starting at 9:00PM CDT and we expect downtime to minimal.
Switching the circuits takes about 15min to do by CoreSite and as soon as we have a stable power environment, we will be powering on your server. The expected outage window will be .5 to 1hrs in length. While we do not expect your server to be down for that long, we are giving our staff and the CoreSite engineering team an ample downtime window to get this issue taken care of and get your server back online. All best practice measures will be taken to ensure downtime is minimal. Your patience and understanding while we work on this proactive emergency replacement is greatly appreciated.
If you have any questions, please feel free to reply back to this email or open a new Grove verified support ticket.
Thanks,
WiredTree Support
______________________________________
Hopefully with proper shutdowns there won't be the same reindexing and quota checking.
I was a victim of the long recovery time back in February and as I understand it the raid array needed to rebuild itself. I wish I'd known about the SLA back then even if it was just a 512 vps then. Now I have two hybrids. ( Man those suckers are fast when you optimize them. I brought someone over from a Rackspace cloud server that periodically locked up after hitting a 184 with all 2gb used. With caching et al, the hybrid server's 15 minute load average is 0.00. ) |
| Posted by BrianLayman, 12-11-2010, 11:42 PM |
|
Hmm I'm informed that a "small subset" of WiredTree people got that and it is not dependent upon whether you were down before or not. |
| Posted by WiredTree Zac, 12-11-2010, 11:45 PM |
|
This isn't all VPS and Hybrid, it is around 80 servers including both those who had and those who did not. Fortunately, the maintenance should not take long. |
| Posted by WiredTree Zac, 12-11-2010, 11:49 PM |
|
The maintenance is complete and servers are powering back on now. |
| Posted by Hendrickson, 12-12-2010, 12:02 AM |
I recieved no such message. Infact im getting more info here than wt support. Over 8 hours offline
Now , time to find a new vps host I think. I doubt this will be the last outage from wiredtree. Any recomendations? |
| Posted by WiredTree Zac, 12-12-2010, 12:07 AM |
|
If you did not get an email earlier, then the maintenance didn't affect you. It went out to a relatively small number of clients. Didn't you post earlier that your server was disk checking? It can take this long, unfortunately in some less common cases. If you can give me your ticket ID (PM or email please) I can make sure you get have latest information we can give you in it if you don't already. |
| Posted by XeHSean, 12-12-2010, 12:36 AM |
|
Theres also a post in the provider outages forum down below about this. |
| Posted by Hendrickson, 12-12-2010, 12:39 AM |
Finally back online after almost 9 hours straight offline. I've lost a lot of $$$
Here's my downtime, http://img207.imageshack.us/img207/1183/downtime.jpg See the 0 users online for 9 hours. Yep thats the only 20% of servers effected with 1-2 hours downtime that is really almost 9 hours. Thanks wiredtree.
This was strike 3 for wiredtree, which recently has been unwiredtree.com...
This downtime is not the first this month, we had issue before as others commented too on page 4 or 5. |
| Posted by Hendrickson, 12-12-2010, 01:02 AM |
|
Oh offline again. Will this ever end? |
| Posted by target, 12-12-2010, 01:30 AM |
|
Does anyone know Wiredtree will pay SLA ? |
| Posted by srider, 12-12-2010, 01:41 AM |
Up, down, up, we rewired the power, down, up, two servers set for same IP address, worst web hosting nightmare in my 32 year career in datacom.
Desperately seeking a competent California dedicated server provider. |
| Posted by JoyceBabu, 12-12-2010, 01:43 AM |
Day 2 in my new hybrid server and it was down for 3 hours. But I am happy that it was only 3 hours when there were many who had higher downtimes.
The server was down for 2.5 hours 9 hours back and 30 minutes 3 hours back. Does anyone know why it went down for the second time?
Hopefully, this won't happen again. |
| Posted by plumsauce, 12-12-2010, 01:57 AM |
Quote:
|
Originally Posted by JoyceBabu
and 30 minutes 3 hours back. Does anyone know why it went down for the second time?
|
Further up in the thread you will find a bit about it.
The data center had to put in a new cable or busbar to completely correct the original ground fault. This is a mandatory operation because it is presumably covered under the electrical code. In that case, if it is not done, and done in a manner acceptable to the power utility, the utility will simply shutoff inbound power.
Never mind, see the vendor post below. Wrong second interruption. |
| Posted by WiredTree Zac, 12-12-2010, 01:58 AM |
|
The reason it goes down the second time is because Virtuozzo has shut down cleanly and cannot enable disk quotas on your server until it can examine it off-line, To minimize downtime after such an event, Virtuozzo starts all VPS at once, then takes them down one at a time to quota check. The length of the process will vary. It is largely influenced by the number/size and layout of files. |
| Posted by sross, 12-12-2010, 02:13 AM |
Quote:
|
Originally Posted by srider
Up, down, up, we rewired the power, down, up, two servers set for same IP address, worst web hosting nightmare in my 32 year career in datacom.
Desperately seeking a competent California dedicated server provider.
|
Part of the problem is you are on a VPS. Why, with 32yrs industry experience are you running mission critical apps on a shared VPS? Not trying to be a jerk, but if you want to increase your chances of reliability you go with a dedicated box, hot swap components and RAID 10, etc. You get what you pay for. Is this outage acceptable? Surely not, but I've been working in DCs for 15yrs and crap happens. You'll be shifting host every week if you think you can find much better. There will always be unforeseen issues even at the best of hosts. Wiredtree has been pretty solid about learning from such issues. I think in the last 4yrs I've had maybe 4hrs down time and one of them was a check disk for 3hrs after a power supply died and crashed me (they had me booting back up in 45mins too after the swapout). Good luck.. |
| Posted by srider, 12-12-2010, 02:21 AM |
Quote:
|
Originally Posted by sross
Part of the problem is you are on a VPS. Why, with 32yrs industry experience are you running mission critical apps on a shared VPS? Not trying to be a jerk, but if you want to increase your chances of reliability you go with a dedicated box, hot swap components and RAID 10, etc. You get what you pay for. Is this outage acceptable? Surely not, but I've been working in DCs for 15yrs and crap happens. You'll be shifting host every week if you think you can find much better. There will always be unforeseen issues even at the best of hosts. Wiredtree has been pretty solid about learning from such issues. I think in the last 4yrs I've had maybe 4hrs down time and one of them was a check disk for 3hrs after a power supply died and crashed me (they had me booting back up in 45mins too after the swapout). Good luck..
|
I have a quad core dedicated server with twelve gb ram and two terabytes of hard drive and I am paying $286 per month. It is not a vps. Your apology would be appreciated. |
| Posted by srider, 12-12-2010, 02:25 AM |
|
Three hours ago I reported that they have routing problems causing WHM to declare services down that are not down. After three hours I have the same problem. I'm getting sixty to seventy error emails from WHM per hour. Nor course I did restart cPanel several times but their network misconfiguration is not fixed yet. |
| Posted by sross, 12-12-2010, 02:27 AM |
Quote:
|
Originally Posted by srider
I have a quad core dedicated server with twelve gb ram and two terabytes of hard drive and I am paying $286 per month. It is not a vps. Your apology would be appreciated.
|
I was going on what wird tree said about the second outage:
"The reason it goes down the second time is because Virtuozzo has shut down cleanly and cannot enable disk quotas on your server until it can examine it off-line, To minimize downtime after such an event, Virtuozzo starts all VPS at once, then takes them down one at a time to quota check. The length of the process will vary. It is largely influenced by the number/size and layout of files."
That made it sound like you were on a VPS. How many times have you been up and down? Should have been once when the initial incident happened, and possibly one more time after that for 5-60mins. My first outage (dedicated) was 1.2hrs, none after that. Sounds like bad luck, sorry I misinterpreted the situation. |
| Posted by Josh [TimelessHost], 12-12-2010, 02:28 AM |
Maybe I am pushing the speculation boat out a bit soon, but is it just me or does it seem WiredTree is going down the drain?
I've noticed a downtime complaints and support answering (or lack of) issues. |
| Posted by anon-e-mouse, 12-12-2010, 02:40 AM |
Quote:
|
Originally Posted by Tylent Night
Threads merged.
|
And again |
| Posted by srider, 12-12-2010, 02:48 AM |
Each attempt to reach my server is a coin toss. There seem to be two servers responding to my main ip address. I am getting one error text message to my cell phone per minute for hours. I have made three tickets and two successful phone calls. The problem still exists.
CPanel is freaking out.
After the first power failure the rack my server is in was powered down without any warning to me, and since the server finished fsck three hours ago the routing problem has not cleared.
Hint to WiredTree Was there a server in the rack mine is in that was powered off before you yanked the power, but which powered up because of BIOS settings when power was restored? |
| Posted by Dannyarr, 12-12-2010, 05:24 AM |
2 hour downtime on 2 of my hybrids and a 9 hour downtime on 1 of my hybrids.
And you can forget about the SLA since that only covers network issues.
Sigh. |
| Posted by Bob30, 12-12-2010, 05:35 AM |
|
Mine was 2h30 minutes downtime on my dedicated server. |
| Posted by jordanriane, 12-12-2010, 05:43 AM |
Quote:
|
Originally Posted by Josh [TimelessHost]
Maybe I am pushing the speculation boat out a bit soon, but is it just me or does it seem WiredTree is going down the drain?
I've noticed a downtime complaints and support answering (or lack of) issues.
|
I'd say it's just you attempting to push the "speculation boat." I've been with WiredTree for almost four years now and can still count on one hand the number of "issues" I've had with non-planned downtime (and of the couple, one was a motherboard that died and which, said server had almost 365 days of uptime.) It happens and you know what, at least WT are quick to announce the problem and let you know they're rectifying it.
I get awesome support from WiredTree any time of the day and they have been the only company I've been with that are consistent in all aspects. |
| Posted by srider, 12-12-2010, 07:43 AM |
Almost the entire night has gone by now and my server is now 100% offline.
After I correctly guessed that an unused server had powered up along with mine I received word from Wiredtree tech support that another server that was unused had powered up along with mine. Included was a note that "that" server was now shut down. Based on my inability to even ping any IP on my server now I wonder if the server that was shut down was mine and if the serve still powered up is the interloper?
I could not possibly be less pleased.
The tech said my server "should" be up now. I agree. It is not. |
| Posted by Hendrickson, 12-12-2010, 09:06 AM |
Quote:
|
Originally Posted by Josh [TimelessHost]
Maybe I am pushing the speculation boat out a bit soon, but is it just me or does it seem WiredTree is going down the drain?
I've noticed a downtime complaints and support answering (or lack of) issues.
|
Yes very much so... |
| Posted by RamboLeer, 12-12-2010, 12:03 PM |
Having issues on my VPS as well. Websites are loading very slow and sometimes I cannot access WHM/Cpanel.
I am not used to these kinds of problems with WT and I think I will have to move to a more reliable host at least for the time being |
| Posted by eva2000, 12-12-2010, 12:33 PM |
Quote:
|
Originally Posted by Hendrickson
Finally back online after almost 9 hours straight offline. I've lost a lot of $$$
Here's my downtime, http://img207.imageshack.us/img207/1183/downtime.jpg See the 0 users online for 9 hours. Yep thats the only 20% of servers effected with 1-2 hours downtime that is really almost 9 hours. Thanks wiredtree.
This was strike 3 for wiredtree, which recently has been unwiredtree.com...
This downtime is not the first this month, we had issue before as others commented too on page 4 or 5. |
Yeah approximately 9hrs here as well with a hybrid server I have. My VPS wasn't affected at all. Got my first pingdom/hosttracker/siteuptime sms/email alerts around 6:26am AEST, and in between was up and down with multiple sms alerts all the way until finally fully online around 3:26pm AEST
Some friends and clients on dedicated servers went back up much quicker probably though.
Still I'm staying with wiredtree as such things do happen from time to time. |
| Posted by srider, 12-12-2010, 12:45 PM |
Mine is almost fixed. HTTP, POP, SSH and all the really good stuff is working but cPanel is oddly insisting that services are down that are actually working.
My clients are back in business at least, and they are pursuing this remaining issue.
I'm looking for a new provider too.
I'll never know how much revenue was lost. |
| Posted by WiredTree Zac, 12-12-2010, 01:39 PM |
Quote:
|
Originally Posted by plumsauce
Further up in the thread you will find a bit about it.
The data center had to put in a new cable or busbar to completely correct the original ground fault. This is a mandatory operation because it is presumably covered under the electrical code. In that case, if it is not done, and done in a manner acceptable to the power utility, the utility will simply shutoff inbound power.
Never mind, see the vendor post below. Wrong second interruption.
|
Actually, that was part of it was well for some clients, so you were correct. Those clients were notified separately in email before the maintenance. |
| Posted by WiredTree Zac, 12-12-2010, 01:42 PM |
|
Unfortunately, the Hybrid that was down that long was disk checking. Power to it had been restored within an hour, the system just forced a filesystem check and that is how long it took to complete. That length of time is out of our hands. The process cannot be skipped, and if you could, it would be a very, very bad idea as the filesystem could be permanently corrupting/self-destructing as you are using it if it did. We're of course terribly sorry for the inconvenience and if there was anything we could do to speed up that process, we would. |
| Posted by Josh [TimelessHost], 12-12-2010, 02:09 PM |
Quote:
|
Originally Posted by jordanriane
I'd say it's just you attempting to push the "speculation boat." I've been with WiredTree for almost four years now and can still count on one hand the number of "issues" I've had with non-planned downtime (and of the couple, one was a motherboard that died and which, said server had almost 365 days of uptime.) It happens and you know what, at least WT are quick to announce the problem and let you know they're rectifying it.
I get awesome support from WiredTree any time of the day and they have been the only company I've been with that are consistent in all aspects.
|
Great! It's nice to hear a positive review for WT.  |
| Posted by Harzem, 12-12-2010, 02:29 PM |
I've been with a lot of companies too, and WiredTree is still on top of my list for the "next VPS". My current VPS with them was pre-configured the best among all VPSs I rented from different companies, and their support is literally 5 minutes away.
I don't think an unscheduled downtime or two will affect my thoughts on WT anytime soon. |
| Posted by VL-Adam, 12-12-2010, 02:51 PM |
|
I'm glad to hear WT was on top of this issue and resolved it. |
| Posted by ShaunH, 12-12-2010, 02:54 PM |
|
If I was Wiredtree. I would give Corsite a piece of my mind. This is, I think the second power related issue that wiredtree had no control over. Its one thing if they can do something about it. But another when they have to stand around and wait on Corsite. Considering how much they must be paying (which I'm sure isn't cheap) I would be rather cross about all of this. |
| Posted by Josh [TimelessHost], 12-12-2010, 02:57 PM |
Quote:
|
Originally Posted by ShaunH
If I was Wiredtree. I would give Corsite a piece of my mind. This is, I think the second power related issue that wiredtree had no control over. Its one thing if they can do something about it. But another when they have to stand around and wait on Corsite. Considering how much they must be paying (which I'm sure isn't cheap) I would be rather cross about all of this.
|
I'd think that WT would be very vocal towards CoreSite. |
| Posted by srider, 12-12-2010, 04:43 PM |
In all fairness to Wiredtree they do have some of the sharpest and most expert techs I have ever spoken with. They also are expert at securing servers before they turn them over to customers. With other providers it is sometimes a mad rush to lock down a new server quickly while it is still yours.
In addition they are honest, they told me what was wrong without spin. There are people in this business who might be less forthcoming. They respond usually very quickly to support requests too. They are nowhere near the worst provider one could choose.
It is fair to say they did not cause the power problems yesterday. |
| Posted by frki1, 12-12-2010, 08:06 PM |
Quote:
|
Originally Posted by HoHoHorzem
I've been with a lot of companies too, and WiredTree is still on top of my list for the "next VPS". My current VPS with them was pre-configured the best among all VPSs I rented from different companies, and their support is literally 5 minutes away.
I don't think an unscheduled downtime or two will affect my thoughts on WT anytime soon.
|
Agree
As i see it they have no influence on datacentar power problems. They can just wait for datacentar techs to repair.
Last problem i had was in Dec 2009 which is by my standards pretty good. They responded quickly to this issue and deal with it, also if fsck is runnig there is little thay can do and dowtime will happen ( we had last time fsck .
Butt at the end of the day they are responding to tickets quick and they acctualy resolve problems.
So WT thumb up |
| Posted by target, 12-13-2010, 08:49 AM |
|
Did anyone get an SLA compensation OR an answer if u asked for one ? |
| Posted by jpeacock, 12-13-2010, 12:22 PM |
my guess would be that the datacenter hears it from every angle during a power outage such as this - it's not like they need to be reminded of the outage since they have pissed-off people paging them every 2 seconds
I've been on a WT VPS for a few years now after moving off of a colo'd box in 350 Cermak - can't speak highly enough of their service and frankness when a problem arises. They're not the type of company that speaks to the world when they have an outage, but if you contact them on twitter or open up a ticket, they're very prompt and helpful. |
| Posted by wirefusemedia, 12-14-2010, 01:27 AM |
And we're down again at 9:20+pm PST 12/13/10
Started out as our site began to load slowly, now grove and wiredtree.com is not responding either. Submitted a ticket many minutes ago and still waiting for a response. |
| Posted by Kevin K, 12-14-2010, 01:30 AM |
Quote:
|
Originally Posted by NanoCow
And we're down again at 9:20+pm PST 12/13/10
Started out as our site began to load slowly, now grove and wiredtree.com is not responding either. Submitted a ticket many minutes ago and still waiting for a response.
|
Yup same here. This is starting to get ridiculous. 3rd time in a week here. 
Getting 50% packet loss for both servers. |
| Posted by harrip01, 12-14-2010, 01:45 AM |
They have a DOS underway.
"t appears that the recent network issue was the result of a DDOS attack against one of our customers. We have taken steps to mitigate the issue and connections should be back to normal shortly." |
| Posted by BrianLayman, 12-14-2010, 01:45 AM |
|
Something is definitely up... at least the sites are loading half the time but slooooooow |
| Posted by BloggerDude, 12-14-2010, 01:47 AM |
yup same here.. my sites are down..
They are working on this i was told via ticket...
a few days ago they had similar problem And I was told it was due of DDOS, last time... some days ago.
now i was told this: "It appears that there is an issue with one of our network providers, external to our datacenter."...
I hope this doesn't get often... because it is starting to hurt... |
| Posted by Kevin K, 12-14-2010, 01:49 AM |
That was the issue a few days ago. Nothing has been confirmed at this point for this current loss of connectivity. At least I haven't seen any mentioned as of yet.
Quote:
|
It appears that there is an issue with one of our network providers, external to our datacenter
|
It does look that way from the results of a tracert.
Update From WiredTree:
Quote:
Hello,
It appears that there is an issue with one of our network providers, external to our datacenter, most likely as the result of a DDOS attack against one of our customers. We have taken steps to mitigate the issue and connections should be back to normal shortly.
We do appreciate your patience in this matter and hope to have the situation stabilized shortly.
-Danny
|
|
| Posted by BrianLayman, 12-14-2010, 02:00 AM |
|
I knew WiredTree being listed in that doc on wikileaks would lead to nothing good.. |
| Posted by wirefusemedia, 12-14-2010, 02:03 AM |
Quote:
|
Originally Posted by BrianLayman
I knew WiredTree being listed in that doc on wikileaks would lead to nothing good..
|
LOL I was just about to say that too! The hacktivists of Anonymous got to em. |
| Posted by BloggerDude, 12-14-2010, 02:05 AM |
Docs on wikileaks?
what are you talking about? I hope you are not joking, because our sites are down and it's not good to joke when people business are down, YOU KNOW.. bad timing, dude.. Brian Layman... |
| Posted by Czar, 12-14-2010, 02:05 AM |
Phew! I've been on the ticketing system for hours and no-one seemed to be aware of the issue (repeatedly pointing to our local ISP as the cause). It's a massive relief to know that the cause has been discovered, because all seven of our boxes are completely inaccessible now and we are doing nothing but handling client complaints.
I'm still a fan, but this episode has been painful, to say the least (mainly because of the mixed messages we've received). |
| Posted by Yogesh Sarkar, 12-14-2010, 02:28 AM |
|
Same here, sites been loading extremely slowly, if not timing out completely! |
| Posted by BrianLayman, 12-14-2010, 03:11 AM |
|
Things are back to being blazingly fast again with no packet loss. Has anyone heard anything of the cause? |
| Posted by Kevin K, 12-14-2010, 03:14 AM |
Quote:
|
Originally Posted by BrianLayman
Things are back to being blazingly fast again with no packet loss. Has anyone heard anything of the cause?
|
It was another ddos attack as I posted above. Seems to be a repeated issue lately. |
| Posted by Czar, 12-14-2010, 03:18 AM |
|
I know it's hard to guard against DDOS, but hopefully they'll put some procedures in place to at least isolate sites that are being targeted so that other sites on the same network aren't all dragged down at the same time. |
| Posted by BrianLayman, 12-14-2010, 03:28 AM |
That's actually quite disturbing.
When I saw others were affected, I didn't bother looking at my logs for an attack to shut down. I would have hoped that their infrastructure would isolate attacks on a particular group of sites (Though I know large groups of VPSs could be vulnerable, I'd hope the Hybrids would be much less densely populated.) If this was an attack on their whole ip block, that does not bode well for the near future. I've dealt with enough of these that I've no desire to take to the field again. Heck, once was plenty, thank you very much.
I sincerely hope it was not one of us (or a former WT client) who decided to take revenge over the outage or a service dispute. |
| Posted by target, 12-14-2010, 03:41 AM |
I don't wanna make this is 'Wiredtree sucks' topic because they have some very good pros. Still think there technical support is very good and u get some fast and to the point answers. They always let me think they appreciate their customers.
The cons are it seems that their infrastructure isn't top notch, what u should expect from them, because u pay a higher price than with a lot of other comparable company's.
If they would really care about their customers it's about time they should give some kind of compensation for all the trouble we have been going trough these last few days (weeks). They should give it themselves and we shouldn't have to beg for it. |
| Posted by BloggerDude, 12-14-2010, 08:14 AM |
|
What sites were targeted exactly on wiredtree? |
| Posted by diesel12, 12-14-2010, 10:41 AM |
There has still been no update on Grove regarding the original outages over three days ago as Zach promised earlier in this thread. Everything seems to take a lot longer these days at WiredTree, from new server builds to migrations to billing issues being resolved.....all are taking significantly longer than quoted or they have in the past, so the slowness is posting is consistent with that.
I was hoping a higher profile issue like this would at least get some clarification in Grove. I realize that the response will be that al the facts aren't in, so they couldn't post, but they could have certainly communicated in some way as to clue us into where they are at in the investigation and thoughts they have about moving forward.... so far no communication about issue three days ago or issue last night.
I like WiredTree and am not planning on going anywhere, I think they're one of the best hosts we've ever used, but it's clear that their growth is affecting their execution and performance, without question. |
| Posted by Bob30, 12-14-2010, 11:08 AM |
Quote:
|
Originally Posted by diesel12
but it's clear that their growth is affecting their execution and performance, without question.
|
Employing more staffs can easily solve this. |
| Posted by Layershift Damien, 12-14-2010, 11:50 AM |
Employing more staff is not as easy as it sounds - easy to write, harder to execute.
Of course first you need to identify suitable candidates, but assuming that's easily handled you still need to take considerable time / resources to train and properly integrate them into your existing teams.
I don't have much awareness of the underlying issues, as clearly I'm not a WT customer, but on the basis that you're correct regarding them experiencing some growing pains it's not necessarily even caused by a lack of staff resources - there can be system / process issues that did not scale as anticipated and require some rethinking to handle.
Just to be clear, I'm acutely aware that the issues discussed within this thread are not scalability related (I don't think the power outage of DDoS attacks are about scale in any way!). |
| Posted by BrianLayman, 12-14-2010, 01:01 PM |
Additionally, I believe they are preparing to do just that. Last week or so they moved into new office space. Fortunately, this is a rare event because office moves are inevitably tied up with at least some turmoil. They make life more exciting but more complicated for everyone who is trying to do their job.
This isn't an excuse for any delays and certainly no outages, but it is extenuating circumstance that *may* have played a role in the recent weeks. |
| Posted by Layershift Damien, 12-14-2010, 01:12 PM |
Quote:
|
Originally Posted by BrianLayman
Additionally, I believe they are preparing to do just that. Last week or so they moved into new office space. Fortunately, this is a rare event because office moves are inevitably tied up with at least some turmoil. They make life more exciting but more complicated for everyone who is trying to do their job.
|
Great way to put it! - make life more exiciting
Good point that I forgot to mention about the hiring more staff issue. All of this is easy to overlook from the outside looking in; you only realise these details if you've had similar experience (not just limited to hosting - of course these are common issues to most sectors).
I guess as ever the point is that it's easy to point the finger and criticise, but particularly if you're a customer affected by some downtime etc. like this you need to step back and take a breath. Personally I find it refreshing that there are a number of posts within this thread from customers who acknowledge that sometimes things break and on balance they have excellent reliability and service from WT (remember, I don't know if they do or don't - my point is that it's refreshing to see level headed review in such circumstances).
As a caveat, I'm not saying anything against those who are more frustrated either - I don't know the details and I'm not judging; you may well be entitled to be dissatisfied with the lay of the land in your particular case. Every customer has different requirements and expectations |
| Posted by frki1, 12-17-2010, 10:20 AM |
Again going up and down
also WT is downn??? |
| Posted by target, 12-17-2010, 10:28 AM |
Quote:
|
Originally Posted by frki1
Again going up and down
also WT is downn??? |
U almost gave me a heart attack :p
It's up here. |
| Posted by frki1, 12-17-2010, 10:29 AM |
Quote:
|
Originally Posted by Layershift Damien
|
Wierd, i cannot acces neather theirs Grove or page or mail |
| Posted by Harzem, 12-17-2010, 10:31 AM |
|
I got a pingdom report of my website going down and coming back up. Looks like a hiccup, not a large problem. |
| Posted by frki1, 12-17-2010, 10:37 AM |
Quote:
|
Originally Posted by HoHoHorzem
I got a pingdom report of my website going down and coming back up. Looks like a hiccup, not a large problem.
|
For me it is just loading page, WT page and my the same..Loading timeout |
| Posted by target, 12-17-2010, 10:48 AM |
Quote:
|
Originally Posted by frki1
Wierd, i cannot acces neather theirs Grove or page or mail
|
I can login without a problem. |
| Posted by frki1, 12-17-2010, 11:08 AM |
Quote:
|
Originally Posted by target
I can login without a problem.
|
Yeah, me too now
Maybe it was a glitch with my ISP, but wiered thing i could open other pages beside my, and WT.
Well most iportant it is working now |
| Posted by diesel12, 12-17-2010, 11:21 AM |
|
We also had site uptime notify us that pings were failing for a few minutes.... |
| Posted by WiredTree Zac, 12-17-2010, 05:30 PM |
|
We didn't get any alerts for anything internal from either Pingdom or Hyperspin, checking many services on 1 minute intervals. No internal monitoring lost connectivity to the outside. |
| Posted by dalmuti, 12-21-2010, 01:13 PM |
|
Anyone else having issues with Wiredtree today? |
| Posted by BrianLayman, 12-21-2010, 01:15 PM |
|
Just in Grove and it JUST started. My servers are running fine. |
| Posted by dalmuti, 12-21-2010, 01:17 PM |
Been down for at least 20 minutes for me.
Thanks |
| Posted by BrianLayman, 12-21-2010, 01:19 PM |
Your servers or Grove?
Grove is responding just VERY VERY slowly. There may be another DOS going on for a client in that server group. |
| Posted by Sam.Serverfreak, 12-21-2010, 01:22 PM |
Been up and down for 1.5hours. Emailed them and told them is a network issue, they don't believe. They believed is a network issue only after 1hour.
grove loading is very very slow as well. |
| Posted by Kevin K, 12-21-2010, 01:28 PM |
I have not see any issues either. I have checked the monitoring stats for both servers with them and they both have been reporting the normal response times checked on 1 minute intervals.
Might be an issue with a certain area of servers. I do see their Grove does not load at all for me right now. |
| Posted by Sam.Serverfreak, 12-21-2010, 01:31 PM |
|
Now we are back to business after their rerouting of traffic from savvis to global crossing. |
| Posted by Sam.Serverfreak, 12-21-2010, 01:33 PM |
|
accessing grove is fast now. |
| Posted by Bob30, 12-21-2010, 01:44 PM |
|
Both sites and groove are fine for me, maybe it's because i'm on dedicated server. |
| Posted by Harzem, 12-22-2010, 10:02 AM |
|
Great to hear that the issues are now resolved for everyone |
Add to Favourites 
Print this Article
Also Read
Shared Hosting
Shared Hosting
