Portal Home > Knowledgebase > Industry Announcements > Web Hosting Main Forums > Providers and Network Outages and Updates > imountain databases down?
imountain databases down?
Posted by David, 02-04-2008, 04:09 PM |
Anyone else experiencing database problems @ imountain?
It's been down for a bit now, seems a lot of clients are down too but I was just checking out their ol blog:
http://imountain.com/web/
Well, was!
Last edited by David; 02-04-2008 at 04:17 PM.
|
Posted by kafloofen, 02-04-2008, 04:26 PM |
Down for 18 minutes now
|
Posted by David, 02-04-2008, 04:28 PM |
21 according to my count, but I could be off.
I'm curious -- what sort of benefits does their MySQL clustering offer? What powers it, etc.
|
Posted by David, 02-04-2008, 04:47 PM |
Well, it's at 40 minutes down. Someone in #wht just got an e-mail about it:
|
Posted by DJSlim, 02-04-2008, 04:53 PM |
down here as well
|
Posted by Iwannasite, 02-04-2008, 05:43 PM |
The sun of course!
|
Posted by David, 02-04-2008, 05:48 PM |
Well, I just wonder why they would "cluster" (50ghz worth of machines, if I read correctly) systems if there's zero fault-tolerance. It seems a bit iffy that a single raid issue affects 100% of their clientbase.
|
Posted by kafloofen, 02-04-2008, 06:00 PM |
1 hour 51 minutes down
|
Posted by DJSlim, 02-04-2008, 06:35 PM |
my server status script shows the server as online but still sites aren't connecting to the database
|
Posted by David, 02-04-2008, 07:07 PM |
Three hours and counting.. :/
Anyone have an update from imountain?
|
Posted by dvd871, 02-04-2008, 07:14 PM |
Imountain uses a setup where the mySQL server is a central server that the clustered accounts share. VPS's don't run their own mySQL servers on the same machines.
Things have been running pretty well up until today. I thought that all the mySQL problems were fixed, but I guess thats not the case.
|
Posted by David, 02-04-2008, 07:17 PM |
dvd,
Which is a great idea if it's actually fault tolerant. Centralized systems like that aren't exactly fantastic otherwise..
|
Posted by dvd871, 02-04-2008, 07:47 PM |
Yes I agree. Imountain seems to have too many mySQL issues. Maybe time to start looking and see what alternate is available.
|
Posted by calidude, 02-04-2008, 08:02 PM |
Dear clients
We've had a RAID fault with our mysql.imountain.com cluster. If you
are on this cluster, it is currently down.
We're moving our quickest to correct this RAID fault and have a 60
minute ETA.
Support
Iron Mountain Hosting
|
Posted by David, 02-04-2008, 08:03 PM |
calidude,
Well, it's been four hours now.. just curious, any updates on that or is that the latest update?
(Note: 100% of the clients seem to be on that cluster, at least based on the sites I checked)
|
Posted by calidude, 02-04-2008, 08:04 PM |
Got the above at 12:45 pm (I was not here when this started).
Then this one just came in...
Dear Clients
Data is currently being restored right now.
Your sites should start coming up. The data will be old on the first
run. Do not be alarmed, your data will be refreshed with backups from
this morning shortly thereafter.
We're moving along as quickly as possible...this is our top priority.
Normally, this wouldn't have happened and it's our first mySQL crash.
Usually our database replicators would have limited this to <5 minutes
as before. However, because of our cluster moves, our data
replicator/mirroring clusters were not yet complete (we had projected to be done
this week). Quite bad timing for everything.
We will have full database replication clusters completed by this
coming weekend and this will ensure this does not happen again.
We apologize again for the down-time and hope to have you back up again
shortly.
Support
Iron Mountain Hosting
|
Posted by CarSafety, 02-04-2008, 08:15 PM |
Also interested to hear comments on this response. My site is still down, approaching 4 hours now during our peak time.
|
Posted by dvd871, 02-04-2008, 08:16 PM |
I got the same email from support at 3:40pm PST and my sites are still down. Anyone else come back up yet?
|
Posted by David, 02-04-2008, 08:20 PM |
I'm just confused how this happens with a 50 gigglehurtz mysql cluster..
|
Posted by calidude, 02-04-2008, 08:26 PM |
I called the phone number on their website and they said that user accounts have not been restored yet, so that is why things have taken a bit longer than expected (that and the fact that the restore script was doing a huge database at the time).
|
Posted by calidude, 02-04-2008, 08:34 PM |
My accounts just came back up as of 4:30 pm PST. It's the old data still though, as specified in the earlier email.
|
Posted by DJSlim, 02-04-2008, 09:32 PM |
my site is finally live again but the database is outdated. They said they will be restoring to an backup from this morning next.
|
Posted by CarSafety, 02-04-2008, 09:34 PM |
Our website came back shortly after my last post. It appears to have reverted to the overnight backup. Not a major catastrophe. Given the very good reliability and great service I've had over the last 6 months, I don't have an issue with this snafu if the explantion is reasonable and it appears that measures will be in place to prevent it from happening again.
|
Posted by DJSlim, 02-04-2008, 10:22 PM |
my site is back online in full now. yes it is yesterdays backup which does kind of stink but I will deal. I still love the service that imountain provides and I am sure they have been working their asses off to get this fixed for everyone.
|
Posted by dvd871, 02-05-2008, 12:25 AM |
Yea, sites are back up and data loss was less than a day which is fine for us. Good job to imountain
|
Posted by kafloofen, 02-05-2008, 02:13 AM |
Good thing I have off site backups so my data was more recent.
But more than four hours of downtime is not good.
|
Posted by dead captain, 02-05-2008, 02:24 AM |
things happen for sure, and i am sure there is not a webhost here that can claim they have never had an extended amount of downtime. i know fused had some issues recently as seen here and i hear they are a quality host. no need to panic, just an unfortunate incident.
|
Add to Favourites Print this Article
Also Read