943,310 Members | Top Members by Rank

Ad:
0

DaniWeb Downtime ... all my fault

by on Jun 7th, 2006, 9:58 pm
Well, I just got myself through a major disaster. A couple of days ago, vBulletin, the forum system which powers the core of DaniWeb, released a shiny new version, vB 3.6. Every day since, they've been announcing new features - many of which look just awesome!

This afternoon, they finally released public beta. My first instinct was to naturally wait until stable. However, when 7pm rolled around, my anxiousness got the better of me.

I dutifully backed up the database and the filesystem, and away I went. Only to find that the upgrade wasn't trivial by any means, but rather required many file edits and template edits and all kinds of stuff ... the kinda stuff that you'd be crazy to not have a test server running for at least a week first before attempting the upgrade.

Well ... that was behind me now. So the clock is ticking ... 8 pm rolls around, and I try to crazily scramble to fix one thing after another. Maybe if I pull an allnighter ...

And then I think about that SQL backup I saved! But last time I ran a mysql > source to restore the database, it took about 8 hours, and that was months ago! Imagine how long it would take this time.

On the other hand, once I went through the 8+ hours of downtime, we'd at least be back to normal before the morning. My only other option at this point was to pull an allnighter - or two - scrambling to upgrade all of my hacks and additions and templates and everything else to be 3.6 compatible. Remember, only the CORE of DaniWeb is based on vB - the portal, blogs, code snippet library, tutorials, link directory, and all of the extra features, which are all integrated btw, are my own creation.

So, I sighed, I took a deep breath, and I flushed out the live database, and restored from backup. And ... drumroll please ... it finished in less than five minutes. I promise you. In fact, if I am lying, I wouldn't be able to type this all out right now, one hour after I started this whole disaster (Which turned into about 30 mins on and off of downtime during and after the upgrade when I didn't know what to do with myself).

The moral of the story is don't underestimate the power of a new dual core dual opteron as a dedicated database server. I swear to you guys ... what used to take a full half of a day on a Dual Xeon took 5 minutes max on a dual core Dual Opteron. Aside from the difference in the processor, the other advantage (and it's a big one) is that I now had a dedicated database server which was able to focus entirely on restoring the backup, and didn't have to deal with constant Apache connections and 1000+ users trying to browse a site that's down.

So ... the upgrade will be for another day, after it's already been fully prepared on a test server and ... did I mention ... when it's outta beta?
News Story Tags: backup, daniweb, database, server
Similar Threads
 
 
Comments on this News Story
Jun 7th, 2006
0

Re: DaniWeb Downtime ... all my fault

I just went to check my email ... over 1900 database error alerts:!:
The Queen of DaniWeb
cscgal is online now Online
13,645 posts
since Feb 2002
Jun 8th, 2006
0

Re: DaniWeb Downtime ... all my fault

welcome to the wonderful world of beta software :mrgreen:
duckman
jwenting is offline Offline
7,719 posts
since Nov 2004
Jun 8th, 2006
0

Re: DaniWeb Downtime ... all my fault

The problem isn't the fact that it's beta software - it's not really buggy. The problem is that I completely understimated the amount of time it would take to upgrade my heavily modified and hacked vBulletin.
The Queen of DaniWeb
cscgal is online now Online
13,645 posts
since Feb 2002
Jun 9th, 2006
0

Re: DaniWeb Downtime ... all my fault

Where do you learn how to do all that. Is it information you have amassed on the fly from experience?
Posting Expert
iamthwee is offline Offline
5,865 posts
since Aug 2005
Jun 13th, 2006
0

Re: DaniWeb Downtime ... all my fault

Lool

i'd say that never happened to me before, but it did, so i feel with you dani
Technical Admin
Xenon is offline Offline
5 posts
since Jul 2005
Jun 14th, 2006
0

Re: DaniWeb Downtime ... all my fault

Thanks for the support, Stefan. I actually set up a test installation this second time around and it's near ready to be launched. Everything is working fine - it's just that I am going to wait until at least RC before I go live, after this scare.
The Queen of DaniWeb
cscgal is online now Online
13,645 posts
since Feb 2002
Jun 19th, 2006
0

Re: DaniWeb Downtime ... all my fault

All our puppies are top quality english bulldog puppy, Full AKC registration With Multiple Champion Bloodlines, wonderful with small children.Excellent Companion. And they are ready for Thier new loving home.for more information you can visit our website at:www.allpuppies.net
Newbie Poster
joe12 is offline Offline
1 posts
since Jun 2006
Jul 4th, 2006
0

Re: DaniWeb Downtime ... all my fault

Indeed you under-estimated the time to upgrade ...
Thanks for posting your experience with upgrade, it will surely help to consider the things when upgrading anything.
Newbie Poster
Zaigham is offline Offline
1 posts
since Jul 2006
Oct 19th, 2006
0

Re: DaniWeb Downtime ... all my fault

You're welcome.
The Queen of DaniWeb
cscgal is online now Online
13,645 posts
since Feb 2002
Message:
Previous Thread in Database Design Forum Timeline: Employee Salary Database design.
Next Thread in Database Design Forum Timeline: Help with student induction timetable database





About Us | Contact Us | Advertise | Acceptable Use Policy
Forum Index | Build Custom RSS Feed


Follow us on Twitter


© 2011 DaniWeb® LLC