We're a community of 1076K IT Pros here for help, advice, solutions, professional growth and fun. Join us!
1,075,621 Members — Technology Publication meets Social Media
Username:
Password:
Lost login information?

DaniWeb Downtime ... all my fault

0
By Danielle Horowitz on Jun 8th, 2006 6:58 am

Well, I just got myself through a major disaster. A couple of days ago, vBulletin, the forum system which powers the core of DaniWeb, released a shiny new version, vB 3.6. Every day since, they've been announcing new features - many of which look just awesome!

This afternoon, they finally released public beta. My first instinct was to naturally wait until stable. However, when 7pm rolled around, my anxiousness got the better of me.

I dutifully backed up the database and the filesystem, and away I went. Only to find that the upgrade wasn't trivial by any means, but rather required many file edits and template edits and all kinds of stuff ... the kinda stuff that you'd be crazy to not have a test server running for at least a week first before attempting the upgrade.

Well ... that was behind me now. So the clock is ticking ... 8 pm rolls around, and I try to crazily scramble to fix one thing after another. Maybe if I pull an allnighter ...

And then I think about that SQL backup I saved! But last time I ran a mysql > source to restore the database, it took about 8 hours, and that was months ago! Imagine how long it would take this time.

On the other hand, once I went through the 8+ hours of downtime, we'd at least be back to normal before the morning. My only other option at this point was to pull an allnighter - or two - scrambling to upgrade all of my hacks and additions and templates and everything else to be 3.6 compatible. Remember, only the CORE of DaniWeb is based on vB - the portal, blogs, code snippet library, tutorials, link directory, and all of the extra features, which are all integrated btw, are my own creation.

So, I sighed, I took a deep breath, and I flushed out the live database, and restored from backup. And ... drumroll please ... it finished in less than five minutes. I promise you. In fact, if I am lying, I wouldn't be able to type this all out right now, one hour after I started this whole disaster (Which turned into about 30 mins on and off of downtime during and after the upgrade when I didn't know what to do with myself).

The moral of the story is don't underestimate the power of a new dual core dual opteron as a dedicated database server. I swear to you guys ... what used to take a full half of a day on a Dual Xeon took 5 minutes max on a dual core Dual Opteron. Aside from the difference in the processor, the other advantage (and it's a big one) is that I now had a dedicated database server which was able to focus entirely on restoring the backup, and didn't have to deal with constant Apache connections and 1000+ users trying to browse a site that's down.

So ... the upgrade will be for another day, after it's already been fully prepared on a test server and ... did I mention ... when it's outta beta?

I just went to check my email ... over 1900 database error alerts:!:

Dani
The Queen of DaniWeb
Administrator
21,343 posts since Feb 2002
Reputation Points: 1,555
Solved Threads: 367
Skill Endorsements: 119

welcome to the wonderful world of beta software :mrgreen: :twisted:

jwenting
duckman
Team Colleague
8,522 posts since Nov 2004
Reputation Points: 1,656
Solved Threads: 345
Skill Endorsements: 18

The problem isn't the fact that it's beta software - it's not really buggy. The problem is that I completely understimated the amount of time it would take to upgrade my heavily modified and hacked vBulletin.

Dani
The Queen of DaniWeb
Administrator
21,343 posts since Feb 2002
Reputation Points: 1,555
Solved Threads: 367
Skill Endorsements: 119

Where do you learn how to do all that. Is it information you have amassed on the fly from experience?

iamthwee
Posting Genius
6,254 posts since Aug 2005
Reputation Points: 1,567
Solved Threads: 476
Skill Endorsements: 33

Lool

i'd say that never happened to me before, but it did, so i feel with you dani ;)

Xenon
Technical Admin
Team Colleague
5 posts since Jul 2005
Reputation Points: 10
Solved Threads: 0
Skill Endorsements: 0

Thanks for the support, Stefan. I actually set up a test installation this second time around and it's near ready to be launched. Everything is working fine - it's just that I am going to wait until at least RC before I go live, after this scare.

Dani
The Queen of DaniWeb
Administrator
21,343 posts since Feb 2002
Reputation Points: 1,555
Solved Threads: 367
Skill Endorsements: 119

All our puppies are top quality english bulldog puppy, Full AKC registration With Multiple Champion Bloodlines, wonderful with small children.Excellent Companion. And they are ready for Thier new loving home.for more information you can visit our website at:www.allpuppies.net

joe12
Newbie Poster
1 post since Jun 2006
Reputation Points: 10
Solved Threads: 0
Skill Endorsements: 0

Indeed you under-estimated the time to upgrade :P ...
Thanks for posting your experience with upgrade, it will surely help to consider the things when upgrading anything.

Zaigham
Newbie Poster
1 post since Jul 2006
Reputation Points: 10
Solved Threads: 0
Skill Endorsements: 0

You're welcome.

Dani
The Queen of DaniWeb
Administrator
21,343 posts since Feb 2002
Reputation Points: 1,555
Solved Threads: 367
Skill Endorsements: 119

Post: Markdown Syntax: Formatting Help
 
You
View similar articles that have also been tagged:
 
© 2013 DaniWeb® LLC
Page rendered in 0.1073 seconds using 2.75MB