(Updated) Maintenance Complete

Update 6:05PM EST: Database maintenance complete.  Couple of last minor steps and bringing the site back up.  Thanks for your patience!  Let me know if anything isn’t working!

Update 5:47PM EST: Rebuilding indexes…  I probably don’t need quite this many indexes…

Update 4:23PM EST: Still going.  Initial estimate was incorrect.  Will update again when it’s done or in an hour.  Weird that I keep updating on the 3s…

Update 3:23PM EST: Repairing the last database.  I suspect 45-60 minutes until the site is back up.  Thanks for your patience!

Update 2:43PM EST: Software updated, working on compacting databases now.  This will take awhile…

I’m currently doing some server work that will require a couple/few hours of downtime.  I’ll update this post with any updates or information as I figure out how long it’s going to take!

Feel free to go chat on the forums if you’re bored!

Upcoming Maintenance

At some point this weekend (probably 2012-1-1 in the afternoon EST) I’m going to be doing some maintenance on the site.  I will almost certainly be taking the site down for a few hours in order to do this work.  I’m not totally sure how long the site will be down right now as some of the work I want to do may take quite a bit of time.

For the nerds out there, this is what I’m up to:

- Updating all server software to the latest version (mostly security fixes and whatnot)

- Upgrading the database to the newest version (this is more important and could take some time)

- Compacting the database to give me a little more breathing room in terms of disk space.

The last one is likely the most time intensive and important.  The Raidbots database is currently at about 100GB and steadily growing.  The newest version of Mongo has some functionality that should help contain the growth a little bit to allow some more time before I need to start upgrading the server hardware.

I’ll post updates on this blog and on the Raidbots forum thread.

Daily Updates Now at Noon EST

Due to some changes World of Logs is making, Raidbots will be updating an hour or two later than it usually does.  The job to process all the exports will now start at 10 EST instead of 8 EST.  This should likely result in Raidbots being up-to-date from the day before at closer to noon EST based on how long it takes to process.

Hopefully, this change from World of Logs will result in more parses making their way to Raidbots.  They identified some issues with live logs that could cause the spotty reporting of parses that a bunch of you folks have seen.  Pushing the data export that I use back a couple hours should hopefully result in no more missing logs! \o/

Also, today’s batch of data didn’t quite run properly because of the time change.  It should sort itself out by tomorrow.

Bug Fixes, Help Me with Potential Mistakes!

Bugs/issues addressed:

• LFR should not be processed at all and should not show up on the site.  It’s too much data to store for not a lot of benefit (note: this does rely on World of Logs correctly identifying a parse as LFR and not normal.  If WOL thinks it’s normal, Raidbots thinks it’s Normal)
• Fixed tracking of Yor’sahj.  I was not matching WOL’s usage of the full name of the boss.
• Brazil servers added
• Added Rune Tap to DK Significant Class Skills

Help with CompareBot Potential Mistakes!

I’m also not actively playing right now so I’m not up-to-date on the mechanics of the new bosses.  If you like to use CompareBot and want to see some of the boss abilities tracked on there, let me know in the forum!  I’ll run a pass on my own but I’ll certainly miss things that you guys would like tracked.

4.3 Data Starting to Show Up

Data for Dragon Soul should now be flowing into all the ‘Bots around here.  I have a request open with World of Logs to see if I can backfill the data between 4.3 launch and today to make sure all your first week reports are in EpeenBot and that there is some continuous data from the launch of 4.3

As always, let me know if you find an issue or if reports aren’t showing up (that’s something else that the WOL guys are looking into).

4.3 Update

So I think stuff should be as ready as I can make it.  Tomorrow morning we’ll see if the data importer and WOL play nicely together.  Expect a few bumps and let me know if you find any problems with CompareBot, EpeenBot, or DPSBot!

Firelands has been moved into Previous Tiers.  I’m not entirely sure how WOL will track Spine and Madness of Deathwing so we’ll see how that pans out.

Update: Looks like the new bosses didn’t show up in the WOL export.  Email out to them to figure out when that should show up.  Might be a couple of days before we have data here – I’ll keep the blog updated when/if something changes.

Update Hiccup

Looks like Daylight Savings time broke data updates for today and yesterday.  I’ve fixed the issue and am getting data up to date now.  Sorry for the bug!

Raidbots on Hunting Party Podcast Saturday!

Frostheim has invited me to be a guest on the Hunting Party podcast this Saturday 10/6 at 2PM EST / 11AM PST!

http://www.huntingpartypodcast.com/

I’ll be talking to him about Raidbots, stats, and whatever else comes up.  Come join us in the live chat or listen once it’s done!

Reparsing Data!

I’m in the process of reprocessing all World of Logs exports since the beginning of 4.2 There’s been a lot of reports of missing parses on Epeen Bot so hopefully this will catch most all of those.

This will take a while – probably a week or more as my batch processing is somewhat slow right now so that the speed of the rest of the site isn’t impacted. Hopefully this resolves the missing parse problem!

Raid Achievements Broken :(

This has been true for a while and I’m just starting to get around to fixing it.  Time has been sparse recently and it’s going to require a good chunk of work to get this working again.

The core issue is that Blizzard finally shut down the old armory which is where raidbots was getting player achievement.  I’m in the process of writing code to use the new WoW Community APIs but it’s quite different than the old XML feeds.  It may be a while until I have enough time to sort this all out.  Sorry!

In other news, the hurricane didn’t break anything!  \o/  Hooray!