Planned Server Maintenance on March 30 : 08.00-12:00 GMT

Ishmaeel

Lion's Arch Merchant

Join Date: Jan 2006

zomg i carnt play game 4 four hours what are they thinkink anet gimme back my monay!!!

Heh. Just kidding. Wrote that so the idiots would not have to but I know they will anyway.

So people, I'm posting this as a notification to those who missed the network update news. Do not plan an important voyage/mission for the appointed time.

And thanks to ArenaNet for all the effort they are putting into the game. I hope they won't have a hard time with this maintenance.

Edit: Here's the link to the network news page : http://www.guildwars.com/aboutgw/net...ws/default.php

koneko

Site Contributor

Join Date: Sep 2005

38??16′ N 140??52′ E

Mo/Me

http://www.guildwars.com/aboutgw/networknews/

Quote:
Originally Posted by guildwars.com
Guild Wars will be unavailable during scheduled maintenance on March 30th from 00:00 PST (08:00 GMT) and 04:00 PST (12:00 GMT).

Unfortunately the Guild Wars database servers experienced a hardware failure that prevents them from operating properly, and in order to restore functionality we need to replace several components. We apologize for any inconvenience this maintenance may cause, and hope to have Guild Wars running again in short order.

For those folks with a technical bent, and for those who'd just like to know more about why we're taking such a long outage after almost a year with no scheduled maintenance, read on:

Because Guild Wars is a global game, where players from anywhere in the world can play against other gamers from any other location on the globe, there's really no good time to schedule maintenance because there isn't an idle period; there are always players from some part of the world enjoying the game. We've therefore strived to minimize the number of scheduled maintenance periods, and we've been largely successful.

While we have had several brief, unplanned outages in the nearly one year since the launch of Guild Wars, by and large we've been able to keep the game running continuously. We've had approximately twelve hours of downtime this year, ten hours of which was due to the unfortunate (but necessary) database rollback. Though the database rollback took quite a while to complete, the rollback only removed one hour of progress from character advancement, though we do realize that players lost their time, and for that we wholeheartedly apologize.

This outage is intended to allow us to perform some critical maintenance on our database infrastructure. In order to ensure that Guild Wars is always available, we purchased quite a lot of redundant server hardware (also known as clusters). The clusters are designed so that, if one part fails, another part is capable of taking over the load. Instead of one computer for a given task, there are two computers, each with multiple network cards, power-supplies, drive interface controllers, disk arrays, and all sorts of other components. While this is expensive, it's really the only way to ensure that the network continues to operate 24 hours a day, 7 days a week.

A simple analogy is that it's like having two lightbulbs (with two power supplies and two switches) to keep a room lit. If one bulb burns out, there's still time to change it before the room goes dark, unless the other bulb burns out at the same time, of course...

In the past we've had several successful cluster failovers, but unfortunately this time not everything worked as desired. Basically, one disk controller went bad, and even after replacing the controller we can't get the silly thing to come back again. To ensure that we don't have a catastrophic failure, we're taking down everything on Thursday morning (Pacific Time) so that we can replace the broken components and bring everything back to fully functioning service.

We've alloted four hours for the maintenance, and we certainly hope that it will take less time. We know that a lot of folks won't be able to play Guild Wars during that time period, but we hope that everyone will understand the necessity. We'll look forward to seeing you back in the game a little later in the day.
This part caught my attention:

Quote:
each with multiple network cards, power-supplies, drive interface controllers, disk arrays
Properly done RAID 5 ftw? D;

Ishmaeel

Lion's Arch Merchant

Join Date: Jan 2006

Quote:
Originally Posted by koneko
There was an earlier thread that got deleted...
Why was that deleted?

Savio

Savio

Teenager with attitude

Join Date: Jul 2005

Fifteen Over Fifty [Rare]

The earlier thread was deleted because there was so much misinformation being thrown around and the OP was rather vague. Claims that it'd be down the whole day, claims that it was just the support site... too many bad posts, not enough real information.

Sekkira

Sekkira

Forge Runner

Join Date: Apr 2005

Canberra, AU

And of course my panicing due to not being able to play guild wars for a day. Not that this is much better either.

FOUR HOURS CHRIST! *rocks self in a corner*

Feminist Terrorist

Feminist Terrorist

Desert Nomad

Join Date: Nov 2005

Oh Noes! The 'burbs!

Reminds me of the Verizon commercials: You get the network. lol

Ogg

Academy Page

Join Date: May 2005

12 hours of downtime in a year. And 10 of those because of that rollback.

I'm very, very impressed.

12 hours, in a year.

Anyone working in any IT-related business would give out their firstborn to be able to achieve same kind of uptime for the whole network.

VGJustice

VGJustice

Desert Nomad

Join Date: Jul 2005

Tyria, cappin' ur bosses

Boston Guild [BG]

R/W

well, that's unsetling. I've worked in an environment where scheduled maintanence periods were a thing of legend, and I still remember how badly our technicians were over-worked. Um, I don't mind a little downtime from time-to-time, if it means higher play quality overall. I'll have to see exactly how improved the game is after this 4 hour period, but I'm rather unnerved about this lack of maintainence periods. =\

It's that whole nightmare all over again.

Huntmaster

Huntmaster

Banned

Join Date: Jan 2006

I is not canadien

Guillotine Tactics [GanK]

R/

WoW has what, 12 hours of downtime a day?

jimmy_logic

jimmy_logic

Wilds Pathfinder

Join Date: Sep 2005

R/

Quote:
Originally Posted by VGJustice
well, that's unsetling. I've worked in an environment where scheduled maintanence periods were a thing of legend, and I still remember how badly our technicians were over-worked. Um, I don't mind a little downtime from time-to-time, if it means higher play quality overall. I'll have to see exactly how improved the game is after this 4 hour period, but I'm rather unnerved about this lack of maintainence periods. =\

It's that whole nightmare all over again.
Dont understand what you mean there? Do you want regular scheduled maintenance instead of the 12 hours that were unscheduled? I know what I want... the 12 hours that are unscheduled. Whats half a day!!!

Ogg

Academy Page

Join Date: May 2005

Quote:
Originally Posted by VGJustice
I'll have to see exactly how improved the game is after this 4 hour period, but I'm rather unnerved about this lack of maintainence periods. =\

It's that whole nightmare all over again.
Game won't be improved _that much_. You won't probably see or feel anything different after the maintenance. They'll just be replacing some hardware, which failed, and backupsystems didn't start properly. Current systems might be suffering from higher-than-usual-load, but they are working. Once the maintenance is complete, loads go back down to normal level on all the servers they have.

You dont need that many maintenance periods for the whole network, if you build it to be fault-tolerant, as A.net has done. One part fails, other, similar parts pick up the slack.

Redundancy ftw!


Quote:
Originally Posted by Huntmaster
WoW has what, 12 hours of downtime a day?
Totally different server-architecture. GW is built around instances, WoW is build around huge persistent world, which requires (or so I've been told) reboots, to clear all the little memoryleaks, open databases and so on.. Then again, it might just be crappy programming.

Closest thing to GW-system is DDO, which is built around non-combat areas and heavily instanced, same as GW. They have weekly maintenance, though

Dead Phlox

Academy Page

Join Date: Mar 2006

Angelic Knights of Ascalon

N/Mo

Quote:
Originally Posted by Huntmaster
WoW has what, 12 hours of downtime a day?
I believe the actual count is something along the lines of 12 hours of downtime per every 12.5 hours.

Havelock

Academy Page

Join Date: Feb 2006

Quote:
Originally Posted by koneko
Properly done RAID 5 ftw?
You wouldn't want that for a database. In that case performance is everything. So RAID 1 FTW (for the redundancy in one box and to survive single disk failures) and distribute it among as many channels and disk arrays as you can...

Big_Iron

Big_Iron

Desert Nomad

Join Date: Dec 2005

The Edge

Tormented Weapons [emo]

Quote:
Originally Posted by Havelock
You wouldn't want that for a database. In that case performance is everything. So RAID 1 FTW (for the redundancy in one box and to survive single disk failures) and distribute it among as many channels and disk arrays as you can...
*Buzz!!* Guess again. RAID 0+1. Performance + redundancy. I know a little something about clusters having built and maintained a couple hundred of them.

-Loki-

-Loki-

Forge Runner

Join Date: Oct 2005

No convenient time to do it. So we'll just do it Australia prime time.

Havelock

Academy Page

Join Date: Feb 2006

Quote:
Originally Posted by WoodyDotNet
*Buzz!!* Guess again. RAID 0+1. Performance + redundancy. I know a little something about clusters having built and maintained a couple hundred of them.
This is getting a bit off-topic, but do you really mean what you say?

RAID 0 doesn't give you any performance boost, as the number of disk writes/reads on a given number of disks and a given Bus System (be it SCSI, FC or whatever) is limited. And when running high volume databases (as the Guild Wars DB probably is) you'll want to get as many individual disks on as many different channels as possible.

RAID 0 does nothing to the number of read/writes your disks can serve, it just gives you a different view of the disks used.

Let's do some maths. Assuming one disk can handle 1000 reads / writes per second (just to have a number for simplicity). Putting a number of n of these in a RAID 0 would give you n*1000 reads / writes per second. Using n individual disks gives you the exact same n*1000 reads / writes per second.

If this were "I need to write a constant data-stream with high speed to some disks", RAID 0 would be a nice choice, but I've never seen an online database create that kind of load on a disk

Big_Iron

Big_Iron

Desert Nomad

Join Date: Dec 2005

The Edge

Tormented Weapons [emo]

Yeah Havelock, we don't want to get off topic, but RAID 0+1 gives you added performance with redundancy. Since this is their DB and it's constantly being tapped, they'd need high performance in addition to redundancy. It's been pretty much the standard for DB clusters for a few years now. If I were to guess, I'd bet they're running an Oracle DB on Sun or HP high end servers connected to an EMC. But that's pure speculation on my part.

boxterduke

boxterduke

Furnace Stoker

Join Date: Jun 2005

Walking the ruins of Ascalon

DVDF

Me/

I will be sleeping during that time so I wont notice anything anyway and when I wake up I will be heading to work.
hehe

Havelock

Academy Page

Join Date: Feb 2006

Quote:
Originally Posted by WoodyDotNet
Yeah Havelock, we don't want to get off topic, but RAID 0+1 gives you added performance with redundancy.
It seems you really believe that. So be it. But as I stated above: to double the performance (even with RAID 0) you have to double the number of disks.

I'll admit: with 4 disks forming a RAID 0+1 you get more performance (and more capacity) than with 2 disks forming a RAID 1 but what else could you expect?

Str0b0

Desert Nomad

Join Date: Feb 2006

North Carolina

N/Me

Thank god someone finally linked the actual post about this. Now I can see why they are taking it offline instead of using their fail overs to run parallel units while they work on one. Oh well looks like I gotta get a life for four hours tomorrow. that kinda sucks. LoL

Big_Iron

Big_Iron

Desert Nomad

Join Date: Dec 2005

The Edge

Tormented Weapons [emo]

Quote:
Originally Posted by Havelock
It seems you really believe that. So be it. But as I stated above: to double the performance (even with RAID 0) you have to double the number of disks.

I'll admit: with 4 disks forming a RAID 0+1 you get more performance (and more capacity) than with 2 disks forming a RAID 1 but what else could you expect?
Here's a little something from Sun.

http://blogs.sun.com/roller/page/andresblog/20050614

Also, when dealing with a DB like this one, you're probably talking dozens of disks (if not more) and terabytes of storage.

neoteo

neoteo

Banned

Join Date: Jun 2005

Macau

www.exilesofdarksteel.com

E/

we have 400 computers where i work , network goes down almost every week.

its a miricle 12 hours in one year

wolfe2dale

wolfe2dale

Frost Gate Guardian

Join Date: Feb 2006

Hemel Hempstead

Guildless...

E/Me

Thumbs up to Anet for picking the most unlikely time to impact the majority of gamers

08:00-12:00? Almost everyone I know who plays will be at work...Well done Anet!

Str0b0

Desert Nomad

Join Date: Feb 2006

North Carolina

N/Me

Quote:
Originally Posted by neoteo
we have 400 computers where i work , network goes down almost every week.

its a miricle 12 hours in one year
I agree although it is possible to run a Five Nine network if you can afford the redundancies. Disk space gets cheaper every year. Still 12 hours of downtime for the year. Those are some hard working admins.

KvanCetre

Wilds Pathfinder

Join Date: May 2005

The Madison Scouts

E/Mo

Quote:
Originally Posted by Huntmaster
WoW has what, 12 hours of downtime a day?
Roughly 12 hours a week.
There is at least 8 hours of downtime EVERY SINGLE Tuesday.

On the day of a patch? Welcome to 24 hours.

Aside from the Tuesday Maintenance, you have to deal with the occasional downtimes that would popup here and there.

Worst Servers Ever.

And thats with 4 million people paying 15 bucks a month.

posmo

Ascalonian Squire

Join Date: Nov 2005

Florida

Celestial League of Ascalon War

N/

Quote:
Originally Posted by KvanCetre
Worst Servers Ever.
I agree.. After a patch it's hell- and ANET has done a great job.. 4 hours or less of downtime = not a prob!

JiggyFly

JiggyFly

Lion's Arch Merchant

Join Date: Jan 2006

So-Cal

Forsaken Wanderers [FW]

Mo/

The only reasonable explanation for Anet having so little downtime is that they have a team of uber 1337 haxorz working for them.

But 4 hours without Guild Wars....that's like...well 4 hours I won't be playing Guild Wars..Crap!

Karmaniac

Karmaniac

Lion's Arch Merchant

Join Date: Feb 2006

Quote:
Originally Posted by Ishmaeel
zomg i carnt play game 4 four hours what are they thinkink anet gimme back my monay!!!
For reasons unknown this is quite precisely what I first thought of posting. And 12 hours, not a mean feat. Gotta respect that.

MSecorsky

MSecorsky

Furnace Stoker

Join Date: Jun 2005

So Cal

The Sinister Vanguard

Me/

Four hours beginning at midnight the day before a holiday. Ah well, I'll be getting to bed early.

Naxohs Seralna

Naxohs Seralna

Frost Gate Guardian

Join Date: Nov 2005

Norway

House of the Silver Phoenix (HSP)

E/R

8-12 PEE EM
or
8-12 EY-EM

?

WasAGuest

Desert Nomad

Join Date: Jan 2006

Quote:
Originally Posted by Sekkira
And of course my panicing due to not being able to play guild wars for a day. Not that this is much better either.

FOUR HOURS CHRIST! *rocks self in a corner*
This is absolutely my favorite post today. I got a great chuckle from it.

ravenwolf77

Pre-Searing Cadet

Join Date: Mar 2006

EVA

N/W

u know they just have a bunch of magic fairies typin on old style typewritrs &
no real computers right
the down time is just to feed the gerbils

Ishmaeel

Lion's Arch Merchant

Join Date: Jan 2006

Quote:
Originally Posted by Naxohs Seralna
8-12 PEE EM
or
8-12 EY-EM

?
PM? AM? Why do you cling to that horrendous habit of dividing the day by two and then by twelve anyway? I'm amazed that you even manage to go to work on the right day, not to mention at the right time!

Heh. Kidding again. The times I posted are GMT which means they are always expressed in 24h format. That would be [a few seconds pass while he calculates with his brows creased] 8-12AM for those in Greenwich but since you don't seem to live there, most probably you will need to calculate the time for yourself, considering your time zone.

Edit: Checked your profile. It is 10AM-2PM for you.

dargon

Furnace Stoker

Join Date: May 2005

The Seraphim Knights [TSK]

R/

8-12 gmt = 12am-4am pacific time = 2am - 6am central time = 4am - 8am eastern time. IOW, Go to bed and don't worry about it!

Big_Iron

Big_Iron

Desert Nomad

Join Date: Dec 2005

The Edge

Tormented Weapons [emo]

Quote:
Originally Posted by dargon
8-12 gmt = 12am-4am pacific time = 2am - 6am central time = 4am - 8am eastern time. IOW, Go to bed and don't worry about it!
That's 3 AM to 7 AM for me. No worries.

Ishmaeel

Lion's Arch Merchant

Join Date: Jan 2006

Quote:
Originally Posted by Karmaniac
Quote:
Originally Posted by Ishmaeel
zomg i carnt play game 4 four hours what are they thinkink anet gimme back my monay!!!
For reasons unknown this is quite precisely what I first thought of posting. And 12 hours, not a mean feat. Gotta respect that.
I was hoping that one would be quoted out of context on the first page. Now I'm gonna get the living flame beaten out of my ass on the third page

pigdestroyer

pigdestroyer

Wilds Pathfinder

Join Date: Jan 2006

Los Chavos Del [ocho]

W/

Four Hours what are they thinking!?!?!??!?!???????????

gimme ma money back

Omega X

Omega X

Ninja Unveiler

Join Date: Jun 2005

Louisiana, USA

Boston Guild[BG]

W/Me

Quote:
Originally Posted by pigdestroyer
Four Hours what are they thinking!?!?!??!?!???????????
A nice Brunch maybe?

Rayea

Rayea

Wilds Pathfinder

Join Date: Jun 2005

west yorkshire, Uk

Sisters of Serenity

N/Mo

time to get out the incenc sticks, bowl of infinate RAM and prayer wheel of SATA :P

and sit the servers down, have a very serious talk to them about being good, working hard and not explodong memeory all over the place

oh..and maybe test them by running every ele femail to LA in her undies and standing in color coded groups for a 20 min dance for the a-net xmas party video *winks*

*imagines the groups of eles doing a Ascalon wave lol*

gota had it to them, though...considering how many peeps use the game, 24/7/365...its damn good going to have a small a size of maint as that....
*wonders if the WoW servers are run on Windows *

nirhan shadowmauler

Lion's Arch Merchant

Join Date: Dec 2005

potland,oregon

Through the eyes of the dragon [eyes]

E/W

Quote:
Originally Posted by dargon
IOW, Go to bed and don't worry about it!
unfortunately thats right when i get home from work (12 am pst) and my prime playing time between 12 and 4. totally RED ENGINE GORED ENGINE GORED ENGINE GORED ENGINE GOs my whole day for GW. but on the other hand maybe i can catch up on my pirated movies.