.com.unity Forums
  The Official e-Store of Shrapnel Games

This Month's Specials

Raging Tiger- Save $9.00
World Supremacy- Save $9.00

   







Go Back   .com.unity Forums > Shrapnel Community > Space Empires: IV & V

Reply
 
Thread Tools Display Modes
  #11  
Old October 27th, 2007, 02:07 PM

AstralWanderer AstralWanderer is offline
Corporal
 
Join Date: Oct 2006
Posts: 131
Thanks: 0
Thanked 0 Times in 0 Posts
AstralWanderer is on a distinguished road
Default Re: So I\'ve got two 500GB HDs...

Fyron said:
Relying on the user making manual backups is not a sound strategy. There will be lapses, and Murphy's Law guarantees that any problems will occur during those lapses.


As I noted above, you can automate backups, and they are very much necessary whether mirroring or not.

Fyron said:
With sound partitioning strategies, malware infections are trivial to clear out....Even with a RAID, formatting the Windows partition and reinstalling to fix deep malware infection isn't that big of a deal.


I disagree. Partitioning can make restoring from a backup easier (providing the option of restoring the Windows partition only to recover from registry corruption without affecting the applications installed) but it most certainly does not make a Windows reinstall easy! Most applications store data in the Windows Registry which will be lost in such an event, meaning that many will need to be reinstalled and reconfigured. The time taken for this can greatly outweigh that of installing and configuring Windows itself (and could take days in the case of a well-developed setup with dozens of applications).

Fyron said:
RAID 0 is never an option. Don't even consider it.


Depends on the situation. I use it and for me the performance benefits outweigh the increased likelihood of disk failure (which a regular image backup takes care of). Indeed, the only situations where mirroring could pose an advantage are those where the data is critical enough to merit using higher RAID levels anyway.
Reply With Quote
  #12  
Old October 27th, 2007, 03:11 PM
narf poit chez BOOM's Avatar

narf poit chez BOOM narf poit chez BOOM is offline
Shrapnel Fanatic
 
Join Date: Mar 2003
Location: CHEESE!
Posts: 10,009
Thanks: 0
Thanked 7 Times in 1 Post
narf poit chez BOOM is on a distinguished road
Default Re: So I\'ve got two 500GB HDs...

Well, instead I stayed up all night reading fanfiction. But, on the bright side, this is all very informative.
__________________
If I only could remember half the things I'd forgot, that would be a lot of stuff, I think - I don't know; I forgot!
A* E* Se! Gd! $-- C-^- Ai** M-- S? Ss---- RA Pw? Fq Bb++@ Tcp? L++++
Some of my webcomics. I've got 400+ webcomics at Last count, some dead.
Sig updated to remove non-working links.
Reply With Quote
  #13  
Old October 27th, 2007, 04:35 PM
Fyron's Avatar

Fyron Fyron is offline
Shrapnel Fanatic
 
Join Date: Jul 2001
Location: Southern CA, USA
Posts: 18,394
Thanks: 0
Thanked 12 Times in 10 Posts
Fyron is an unknown quantity at this point
Default Re: So I\'ve got two 500GB HDs...

An image backup of a whole RAID 0 array is going to be crazily large (and you need to backup everything for the inevitable hdd failure). Better to not even bother with RAID 0 and just go with the original plan of two separate disks and manual backups. Its not worth the risks. And as you said, the performance gains are not that relevant for a desktop system. Server, yes. Media center PC, probably not. Gaming/workstation PC? Not really. The CPU is generally a bigger bottleneck in file I/O than the disks themselves in a single user workstation, where the disk isn't being constantly bombarded by requests from dozens to 100s of concurrent users.

A well-developed Windows install doesn't rely on dozens of registry-bound applications. There are always alternatives that store their settings in local files, with only a minimal amount placed in the registry when you run them. Hell, even our reason for being here has never needed to be reinstalled. My SE4 install dates from the original installation back in 2001, which has spanned two separate computers, a failed primary hdd, and half a dozen other MS OS re-installations (some of which involved oscillating between win2k and xp, so I'm not that crazy ). Even SE5 just asks for a CD key on first run.

As time goes on, I find myself having to reinstall fewer and fewer applications with OS reformats. Other than poorly designed MS and Adobe software (and some games), the stuff I do need to reinstall still tends to store the real app data in local files (or at worst in easy to copy/paste Local Settings folders), so reinitializing them is a cinch. It also helps to point a few key folders, like "My Documents," to a different partition with TweakUI (I'd recommend against Program Files, cause a ton of garbage builds up in there; instead install apps you want to keep in D:\Programs). When I reformat, most of my apps can be run directly from the D: partition without any extra effort. A few others need a backed up settings/profile folder copied into the Local Settings folder, and are then good to go. The 3 or 4 apps that actually need installation can just be installed when needed in the future. No big deal.

Would I be better off with disk images for restoration? Not really, since that doesn't remove the cruft that builds up over time, the primary reason for reinstalling the OS. Frequent disk image backups would only let me undo the changes for the past week or two. Malware infections that can't be fixed from safe mode are few and far between, especially with XP SP2 and Vista (anecdotally, I've suffered twice as many hdd failures as irreparable malware infections). A base disk image of the Windows partition post installation and basic setup would help somewhat, but it would fail to be relevant if I ever change hardware components or decide to switch to some different apps. Such necessitates creating a new base image, which over time results in more time and effort than just reinstalling the OS and restoring the Local Settings folders.

Interestingly, a lot of this is just coincidental to the apps I prefer using for various tasks. It seems that the better software design these apps have overall winds its way all the way to the bottom level choices of where to store critical data. The registry was a terrible invention that just needs to fade into dust already...
__________________
It's not whether you win or lose that counts: it's how much pain you inflict along the way.
--- SpaceEmpires.net --- RSS --- SEnet ModWorks --- SEIV Modding 101 Tutorial
--- Join us in the #SpaceEmpires IRC channel on the Freenode IRC network.
--- Due to restrictively low sig limits, you must visit this link to view the rest of my signature.
Reply With Quote
  #14  
Old October 27th, 2007, 08:31 PM

Raapys Raapys is offline
First Lieutenant
 
Join Date: Jan 2005
Posts: 689
Thanks: 0
Thanked 0 Times in 0 Posts
Raapys is on a distinguished road
Default Re: So I\'ve got two 500GB HDs...

I think you must have just been extremely unlucky with your hdds, Fyron. I can't recall the last time I heard of anyone I know having their hdd fail, nor have any of my own hdd's ever failed. You will also find that companies like Dell/Alienware are now selling their high-end computers with Raid0 by default. I wouldn't bother with 'wasting' a hdd on going Raid1 for anything but 'can't risk losing this'- type of data, and I wouldn't store that on my home-entertainment computer at any rate.

The average user might not notice a drastic difference with Raid0's performance increase( unless it's a 2x 10,000 RPM setup, i.e. 3x the speed of a normal hdd ), but it will definitely speed up things like loading of windows, faster loading of applications and demanding games, etc. You'll also get a smoother windows experience in general.
Reply With Quote
  #15  
Old October 28th, 2007, 04:46 AM

StarShadow StarShadow is offline
Sergeant
 
Join Date: Mar 2006
Location: NS, Canada
Posts: 300
Thanks: 0
Thanked 0 Times in 0 Posts
StarShadow is on a distinguished road
Default Re: So I\'ve got two 500GB HDs...

Quote:
narf poit chez BOOM said:
Well, instead I stayed up all night reading fanfiction. But, on the bright side, this is all very informative.
Did you at least get the cookies? Personally I suggest having cookies before, during and after the install..
Reply With Quote
  #16  
Old October 28th, 2007, 08:49 AM
narf poit chez BOOM's Avatar

narf poit chez BOOM narf poit chez BOOM is offline
Shrapnel Fanatic
 
Join Date: Mar 2003
Location: CHEESE!
Posts: 10,009
Thanks: 0
Thanked 7 Times in 1 Post
narf poit chez BOOM is on a distinguished road
Default Re: So I\'ve got two 500GB HDs...

Slept too long to get cookies.
__________________
If I only could remember half the things I'd forgot, that would be a lot of stuff, I think - I don't know; I forgot!
A* E* Se! Gd! $-- C-^- Ai** M-- S? Ss---- RA Pw? Fq Bb++@ Tcp? L++++
Some of my webcomics. I've got 400+ webcomics at Last count, some dead.
Sig updated to remove non-working links.
Reply With Quote
  #17  
Old October 29th, 2007, 04:43 PM

AstralWanderer AstralWanderer is offline
Corporal
 
Join Date: Oct 2006
Posts: 131
Thanks: 0
Thanked 0 Times in 0 Posts
AstralWanderer is on a distinguished road
Default Re: So I\'ve got two 500GB HDs...

Fyron said:
An image backup of a whole RAID 0 array is going to be crazily large (and you need to backup everything for the inevitable hdd failure).


For a new Windows system, image backups are going to be a lot smaller (a couple of gigs at most) which is why I suggested using the 160GB to start with for storing them. By the time Narf has enough porn/warez/SE mods to need more space for backups, a bigger drive should be a lot cheaper.

Fyron said:
And as you said, the performance gains are not that relevant for a desktop system. Server, yes. Media center PC, probably not. Gaming/workstation PC? Not really. The CPU is generally a bigger bottleneck in file I/O.


I'd agree with Raapys that games do tend benefit from RAID (faster level loads for example). My previous comments on performance were in relation to partitioning, not RAID setup.

Fyron said:
There are always alternatives that store their settings in local files, with only a minimal amount placed in the registry when you run them...Even SE5 just asks for a CD key on first run.


While there are well-behaved and robust applications that can cope with just having their files plopped on a new system, it is not possible for a user to tell which ones they are without actual testing. The trend seems to be for using the registry more rather than less so it would seem unwise to rely on file-only copying (plus this method can't deal with locked files). Image backups avoid any such problems.

Fyron said:
Would I be better off with disk images for restoration? Not really, since that doesn't remove the cruft that builds up over time, the primary reason for reinstalling the OS. Frequent disk image backups would only let me undo the changes for the past week or two.


Image backups can't deal with "software cruft buildup" true enough - there are other tools for that though (BTW I use Total Uninstall for this to take before and after snapshots of every install - it finds much of what a standard uninstall misses, but since it catches all changes, it is necessary to prune its log to remove those caused by other programs running in the background - and installs requiring a Windows restart require more work due to all the extra changes Windows itself then makes).

However it is in the case of a driver-install gone awry or some major configuration hiccup that an image backup comes into its own.

Fyron said:
Malware infections that can't be fixed from safe mode are few and far between, especially with XP SP2 and Vista (anecdotally, I've suffered twice as many hdd failures as irreparable malware infections).


With malware, Safe Mode is no defense since it can run within it (or disable it) via the SafeBoot registry keys - even Microsoft recommend a complete reformat/reinstall to recover from rootkit infection. Restoring an image backup (assuming you detected the problem before all backups were affected) should be just as effective (and a lot easier for non-experts).

Fyron said:
A base disk image of the Windows partition post installation and basic setup would help somewhat, but it would fail to be relevant if I ever change hardware components or decide to switch to some different apps. Such necessitates creating a new base image, which over time results in more time and effort than just reinstalling the OS and restoring the Local Settings folders.


Some people do use a base image combined with the likes of Power Shadow or Deep Freeze (this Wilders tthread has a good discussion for those interested). It is clearly not going to suit everyone though.

Fyron said:
Interestingly, a lot of this is just coincidental to the apps I prefer using for various tasks. It seems that the better software design these apps have overall winds its way all the way to the bottom level choices of where to store critical data. The registry was a terrible invention that just needs to fade into dust already...


While I'd agree with the registry being a disaster, it seems to be getting more use not less in my experience, with features like Windows Media Centre and Vista's Game Explorer requiring new keys to be set by applications. Add bloatware like .NET Framework (which added over 1MB worth of Registry entries when I monitored it) and I see things getting very much worse, not better.
Reply With Quote
  #18  
Old October 31st, 2007, 08:56 AM

Kasdar Kasdar is offline
Private
 
Join Date: Oct 2007
Posts: 11
Thanks: 0
Thanked 0 Times in 0 Posts
Kasdar is on a distinguished road
Default Re: So I\'ve got two 500GB HDs...

Ok, I am a computer technician. I got my degree in 1993 and my A+ Cert in 1996. I fully concur with what Fyron said. RAID 0 is very bad and those of you who think your hard drives won't fail are the ones who are gonna have the most problems. If you don't care about redundancy simply partition your primary hard drive with a reasonable partition for storing WINDOWS, then use the remaining partition and the other drive for your data and programs. There is no reason to do a RAID 0 configuration as with the drives you are using and the array's that come with windows and/or motherboards you WILL NOT see any improvement in performance, however you mast likely will eventually run into a situation where you will lose everything because of a simple disk failure, if you decide on the RAID 0 approach.

The option I might suggest to you would be to install WINDOWS on your 160gb HD and, use the other 2 drives in a raid 1 array to store your data. that way you have the best of both worlds. As most motherboards have 2 IDE headers that each support 2 drives. Put the 160gb HD as a master on the same cable as your CD/DVD drive and set it to slave. Then run the 2 500gb HD's on the other Header and use RAID 1.
Reply With Quote
  #19  
Old October 31st, 2007, 06:31 PM

AstralWanderer AstralWanderer is offline
Corporal
 
Join Date: Oct 2006
Posts: 131
Thanks: 0
Thanked 0 Times in 0 Posts
AstralWanderer is on a distinguished road
Default Re: So I\'ve got two 500GB HDs...

Kasdar said:
RAID 0 is very bad and those of you who think your hard drives won't fail are the ones who are gonna have the most problems.


And exactly where has anyone in this thread assumed that hard disk failure wasn't an issue? The point I have been trying to make (and which you seem to have profoundly missed) is that configuration corruption (due to causes like a failed driver install or malware compromise) is a far more common problem than drive failure. RAID mirroring does nothing to cover this area, only a regular backup will (with a full image backup being the easiest to make and restore from).

The likelihood of failure (as doubtless any A+ tech should know...) for an average drive will be somewhere between 2-4% per year. Over a 5-year period, a 4% ARR (Annual Replacement Rate) drive has a 19.5% chance of failing, with a RAID 0 2-drive array doubling this (39%). For a 3-year period the figures are 11.5%/23% respectively. So yes, users of RAID0 arrays definitely should keep regular backups (a point made repeatedly in this thread) but whether you are using RAID or not, you still need to keep backups - the backup frequency being dictated by the maximum amount of data you are prepared to lose.

On top of that, the prudent user should consider regularly replacing their hard drives - DansData sugguests 3 years as a good point.

Kasdar said:
There is no reason to do a RAID 0 configuration as with the drives you are using and the array's that come with windows and/or motherboards you WILL NOT see any improvement in performance


This is BS - faster hard drives will always provide a performance improvement and for a home user, games will show the most obvious benefit.

Kasdar said:
The option I might suggest to you would be to install WINDOWS on your 160gb HD and, use the other 2 drives in a raid 1 array to store your data. that way you have the best of both worlds.


With that setup, an extra hard disk would have to be purchased to store image backups (using multiple CDs or DVDs is possible but impractical for current PC setups which can easily exceed 50GB in size). Using the 160GB for backup instead as suggested above provides a short-to-medium term solution.

RAID 1 only makes real sense for systems that have to be up 24/7 where instant recovery from hard disk failure is needed and even then, higher RAID levels with hot-swap capability would serve better.
Reply With Quote
  #20  
Old October 31st, 2007, 09:22 PM

Raapys Raapys is offline
First Lieutenant
 
Join Date: Jan 2005
Posts: 689
Thanks: 0
Thanked 0 Times in 0 Posts
Raapys is on a distinguished road
Default Re: So I\'ve got two 500GB HDs...

Also, you guys seem to be missing the fact that most people want the biggest possible amount of disk space these days. For most people I know, there's no way they'd sacrifice 500gb of space by going Raid1 just to possibly avoid the consequences of a disk failure.

This is how I think it should be done: Put two smaller hdds in a Raid0 array and then install windows and all your applications and games onto that array. This will let those programs take advatange of the great performance of Raid0. Then you simply use a regular hdd of some size for storage; put all your documents, movies, save-games, porn, whatever, in there.

Should the Raid0 array ever fail, it's simply a matter of replacing the broken disk and reinstalling windows and your games and applications. All the important stuff will still be stored on your storage disk.
Reply With Quote
Reply

Bookmarks


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is On

Forum Jump


All times are GMT -4. The time now is 08:32 AM.


Powered by vBulletin® Version 3.8.1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Copyright ©1999 - 2024, Shrapnel Games, Inc. - All Rights Reserved.