Friday, February 29, 2008
Tuesday, February 26, 2008
Friday, February 22, 2008
Monday, February 18, 2008
Ok, so I've only been playing with Mindy for about 24 hours, but this build is looking a bit more promising. Right now, I'm copying files to my file server, listening to music off my Roku (also from the same VM) and importing CD audio on a second and nothing seems to be bogging down like before.
I still don't seem to get the write performance that I would want from the network. It still seems to be writing in spurts (20-30 Mb straight and then a pause), but I think these can be fixed via filesystem fine tuning.
Once I have a good, working system, I'll post my complete settings.
Sunday, February 17, 2008
So, all my changes so far haven't resulted in a stable system. Well, stable yes, but performing ... absolutely not.
Now that I'm back from my business trip, it's time to try again. This time I had planned on using Ubuntu 6.06.2 LTS amd64 as it's supported (officially) by both the 3ware card and VMware Server. However, that seemed to not like something about my configuration. All I got was a hang after "Booting kernel ..." on the installer.
So, then I tried OpenSuSE 10.2 Community (the OS I was using before all this started). That booted, but it couldn't find the array.
So, I happened to have a Ubuntu Server 7.0.4 x86 32-bit CD and out of desperation, I tried that. An hour or so later, Mindy is back up and running. Now I just get to see if this solves my other problems. Sigh.
Saturday, February 09, 2008
Friday, February 08, 2008
- 3ware 9650SE 8-port SATA-II RAID card
- 2 additional 500Gb Seagate Barracuda drives (well 1 for now, the other still contains my backup)
- Replacing OpenSUSE 10.2 32bit with Ubuntu Server 7.10 64bit
Now, I picked the 3ware card because of the good reviews and good support for Linux. Also, I was looking for a reliable way to do RAID-5 on the system. A friend of mine scared me because he had a 50% failure rate on the same Western Digital drives I was using. (I'm still a WD fan, just not of these specific drives).
I assumed that when I launched into this project on Friday night it would be just a matter of bringing down the old system, backing up the VMs, installing the new hardware, reinstalling the software and off to the races.
Well, not quite ...
My first attempt seemed to be a complete failure. The I/O performance I was getting was terrible. It took 5 hours to copy 100Gb of virtual hard disks to the internal drive from a USB 2.0 external drive. In that same 5 hours before, I was able to copy all 500Gb of virtual hard disks. In addition, it appeared that the CPU utilization was tremendously high, so I knew something wasn't quite right.
It would appear that my first pass was a failure for the following reasons (though I'm not 100% sure on this):
- I had to se my motherboard's video settings to use only the integrated video (my RAID card is PCI Express 4x)
- Somehow in trying to enable write caching, the array had been left in a weird state (the 3ware BIOS Manager keep saying INIT ARRAY ... whatever that means)
- I had used the wrong block size (64k instead of 256k)
So, after about 18 hours of copying data and mucking about, I decided it was time to cut my losses and try again, so I burned down the array and recreated, this time enabling write caching and setting a 256k block size on the array.
This time, I seemed to have much better luck. I was able to copy the VMs at near correct speed (hour for the 100Gb of data) or something like that anyway and I could do other things while the data was copying too. So it looked much more promising this time.
I finally got everything loaded and was ready to start copying my media (220Gb worth) from the virtual hard disk stored on my external drive to a newly minted 500Gb virtual drive on the array. Both drives were attached to Pesto my Ubuntu 7.0.4 32-bit server.
This process took about 14 hours. Definitely not right, but hey, at least I could copy things, so it was progress. Unfortunately, the interactive performance of the system was still abysmal. After booting Bobby, my Windows XP VM, it was horrendously sluggish and it seemed that the drive array was in constant motion, something I hadn't seen in the old system.
After whining to 3ware and mucking about with system tuning, I realized 2 things:
- I had VMware set to allow VMs to be swapped out
- I had the "swappiness" of the Linux VM system too high ... or more specific, I needed to instruct the kernel not to swap out until absolutely necessary by adding the following line to /etc/syscontl.conf: "vm.swappiness = 0"
Thursday, February 07, 2008
So, meet Mindy. She's my VMware Server host that's become the cornerstone of my digital office / media / life. I started building her about a year ago after having a couple near hard drive failures on my older systems (morella, ultra60, firewall and plumb). Also, at about the same time, VMware started giving away their VMware Server product, so I started thinking seriously about server consolidation.
The end result was Mindy, an Intel Core2 Duo-based server running Linux and VMware. For you tech geeks, here are the "vitals"
- Antec P180 case
- Antec Earthwatts 500 watt power supply
- Intel DG965RYCK motherboard
- 4x Corsair 1Gb DDR RAM (originally 2x)
- 2 Western Digital 500Gb SATA drives
- OpenSuSE 10.2 32-bit Linux
- VMware Server 1.0.4
Then running on top of it are a number of virtual machines, including (but not limited to):
- Pesto: Ubuntu 7.0.4 server (file server, music server, Subversion server)
- Bobby: Windows XP Professional (iTunes podcatcher, e-mail client, etc)
- Morella: Slackware 8.1 (domain controller, imaged from the original machine)
- DrPlotz: OpenBSD 4.0 SSH server
It took about a week to put together, but she's now an indispensable part of my life. And to make thins even better, I took what was a 600 watt power budget (at least according to my UPS) down to 185 watts and taken the wind tunnel sound of the old systems down to a much more manageable volume. She's still a bit noisy (need better fans and maybe a better power supply), but for now, it's way better.