Discussion:
[PVE-User] Best way to RAID1 a Proxmox VE server?
m***@mWare.ca
2009-03-30 22:13:04 UTC
Permalink
HI all, I suppose this question might be a bit out of scope for this
mailing list, but I'm rather out of touch with Linux's modem storage
system and I'm unsure as to the best way to go about setting up my PVE
server on RAID. I also want to make sure it gets done in a way that
doesn't interfere with the management system (which is why we're all
using PVE in the first place, right?) and/or any possible future
changes/interactions that may come along.

I'm running a recently updated PVE that was originally created using the
baremetal installer CD.

Thanks in advance,

Myke
Theron T. Trout
2009-03-31 02:56:55 UTC
Permalink
Hi Myke,

I setup a Proxmox VE server with 6 SCSI drivers in RAID 1+0 (stripped
and mirrored). It was a total of 1.2TB and it was blazing fast. We
configured a second, near identical, Proxmox machine and initially
didn't setup the same RAID configuration and it was considerably slower.
The speed difference was most startling with Windows 2003 KVM clients,
particularly during boot. The RAID 1+0 setup was a lot faster than the
other machine. Unfortunately, I don't recall how it's RAID was
initially configured.

Unfortunately, we were under some tight deadlines, so I wasn't able to
do any formal benchmarking before reconfiguring the slower machine. If
I ever get a chance to I'll try to pull some hard numbers, but I doubt
I'll get to tear down one of the two machines any time soon.

Hope that is helpful,
Theron
--
Theron Trout
Principal, Mellonway LLC

800-614-MWAY (6929)
301-358-5050
www.mellonway.com

Efficiency and Results through Expertise. (TM)
Post by m***@mWare.ca
HI all, I suppose this question might be a bit out of scope for this
mailing list, but I'm rather out of touch with Linux's modem storage
system and I'm unsure as to the best way to go about setting up my PVE
server on RAID. I also want to make sure it gets done in a way that
doesn't interfere with the management system (which is why we're all
using PVE in the first place, right?) and/or any possible future
changes/interactions that may come along.
I'm running a recently updated PVE that was originally created using the
baremetal installer CD.
Thanks in advance,
Myke
_______________________________________________
pve-user mailing list
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
m***@mWare.ca
2009-03-31 03:02:05 UTC
Permalink
Hi Theron, thanks for the anecdote... I am certainly familiar with RAIDs
and their characteristics, my problem is that I'm out of touch with
Linux specifically - spent too much time in FreeBSD lately.

I'm moreso looking for a 'how-to' for mirroring the second drive in my
PVE server... hopefully without any extended downtime or reloading of
the OS being required.

Suggestion for the bare-metal installer - provide RAID1'ing as an
option? I understand the LVM/PV jazz makes it possible to do this after
the fact, but it'd sure be nice to have it from the get-go :)

Myke
Post by Theron T. Trout
Hi Myke,
I setup a Proxmox VE server with 6 SCSI drivers in RAID 1+0 (stripped
and mirrored). It was a total of 1.2TB and it was blazing fast. We
configured a second, near identical, Proxmox machine and initially
didn't setup the same RAID configuration and it was considerably slower.
The speed difference was most startling with Windows 2003 KVM clients,
particularly during boot. The RAID 1+0 setup was a lot faster than the
other machine. Unfortunately, I don't recall how it's RAID was
initially configured.
Unfortunately, we were under some tight deadlines, so I wasn't able to
do any formal benchmarking before reconfiguring the slower machine. If
I ever get a chance to I'll try to pull some hard numbers, but I doubt
I'll get to tear down one of the two machines any time soon.
Hope that is helpful,
Theron
Theron T. Trout
2009-03-31 03:41:00 UTC
Permalink
Hi Myke,

Ah, I see. I agree with you on the installer. It would be great if
future versions provide more guided storage configurations. I've heard
rumor that PVE 2.0 may include some network-based filesystems, but I
digress.

Recently I've had to dig in pretty deep with LVM while customizing a new
Proxmox system. It sounds like we had similar experience where the
installer asks which hdd to install to, but leaves the other unused,
yes? The first time through I used LVM to extend the /var/lib/vz
partitions to include the second hard drive. This site made that
process quite painless and fast.

http://lucaschan.com/weblog/2007/06/29/adding-a-physical-disk-to-lvm-in-redhatcentos/

Due to some requirements in how my new PVE server will be deployed and
utilized, I finally backed off that approach and shifted gears slightly.
I settled on extending /var/lib/vz to use some of the space on the
second hard drive and the remainder I am using for nightly snapshot
backups. It may be overkill but I left 10GB of free space on the LVM
volume group for temporary snapshot partitions during backup (compared
to the 4GB that the Proxmox installer sets aside). Overall my ~500GB of
storage is split 60%/40% for data and backups, respectively.

I didn't explore any Linux software RAID options, so I can't offer much
on that, but I'd be very interested in finding out how well that plays
on a Proxmox VE system. Still, I'm happy to share more details of what
I've done if it's helpful to you.

Best regards,
Theron
Post by m***@mWare.ca
Hi Theron, thanks for the anecdote... I am certainly familiar with RAIDs
and their characteristics, my problem is that I'm out of touch with
Linux specifically - spent too much time in FreeBSD lately.
I'm moreso looking for a 'how-to' for mirroring the second drive in my
PVE server... hopefully without any extended downtime or reloading of
the OS being required.
Suggestion for the bare-metal installer - provide RAID1'ing as an
option? I understand the LVM/PV jazz makes it possible to do this after
the fact, but it'd sure be nice to have it from the get-go :)
Myke
Post by Theron T. Trout
Hi Myke,
I setup a Proxmox VE server with 6 SCSI drivers in RAID 1+0 (stripped
and mirrored). It was a total of 1.2TB and it was blazing fast. We
configured a second, near identical, Proxmox machine and initially
didn't setup the same RAID configuration and it was considerably slower.
The speed difference was most startling with Windows 2003 KVM clients,
particularly during boot. The RAID 1+0 setup was a lot faster than the
other machine. Unfortunately, I don't recall how it's RAID was
initially configured.
Unfortunately, we were under some tight deadlines, so I wasn't able to
do any formal benchmarking before reconfiguring the slower machine. If
I ever get a chance to I'll try to pull some hard numbers, but I doubt
I'll get to tear down one of the two machines any time soon.
Hope that is helpful,
Theron
--
Theron Trout
Principal, Mellonway LLC

800-614-MWAY (6929)
301-358-5050
www.mellonway.com

Efficiency and Results through Expertise. (TM)
Erik Gulliksson
2009-03-31 06:50:37 UTC
Permalink
Hi,
Post by m***@mWare.ca
I'm moreso looking for a 'how-to' for mirroring the second drive in my
PVE server... hopefully without any extended downtime or reloading of
the OS being required.
The process of adding software Linux raid to an existing Proxmox VE
installation is outlined in proxmox forums in the following thread:
http://www.proxmox.com/forum/showthread.php?t=838&page=2

However, this is recommended against from the Proxmox developers, I
guess mostly because it might break future update schemas.

Regards
Erik Gulliksson
--
Erik Gulliksson, ***@diino.net
System Administrator, Diino AB
http://www.diino.com
Pongrácz István
2009-03-31 15:37:45 UTC
Permalink
Hi,

I setup more than 5 systems with software raid1. Some of them have 4 drives,
some have only 2 drives.
They are working well for months.

Only backdraw, when I upgrade to a new kernel, I must hack a little bit the
initrd and grub config file to get mdadm working. But now this procedure is
a painless step.

Of course, it will be never as fast, as scsi drives with raid10, but seems
safe enough, after some hard tests (power failure etc.).

Cheers,
István

----------------eredeti üzenet-----------------
Feladó: "Erik Gulliksson" ***@diino.net
Címzett: ***@mware.ca
CC: "proxmoxve"
Dátum: Tue, 31 Mar 2009 08:50:37 +0200
-------------------------------------------------
Post by Erik Gulliksson
Hi,
Post by m***@mWare.ca
I'm moreso looking for a 'how-to' for mirroring the second drive in my
PVE server... hopefully without any extended downtime or reloading of
the OS being required.
The process of adding software Linux raid to an existing Proxmox VE
http://www.proxmox.com/forum/showthread.php?t=838&page=2
However, this is recommended against from the Proxmox developers, I
guess mostly because it might break future update schemas.
Regards
Erik Gulliksson
--
System Administrator, Diino AB
http://www.diino.com
_______________________________________________
pve-user mailing list
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
--
István PONGRÁCZ
http://www.startit.hu
http://www.osbusiness.hu
Loading...