Discussion:
[PVE-User] deleting a cluster
Adam Weremczuk
2018-10-29 10:00:34 UTC
Permalink
Hi all,

I'm experimenting with 5.2 and trying to delete a cluster I created on
one of the nodes using web GUI.

I haven't managed to find any options in web GUI, shell or documentation.

The closest thing appears to be:

pvecm delnode node1
Cannot delete myself from cluster!

Can you please advise how to completely purge current cluster's settings?

Thanks,
Adam
Dominik Csapak
2018-10-29 10:18:25 UTC
Permalink
Post by Adam Weremczuk
Hi all,
I'm experimenting with 5.2 and trying to delete a cluster I created on
one of the nodes using web GUI.
I haven't managed to find any options in web GUI, shell or documentation.
please have a look at
https://pve.proxmox.com/wiki/Cluster_Manager#_remove_a_cluster_node

especially the section 'Separate A Node Without Reinstalling'
Post by Adam Weremczuk
pvecm delnode node1
Cannot delete myself from cluster!
Can you please advise how to completely purge current cluster's settings?
Thanks,
Adam
_______________________________________________
pve-user mailing list
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
lord_Niedzwiedz
2018-10-29 13:08:27 UTC
Permalink
        Hi,
I have a problem.
Im trying to install Proxmox on 4 NVMe drives.
One on the motherboard, two on the PCIe.

Proxmox see everything at the installation.
I give the option zfs (RAIDZ-1).

And I get a mistake error at the end.
"unable to create zfs root pool"

Attached pictures (1-5) .jpg.
Loading Image...
Loading Image...
Loading Image...
Loading Image...
Loading Image...

greetings
Grzegorz
Alwin Antreich
2018-10-29 15:29:31 UTC
Permalink
Hi Grzegorz,
Post by lord_Niedzwiedz
        Hi,
I have a problem.
Im trying to install Proxmox on 4 NVMe drives.
One on the motherboard, two on the PCIe.
Proxmox see everything at the installation.
I give the option zfs (RAIDZ-1).
And I get a mistake error at the end.
"unable to create zfs root pool"
GRUB is not yet working with ZFS on EFI. Try to switch to legacy boot in
BIOS if possible or use LVM for the installation.
Post by lord_Niedzwiedz
Attached pictures (1-5) .jpg.
https://help.komandor.pl/Wymiana/1.jpg
https://help.komandor.pl/Wymiana/2.jpg
https://help.komandor.pl/Wymiana/3.jpg
https://help.komandor.pl/Wymiana/4.jpg
https://help.komandor.pl/Wymiana/5.jpg
greetings
Grzegorz
_______________________________________________
pve-user mailing list
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
--
Cheers,
Alwin
Michael Cooper
2018-10-29 15:44:30 UTC
Permalink
Hello, I had to use one to boot into a native ext4 with grub then I was
able to install zfs-utils on Ubuntu 18.04, if would like my noter how i did
it, I would be to share them with you. Mind you, you lose one drive in that
config but i have 3 - 3 tb drives and one nvme as my boot drive. It may not
work for you that but its worth a shot as long as your not using zfs to
boot from.

Hope this helps,
Michael


On Oct 29, 2018 11:29 AM, "Alwin Antreich" <***@proxmox.com> wrote:

Hi Grzegorz,
Post by lord_Niedzwiedz
Hi,
I have a problem.
Im trying to install Proxmox on 4 NVMe drives.
One on the motherboard, two on the PCIe.
Proxmox see everything at the installation.
I give the option zfs (RAIDZ-1).
And I get a mistake error at the end.
"unable to create zfs root pool"
GRUB is not yet working with ZFS on EFI. Try to switch to legacy boot in
BIOS if possible or use LVM for the installation.
Post by lord_Niedzwiedz
Attached pictures (1-5) .jpg.
https://help.komandor.pl/Wymiana/1.jpg
https://help.komandor.pl/Wymiana/2.jpg
https://help.komandor.pl/Wymiana/3.jpg
https://help.komandor.pl/Wymiana/4.jpg
https://help.komandor.pl/Wymiana/5.jpg
greetings
Grzegorz
_______________________________________________
pve-user mailing list
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
--
Cheers,
Alwin

_______________________________________________
pve-user mailing list
pve-***@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
lord_Niedzwiedz
2018-10-30 14:08:22 UTC
Permalink
        I set legacy boot in bios.
Use only one disk with lvm.
And system not start with this.

Any sugestion ?
Post by Alwin Antreich
Post by lord_Niedzwiedz
I have a problem.
Im trying to install Proxmox on 4 NVMe drives.
One on the motherboard, two on the PCIe.
Proxmox see everything at the installation.
I give the option zfs (RAIDZ-1).
And I get a mistake error at the end.
"unable to create zfs root pool"
GRUB is not yet working with ZFS on EFI. Try to switch to legacy boot in
BIOS if possible or use LVM for the installation.
Post by lord_Niedzwiedz
Attached pictures (1-5) .jpg.
https://help.komandor.pl/Wymiana/1.jpg
https://help.komandor.pl/Wymiana/2.jpg
https://help.komandor.pl/Wymiana/3.jpg
https://help.komandor.pl/Wymiana/4.jpg
https://help.komandor.pl/Wymiana/5.jpg
Michael Cooper
2018-10-30 14:10:05 UTC
Permalink
Which os?
Post by lord_Niedzwiedz
I set legacy boot in bios.
Use only one disk with lvm.
And system not start with this.
Any sugestion ?
Post by Alwin Antreich
Post by lord_Niedzwiedz
I have a problem.
Im trying to install Proxmox on 4 NVMe drives.
One on the motherboard, two on the PCIe.
Proxmox see everything at the installation.
I give the option zfs (RAIDZ-1).
And I get a mistake error at the end.
"unable to create zfs root pool"
GRUB is not yet working with ZFS on EFI. Try to switch to legacy boot in
BIOS if possible or use LVM for the installation.
Post by lord_Niedzwiedz
Attached pictures (1-5) .jpg.
https://help.komandor.pl/Wymiana/1.jpg
https://help.komandor.pl/Wymiana/2.jpg
https://help.komandor.pl/Wymiana/3.jpg
https://help.komandor.pl/Wymiana/4.jpg
https://help.komandor.pl/Wymiana/5.jpg
_______________________________________________
pve-user mailing list
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
lord_Niedzwiedz
2018-10-30 14:11:21 UTC
Permalink
        proxmox-ve_5.2-1.iso
Post by Michael Cooper
Which os?
Post by lord_Niedzwiedz
I set legacy boot in bios.
Use only one disk with lvm.
And system not start with this.
Any sugestion ?
Post by Alwin Antreich
Post by lord_Niedzwiedz
I have a problem.
Im trying to install Proxmox on 4 NVMe drives.
One on the motherboard, two on the PCIe.
Proxmox see everything at the installation.
I give the option zfs (RAIDZ-1).
And I get a mistake error at the end.
"unable to create zfs root pool"
GRUB is not yet working with ZFS on EFI. Try to switch to legacy boot in
BIOS if possible or use LVM for the installation.
Post by lord_Niedzwiedz
Attached pictures (1-5) .jpg.
https://help.komandor.pl/Wymiana/1.jpg
https://help.komandor.pl/Wymiana/2.jpg
https://help.komandor.pl/Wymiana/3.jpg
https://help.komandor.pl/Wymiana/4.jpg
https://help.komandor.pl/Wymiana/5.jpg
_______________________________________________
pve-user mailing list
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
_______________________________________________
pve-user mailing list
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
dorsy
2018-10-30 14:13:09 UTC
Permalink
On most systems legacy boot from nvme drives is not possible.
Post by lord_Niedzwiedz
        I set legacy boot in bios.
Use only one disk with lvm.
And system not start with this.
Any sugestion ?
Post by Alwin Antreich
Post by lord_Niedzwiedz
I have a problem.
Im trying to install Proxmox on 4 NVMe drives.
One on the motherboard, two on the PCIe.
Proxmox see everything at the installation.
I give the option zfs (RAIDZ-1).
And I get a mistake error at the end.
"unable to create zfs root pool"
GRUB is not yet working with ZFS on EFI. Try to switch to legacy boot in
BIOS if possible or use LVM for the installation.
Post by lord_Niedzwiedz
Attached pictures (1-5) .jpg.
https://help.komandor.pl/Wymiana/1.jpg
https://help.komandor.pl/Wymiana/2.jpg
https://help.komandor.pl/Wymiana/3.jpg
https://help.komandor.pl/Wymiana/4.jpg
https://help.komandor.pl/Wymiana/5.jpg
_______________________________________________
pve-user mailing list
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Mark Adams
2018-10-30 14:35:07 UTC
Permalink
Did you reinstall from the proxmox ISO after changing boot mode to legacy?

Regards.
Mark
Post by lord_Niedzwiedz
I set legacy boot in bios.
Use only one disk with lvm.
And system not start with this.
Any sugestion ?
Post by Alwin Antreich
Post by lord_Niedzwiedz
I have a problem.
Im trying to install Proxmox on 4 NVMe drives.
One on the motherboard, two on the PCIe.
Proxmox see everything at the installation.
I give the option zfs (RAIDZ-1).
And I get a mistake error at the end.
"unable to create zfs root pool"
GRUB is not yet working with ZFS on EFI. Try to switch to legacy boot in
BIOS if possible or use LVM for the installation.
Post by lord_Niedzwiedz
Attached pictures (1-5) .jpg.
https://help.komandor.pl/Wymiana/1.jpg
https://help.komandor.pl/Wymiana/2.jpg
https://help.komandor.pl/Wymiana/3.jpg
https://help.komandor.pl/Wymiana/4.jpg
https://help.komandor.pl/Wymiana/5.jpg
_______________________________________________
pve-user mailing list
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
lord_Niedzwiedz
2018-10-31 14:24:37 UTC
Permalink
I upgrade bios/firmware server motherboard Supermicro.
I set everything in the BIOS to "legacy" mode.
Not only in the boot menu.
Supermicro -> Bios -> Advence -> PCIe/PCI/Pnp Configuration (everything
on legacy).

Weird, because in my PC (processor Ryzen), everything is on UEFI
(windows 10 and Fedora works perfecly).

Its work now.
But....

1) On sysrescue-cd one nvme disk speed = 2600MB/s.
RAID 5/6  = max 3600MB/s (on 4-5 drives).
Why not N*2600 - 2600 MB/s  ??!!

*2) *I create RAID 1    or    RAID 10.    It works.*
**But Proxmox is displayed ***a message * with RAID Z1-2.**
**Loading Image...**
*
3) I make install Proxmox on one m2 disk (lvm) - boot system.
I have 5 disks.
I can of course install proxmox on 1 disk (or on raid 1, two disks).
The question is how to add other disks?
Is it worth creating a RAID Z from the other 3-4 disks?
What configuration would you recommend?
Post by Alwin Antreich
Post by lord_Niedzwiedz
Im trying to install Proxmox on 4 NVMe drives.
One on the motherboard, two on the PCIe.
Proxmox see everything at the installation.
I give the option zfs (RAIDZ-1).
And I get a mistake error at the end.
"unable to create zfs root pool"
GRUB is not yet working with ZFS on EFI. Try to switch to legacy boot in
BIOS if possible or use LVM for the installation.
Post by lord_Niedzwiedz
Attached pictures (1-5) .jpg.
https://help.komandor.pl/Wymiana/1.jpg
https://help.komandor.pl/Wymiana/2.jpg
https://help.komandor.pl/Wymiana/3.jpg
https://help.komandor.pl/Wymiana/4.jpg
https://help.komandor.pl/Wymiana/5.jpg
lord_Niedzwiedz
2018-10-31 14:52:19 UTC
Permalink
        How i make test RAID/Volume speed in Proxmox ?
hdparm -tT ............... ?
dorsy
2018-10-31 15:02:17 UTC
Permalink
hdparm is for hdds(ssds).

Use fio, it can test with a variety of settings (random
iops/bandwith/etc.) and are reproducable!
Post by lord_Niedzwiedz
        How i make test RAID/Volume speed in Proxmox ?
hdparm -tT ............... ?
_______________________________________________
pve-user mailing list
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Gilberto Nunes
2018-10-31 15:03:45 UTC
Permalink
You should use dd or search for linux disk benchmark in Master Google!
---
Gilberto Nunes Ferreira

(47) 3025-5907
(47) 99676-7530 - Whatsapp / Telegram

Skype: gilberto.nunes36
Post by lord_Niedzwiedz
How i make test RAID/Volume speed in Proxmox ?
hdparm -tT ............... ?
_______________________________________________
pve-user mailing list
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
lord_Niedzwiedz
2018-11-07 14:41:45 UTC
Permalink
        Good morning,

After a longer (unfortunately) fight, I was able to install on your
Proxmox server on RAIDZ from 1 to 3.
To do this I had to change some settings in the BIOS (the system did not
want to start without the "legacy" option).
https://help.komandor.pl/Wymiana/iKVM_capture.jpg
Loading Image...
Loading Image...

And manually edit the MBR on each of the disks.

***@gandalf8:~# sfdisk -d /dev/nvme0n1         (drives from nvme0n1 to
nvme5n1)
label: gpt
label-id: AD03123E-3D5D-4FD2-A7F3-9B6247F88CEA
device: / dev / nvme0n1
unit: sectors
first-lba: 34        (this must be necesary set)
last-lba: 976773134

/dev/nvme0n1p1: start = 34, size = 2014, type =
21686148-6449-6E6F-744E-656564454649, uuid =
CA6B9D71-BFEC-4EC2-8DB5-BB79B426D20D

cfdisk - the first sector must begin:         Start 34 End 2047
Example for disk 500GB.

10007K                2014S                          BIOS boot
465.8G                976754702S                Solaris / usr & Apple ZFS
8M                       16385S                        Solaris reserved 1

And so for 5 drives.

Without this, the proxmox crashed at the installation every time.
Post by lord_Niedzwiedz
I upgrade bios/firmware server motherboard Supermicro.
I set everything in the BIOS to "legacy" mode.
Not only in the boot menu.
Supermicro -> Bios -> Advence -> PCIe/PCI/Pnp Configuration
(everything on legacy).
Weird, because in my PC (processor Ryzen), everything is on UEFI
(windows 10 and Fedora works perfecly).
Its work now.
But....
1) On sysrescue-cd one nvme disk speed = 2600MB/s.
RAID 5/6  = max 3600MB/s (on 4-5 drives).
Why not N*2600 - 2600 MB/s  ??!!
*2) *I create RAID 1    or    RAID 10.    It works.*
**But Proxmox is displayed ***a message * with RAID Z1-2.**
**https://help.komandor.pl/Wymiana/iKVM_capture.jpg**
*
3) I make install Proxmox on one m2 disk (lvm) - boot system.
I have 5 disks.
I can of course install proxmox on 1 disk (or on raid 1, two disks).
The question is how to add other disks?
Is it worth creating a RAID Z from the other 3-4 disks?
What configuration would you recommend?
Post by Alwin Antreich
Post by lord_Niedzwiedz
Im trying to install Proxmox on 4 NVMe drives.
One on the motherboard, two on the PCIe.
Proxmox see everything at the installation.
I give the option zfs (RAIDZ-1).
And I get a mistake error at the end.
"unable to create zfs root pool"
GRUB is not yet working with ZFS on EFI. Try to switch to legacy boot in
BIOS if possible or use LVM for the installation.
Post by lord_Niedzwiedz
Attached pictures (1-5) .jpg.
https://help.komandor.pl/Wymiana/1.jpg
https://help.komandor.pl/Wymiana/2.jpg
https://help.komandor.pl/Wymiana/3.jpg
https://help.komandor.pl/Wymiana/4.jpg
https://help.komandor.pl/Wymiana/5.jpg
_______________________________________________
pve-user mailing list
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
lord_Niedzwiedz
2018-11-07 14:47:51 UTC
Permalink
        How can I do an AMD processor, implements RAID faster than 4GB/s  ?

Hardware ?
Software ?

One disk work 3GB/s.
I heave 5.
lord_Niedzwiedz
2018-11-07 14:51:37 UTC
Permalink
    I heave RAIDZ partition in Proxmox.
How can I test the speed of this  ??!!

I lvm i do:
hdparm -tT /dev/nvme0n1
hdparm -tT /dev/mapper/pve-root

fio --filename=/dev/mapper/pve-root --direct=1 --rw=read --bs=1m
--size=2G --numjobs=200 --runtime=60 --group_reporting --name=file1

But in RAIDZ i dont heave /dev/mapper/pve-root.

Loading...