Miscellaneous local server setup notes.
I'm using a Dell R610 server with 64MB of memory.
Dell iDRAC 6 Enterprise
The DRAC provides a means for out-of-band management of the R610. I
configured the DRAC to have an IP address of
Proxmox VE Setup
Router, configured as bridge w/ static IP: 192.168.88.9 DHCP off, GW: 192.168.1 DRAC5 card: 192.168.88.10 PVE eno1 192.168.88.20 / server.local
Install on ZFS RAID 0 sda, sdb Note that this creates the pool 'rpool' with /dev/sda and /dev/sdb. These devices are assigned based on when and where drives are inserted/removed. Therefore, it's important not to change device locations. More later.
'zpool list' Shows 136G mirror online
'zpool status' Shows status of all pools
'zfs list' Shows all zfs filesystems --> the single pool 'rpool' plus the other zfs filesystems that PVE created for its use.
Install two 8TB ata-WDC_WD80EFAX-68LHPN0_7SGJ4H6C /dev/sdd ata-WDC_WD80EFAX-68LHPN0_7SGK1PGC /dev/sde
zpool create -f tank mirror \ ata-WDC_WD80EFAX-68LHPN0_7SGJ4H6C\ ata-WDC_WD80EFAX-68LHPN0_7SGK1PGC
zfs create tank/vmsdata
zfs set compression=on tank
Tell PVE to pickup the storage
Tell PVE to use tank/vmdata for VM and Container storage.
In PVE UI, Datacenter->Storage-Add
tank/vmdata for 'Disk image, Container'
Confirm that PVE has it: cat /etc/pve/storage.cfg
To remove the storage from PVM: in UI: Datacenter->Storage->Remove
Then remove it from zfs: zpool destroy tank
Raw disk passthrough to VM.
Find the two 8TB disks by serial number: ls /dev/disk/by-id ata-WDC_WD80EFAX-68LHPN0_7SGJ4H6C ata-WDC_WD80EFAX-68LHPN0_7SGK1PGC
Note that 'ls /dev/disk/by-id' will show each disk ID and a link to the /dev/sd? device it is associated with.
Create FreeNAS VM on PVE. Install FreeNAS. After install, shutdown VM.
Add the two devices to the VM as passthrough. Note that '100' is the ID of the FreeNAS VM. qm set 100 -virtio2 /dev/disk/by-id/ata-WDC_WD80EFAX-68LHPN0_7SGJ4H6C qm set 100 -virtio3 /dev/disk/by-id/ata-WDC_WD80EFAX-68LHPN0_7SGK1PGC
Confirm via 'cat /etc/pve/qemu-server/100.conf'
Boot the FreeNAS VM and configure.
When it reboots, use PVM to access the console.
Choose 1) to configure the network interface. Choose to configure the em0 interface. Answer 'no' to 'reset?'. 'no' DHCP 'yes' configure IPv4 static IP 192.168.88.21/24 'no' configure IPv6
Add 192.168.88.1 as the gateway.
Access the system now via http://192.168.88.21 for the remainder of the configuration.
Skip the setup wizard. You can always run it later.
Storage->Volumes->ViewDisks and confirm the two 8TB drives are there.
Storage->Volumes->VolumeManager add mirrored volume consisting of both disks named 'vol1'
Storage->Volumes->ViewVolumes confirm that the volume exists.
OpenManage Server Administrator Managed Node (Win 64bit), v8.3 Requires Windows Server 2008 or 2012 R2 http://www.dell.com/support/home/us/en/19/Drivers/DriversDetails?driverId=TK61C&fileId=3547081112&osCode=WS8R2&productCode=poweredge-r810&languageCode=en&categoryId=SM
Windows Server 2016 https://www.microsoft.com/en-us/evalcenter/
Dell Systems Service and Diagnostics Tools ISO, v7.0 http://www.dell.com/support/home/us/en/19/Drivers/DriversDetails?driverId=W0R66
Update Dell PE servers via bootable media / ISO. Linux distro + all firmware auto update all FW on system. 1.8GB in size? https://www.dell.com/support/article/us/en/19/sln296511/updating-dell-poweredge-servers-via-bootable-media---iso?lang=en
Check available drivers for your service tag on Dell Support page. One item is the Dell OS Driver Pack, which is apparently just drives for your specific machine. I think it must be like the previous, but smaller, since it only has drivers for one system. 100MB in size? http://www.dell.com/support/home/us/en/19/drivers/driversdetails?driverId=VC4GP