All about POOLS | Proxmox + Ceph Hyperconverged Cluster fäncy Configurations for RBD

apalrd's adventures December 29, 2022
Video Thumbnail

About

No channel description available.

Video Description

In this video, I expand on the last video of my hyper-converged Proxmox + Ceph cluster to create more custom pool layouts than Proxmox's GUI allows. This includes setting the storage class (HDD / SSD / NVME), failure domain, and even erasure coding of pools. All of this is then setup as a storage location in Proxmox for RBD (RADOS Block Device), so we can store VM disks on it. After all of this, I now have the flexibility to assign VM disks to HDDs or SSDs, and use erasure coding to get 66% storage efficiency instead of 33% (doubling my usable capacity for the same disks!). With more nodes and disks, I could improve both the storage efficiency and failure resilience of my cluster, but with only the small number of disks I have, I opted to go for a basic 2+1 erasure code. Blog post for this video (tbh not a whole lot there): https://www.apalrd.net/posts/2022/cluster_ceph_pools/ My Discord Server, where you can chat about any of this: https://discord.gg/xJsaEukAr4 If you find my content useful and would like to support me, feel free to here: https://ko-fi.com/apalrd This video is part of my Hyperconverged Cluster Megaproject: https://www.youtube.com/playlist?list=PLZcFwaChdgSpJJoU80dHrxoBKAtjakTUb Find an HP Microserver Gen8 like mine on eBay (maybe you'll get lucky idk): https://ebay.us/1l1HI1 Timestamps: 00:00 - Introduction 01:11 - Cluster Overview 02:16 - Ceph Web Manager 03:10 - Failure Domains 04:24 - Custom CRUSH Ruleset 06:18 - Storage Efficiency & Erasure Codes 08:00 - Creating Erasure Coded Pools 12:35 - Results Some links to products may be affiliate links, which may earn a commission for me.

You May Also Like

Build Your Dream Hyperconverged Setup

AI-recommended products based on this video

Loading...
Firewall Mini PC N100 Fanless Pocket Computer 2x2.5G I226-V Micro Router Appliance, AES-NI, HDMI DP Support Dual 4K Proxmox Server, 32GB RAM 1TB SSD

Firewall Mini PC N100 Fanless Pocket Computer 2x2.5G I226-V Micro Router Appliance, AES-NI, HDMI DP Support Dual 4K Proxmox Server, 32GB RAM 1TB SSD

(0)
$518.99
FREE delivery Jul 8 - 29
Loading...
OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge R660XS R760XS

OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge R660XS R760XS

(0)
$1,474.98
FREE delivery Aug 14 - 22
Loading...
OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge XE9680

OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge XE9680

(0)
$1,474.98
FREE delivery Aug 14 - 22
Loading...
OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge R6625 R760 R7615 R7625

OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge R6625 R760 R7615 R7625

(0)
$1,474.98
FREE delivery Aug 14 - 22
Loading...
OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge HS5610 HS5620

OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge HS5610 HS5620

(0)
$1,474.98
FREE delivery Aug 14 - 22
Loading...
Western Digital 2TB WD Blue SA510 SATA Internal Solid State Drive SSD - SATA III 6 Gb/s, 2.5"/7mm, Up to 560 MB/s - WDS200T3B0A

Western Digital 2TB WD Blue SA510 SATA Internal Solid State Drive SSD - SATA III 6 Gb/s, 2.5"/7mm, Up to 560 MB/s - WDS200T3B0A

(74,910)
$169.97
FREE delivery Tue, Jun 17
50+ bought in past month
Loading...
Western Digital 4TB Elements Desktop External Hard Drive, USB 3.0 external hard drive for plug-and-play storage - WDBWLG0040HBK-NESN

Western Digital 4TB Elements Desktop External Hard Drive, USB 3.0 external hard drive for plug-and-play storage - WDBWLG0040HBK-NESN

(25,657)
$183.49
FREE delivery Tue, Jun 17
Loading...
Western Digital 4TB My Book Desktop External Hard Drive, USB 3.0, External HDD with Password Protection and Backup Software - WDBBGB0040HBK-NESN

Western Digital 4TB My Book Desktop External Hard Drive, USB 3.0, External HDD with Password Protection and Backup Software - WDBBGB0040HBK-NESN

(4,704)
$148.98$138.55
FREE delivery Tue, Jun 17
Loading...
Western Digital 4TB My Passport Portable External Hard Drive HDD, USB 3.0, USB 2.0 Compatible, Black - WDBPKJ0040BBK-WESN

Western Digital 4TB My Passport Portable External Hard Drive HDD, USB 3.0, USB 2.0 Compatible, Black - WDBPKJ0040BBK-WESN

(111,552)
$154.99$139.49
FREE delivery Tue, Jun 17
100+ bought in past month
Loading...
Crucial 64GB DDR5 RAM, 5600MHz (or 5200MHz or 4800MHz) Desktop Memory Kit, UDIMM 288-Pin, Compatible with 13th Gen Intel Core and AMD Ryzen 7000 - CT2K32G56C46U5

Crucial 64GB DDR5 RAM, 5600MHz (or 5200MHz or 4800MHz) Desktop Memory Kit, UDIMM 288-Pin, Compatible with 13th Gen Intel Core and AMD Ryzen 7000 - CT2K32G56C46U5

(2,409)
$181.38
FREE delivery Mon, Aug 11
Loading...
Skytech Blaze 3.0 Gaming PC Desktop – Intel Core i5 12400F 2.5 GHz, NVIDIA RTX 3060, 500GB NVME SSD, 16GB DDR4 RAM 3200, 600W Gold PSU, 11AC Wi-Fi, Windows 11 Home 64-bit

Skytech Blaze 3.0 Gaming PC Desktop – Intel Core i5 12400F 2.5 GHz, NVIDIA RTX 3060, 500GB NVME SSD, 16GB DDR4 RAM 3200, 600W Gold PSU, 11AC Wi-Fi, Windows 11 Home 64-bit

(786)
$1,414.11
FREE delivery Thu, Feb 19Only 4 left in stock.
Loading...
Skytech Azure Gaming PC, Intel i7 14700F 2.1 GHz, RTX 4070 Super 12GB GDDR6X, 1TB NVME Gen4, 32GB DDR5 RAM RGB, 750W Gold PSU, Wi-Fi, Win 11 Home

Skytech Azure Gaming PC, Intel i7 14700F 2.1 GHz, RTX 4070 Super 12GB GDDR6X, 1TB NVME Gen4, 32GB DDR5 RAM RGB, 750W Gold PSU, Wi-Fi, Win 11 Home

(137)
$2,530.00
FREE delivery Wed, Jun 18
Loading...
Skytech Archangel Gaming PC, Intel i5 14400F 2.5 GHz, RTX 4070 Super, 1TB NVME, 32GB DDR4 RAM 3200, 650W Gold PSU, Wi-Fi, Win 11 Home

Skytech Archangel Gaming PC, Intel i5 14400F 2.5 GHz, RTX 4070 Super, 1TB NVME, 32GB DDR4 RAM 3200, 650W Gold PSU, Wi-Fi, Win 11 Home

(79)
$1,780.00
FREE delivery Wed, Jun 18