Is ZFS Ready for NVMe Speed? Allan Jude Explains

Video Description

https://lawrence.video/ Klara Systems https://klarasystems.com/ Previous video with Allan Understanding ZFS in the Real World: Mistakes Made, Lessons Learned & Future Plans https://youtu.be/OscKOZ5nxxA?si=qbx23a9sQCpCZzQC Why You Can’t Trust AI to Tune ZFS https://klarasystems.com/articles/why-you-cant-trust-ai-to-tune-zfs/ Connect With Us --------------------------------------------------- + Hire Us for a project: https://lawrencesystems.com/hire-us/ + Toms' Twitter 🐦 https://twitter.com/TomLawrenceTech + Our Website https://www.lawrencesystems.com/ + Our Forums https://forums.lawrencesystems.com/ + Instagram https://www.instagram.com/lawrencesystems/ + Facebook https://www.facebook.com/Lawrencesystems/ + GitHub https://github.com/lawrencesystems/ Lawrence Systems Shirts and Swag --------------------------------------------------- ►👕 https://lawrence.video/swag/ AFFILIATES & REFERRAL LINKS --------------------------------------------------- Amazon Affiliate Store 🛒 https://www.amazon.com/shop/lawrencesystemspcpickup UniFi Affiliate Link 🛒 https://lawrence.video/unifi-affiliate All Of Our Affiliates help us out and can get you discounts! 🛒 https://lawrencesystems.com/partners-we-love/ Gear we use on Kit 🛒 https://kit.co/lawrencesystems Use OfferCode LTSERVICES to get 10% off your order at 🛒 https://www.techsupplydirect.com?aff=2 Digital Ocean Offer Code 🛒 https://m.do.co/c/85de8d181725 HostiFi UniFi Cloud Hosting Service 🛒 https://hostifi.net/?via=lawrencesystems Protect your privacy with a VPN from Private Internet Access 🛒 https://www.privateinternetaccess.com/pages/buy-vpn/LRNSYS Patreon 💰 https://www.patreon.com/lawrencesystems Chapters 00:00 – Intro: Tom & Allan Jude on ZFS + NVMe 00:45 – ZFS Origins & Early Hard Drive Constraints 01:30 – Copy-on-Write, Batch Writes, and HDD Limits 03:07 – Free Space Fragmentation and Pool Full Behavior 04:38 – Gang Blocks, Sector Size Changes, and Modernization 06:20 – Logical Block Addressing & Compatibility Layers 07:20 – Flash Translation Layers in SSDs & NVMe 08:18 – SMR vs NVMe Parallels and Alignment Costs 09:09 – Device-Specific Tuning Challenges in ZFS 09:58 – SSD Garbage Collection, TRIM, and Write Stalls 10:52 – Write Aggregation, Prefetch, and Queue Management 11:37 – NVMe Latency, Microsecond Ops & Outpacing ZFS Logic 14:20 – Real-World NVMe Workloads (Media, IOPS, Databases) 15:55 – ZFS Roadmap: Optimizations, Auto-Tuning, and Use Cases 17:25 – Detecting Device Types: HDD, SSD, NVMe, NVMe-oF 20:53 – Solid state challenges with Error Correction 22:09 – Block Pointer Trees, Verification, and NAND Reliability 24:10 – Compression Limits & Embedded Block Pointers 25:48 – Per Drive Uber Blocks and Labels 30:09 – Storage with CXL 31:42 – Tiered Storage: NVMe, SSD, HDD, Tape, and Cloud 32:35 – Emerging Features and Community Involvement 33:02 – ZFS O_DIRECT Application Cache 36:00 – Media Demands Driving ZFS Development 37:38 – ZFS at Scale: CERN, Lawrence Livermore, SCIENCE!