C++ cache locality and branch predictability

mCoding November 1, 2021
Video Thumbnail
mCoding Logo

mCoding

@mcoding

About

Video Description

Cache me outside, how bout that? People always talk about Big O time for analyzing speed, but Big O isn't the only important factor in writing performant code. Two important things to keep in mind are cache locality (locality of reference) and branch predictability. In this video, we go over these ideas and through examples we see the huge impact that they can have on performance. ― mCoding with James Murphy (https://mcoding.io) Source code: https://github.com/mCodingLLC/VideosSampleCode Branch prediction: https://en.wikipedia.org/wiki/Branch_predictor Cache locality: https://en.wikipedia.org/wiki/Locality_of_reference Awesome CppCon talk: https://www.youtube.com/watch?v=2EWejmkKlxs SUPPORT ME ⭐ --------------------------------------------------- Patreon: https://patreon.com/mCoding Paypal: https://www.paypal.com/donate/?hosted_button_id=VJY5SLZ8BJHEE Other donations: https://mcoding.io/donate Top patrons and donors: Jameson, Laura M, Dragos C, Vahnekie, John Martin, Casey G, Pieter G, Krisztian M, Sigmanificient BE ACTIVE IN MY COMMUNITY 😄 --------------------------------------------------- Discord: https://discord.gg/Ye9yJtZQuN Github: https://github.com/mCodingLLC/ Reddit: https://www.reddit.com/r/mCoding/ Facebook: https://www.facebook.com/james.mcoding CHAPTERS --------------------------------------------------- 0:00 Sorting 1:26 Cache locality 2:41 Vector traversal 4:39 Matrix multiplication 7:04 Branch predictability 9:56 Branchless optimization

Boost C++ Performance Now

AI-recommended products based on this video

Loading...
Intel Core i9-12900KF Desktop Processor 16 (8P+8E) Cores up to 5.2 GHz Unlocked LGA1700 600 Series Chipset 125W

Intel Core i9-12900KF Desktop Processor 16 (8P+8E) Cores up to 5.2 GHz Unlocked LGA1700 600 Series Chipset 125W

(949)
$459.95
Loading...
Corsair Vengeance LPX 32GB (2 X 16GB) DDR4 3200 (PC4-25600) C16 1.35V Desktop Memory - Black
Best Seller

Corsair Vengeance LPX 32GB (2 X 16GB) DDR4 3200 (PC4-25600) C16 1.35V Desktop Memory - Black

(16,675)
$112.99$101.69
FREE delivery Sun, Aug 10
500+ bought in past month
Loading...
Crucial X9 4TB Portable SSD, Up to 1050MB/s, USB 3.2 USB-C, External Solid State Drive, Compatible with Windows, Mac, & Android, Reliable Storage for Games, Files, & Backups, Black - CT4000X9SSD902

Crucial X9 4TB Portable SSD, Up to 1050MB/s, USB 3.2 USB-C, External Solid State Drive, Compatible with Windows, Mac, & Android, Reliable Storage for Games, Files, & Backups, Black - CT4000X9SSD902

(19,722)
$315.09
FREE delivery Tue, Jun 17
50+ bought in past month
Loading...
Crucial X10 Pro 4TB Portable SSD, Up to 2100MB/s Read, 2000MB/s Write, 3.2 USB-C, External Solid State Drive, Durable Storage for PC & Mac, for Professional Creators, Black - ‎CT4000X10PROSSD902

Crucial X10 Pro 4TB Portable SSD, Up to 2100MB/s Read, 2000MB/s Write, 3.2 USB-C, External Solid State Drive, Durable Storage for PC & Mac, for Professional Creators, Black - ‎CT4000X10PROSSD902

(2,557)
$358.93
FREE delivery Tue, Jun 17
50+ bought in past month
Loading...
Crucial X9 Pro 4TB Portable SSD, Up to 1050MB/s Read & Write, 3.2 USB-C, External Solid State Drive, Durable Storage for PC and Mac, for Professional Creators, Silver - ‎CT4000X9PROSSD902

Crucial X9 Pro 4TB Portable SSD, Up to 1050MB/s Read & Write, 3.2 USB-C, External Solid State Drive, Durable Storage for PC and Mac, for Professional Creators, Silver - ‎CT4000X9PROSSD902

(3,702)
$326.05$260.70
FREE delivery Tue, Jun 17
50+ bought in past month
Loading...
Crucial T705 4TB PCIe Gen5 NVMe M.2 SSD - Up to 14,100 MB/s - Game Ready - Internal Solid State Drive (PC) - +1mo Adobe CC - CT4000T705SSD3

Crucial T705 4TB PCIe Gen5 NVMe M.2 SSD - Up to 14,100 MB/s - Game Ready - Internal Solid State Drive (PC) - +1mo Adobe CC - CT4000T705SSD3

(2,172)
$599.11
FREE delivery Jun 17 - 18
Loading...
ASUS ROG Strix G16 Gaming Laptop, GeForce RTX 5070 Ti 12GB GDDR7, AMD Ryzen 9 8940HX, 64GB DDR5, 2TB SSD, Backlit Keyboard, Wi-Fi 6E, 16" WUXGA 165Hz Display, Win 11, Gray, 1TB Docking Station Set

ASUS ROG Strix G16 Gaming Laptop, GeForce RTX 5070 Ti 12GB GDDR7, AMD Ryzen 9 8940HX, 64GB DDR5, 2TB SSD, Backlit Keyboard, Wi-Fi 6E, 16" WUXGA 165Hz Display, Win 11, Gray, 1TB Docking Station Set

(10)
$4,269.00
FREE delivery Feb 24 - Mar 5
Loading...
Lenovo Legion Pro 5 16" WQXGA 165Hz Gaming Laptop, AMD Ryzen 9 9955HX, GeForce RTX 5070, 32GB DDR5, 3TB Storage (2TB SSD+1TB Docking Station Set), 24-Zone RGB Backlit Keyboard, WiFi 7, Win 11, Black

Lenovo Legion Pro 5 16" WQXGA 165Hz Gaming Laptop, AMD Ryzen 9 9955HX, GeForce RTX 5070, 32GB DDR5, 3TB Storage (2TB SSD+1TB Docking Station Set), 24-Zone RGB Backlit Keyboard, WiFi 7, Win 11, Black

(2)
$3,199.00
FREE delivery Feb 24 - Mar 5
Loading...
GEEKOM A7 Max Mini PC (Flagship Level Performance), AMD Ryzen 9 7940HS (Up to 5.2GHz),Mini Computer 16GB DDR5 RAM and 1TB PCIe 4.0 SSD, Windows 11 Pro, Quad 8K Display, USB4, Dual 2.5G LAN, Wi-Fi 6E

GEEKOM A7 Max Mini PC (Flagship Level Performance), AMD Ryzen 9 7940HS (Up to 5.2GHz),Mini Computer 16GB DDR5 RAM and 1TB PCIe 4.0 SSD, Windows 11 Pro, Quad 8K Display, USB4, Dual 2.5G LAN, Wi-Fi 6E

(115)
$1,199.00
FREE delivery Sat, Jan 3
Loading...
GEEKOM A8 AI Mini PC (3-Year Quality Support) with AMD Ryzen 9 8945HS Mini Computers, 32GB DDR5 RAM&2TB M.2 2280 NVMe Gen4*4 SSD, Windows 11 Pro Mini Desktop, WiFi 6E/BT5.2/USB4/8K/Quad Display

GEEKOM A8 AI Mini PC (3-Year Quality Support) with AMD Ryzen 9 8945HS Mini Computers, 32GB DDR5 RAM&2TB M.2 2280 NVMe Gen4*4 SSD, Windows 11 Pro Mini Desktop, WiFi 6E/BT5.2/USB4/8K/Quad Display

(215)
$1,159.40
FREE delivery Sun, Aug 10
Loading...
EVGA GeForce RTX 3060 Ti FTW Ultra Gaming, 08G-P5-3667-KR, 8GB GDDR6, iCX3 Cooling, ARGB LED

EVGA GeForce RTX 3060 Ti FTW Ultra Gaming, 08G-P5-3667-KR, 8GB GDDR6, iCX3 Cooling, ARGB LED

(60)
$2,403.74
Loading...
EVGA GeForce RTX 3060 Ti XC Gaming, 08G-P5-3663-KR, 8GB GDDR6, iCX3 Cooling, Metal Backplate

EVGA GeForce RTX 3060 Ti XC Gaming, 08G-P5-3663-KR, 8GB GDDR6, iCX3 Cooling, Metal Backplate

(31)
$1,845.57
FREE delivery Feb 24 - Mar 3Only 3 left in stock.
Loading...
EVGA GeForce RTX 3060 Ti XC Gaming, 08G-P5-3663-KL, 8GB GDDR6, Metal Backplate, LHR

EVGA GeForce RTX 3060 Ti XC Gaming, 08G-P5-3663-KL, 8GB GDDR6, Metal Backplate, LHR

(353)
$1,369.33$549.99
FREE delivery Feb 24 - Mar 3Only 3 left in stock.
Loading...
Portable Air Conditioners, wobuzhi Evaporative Air Cooler with LCD Screen, Fan Speed&Spray, 7 RGB Lights,USB Powered,1-8H Timer, Personal Air Conditioners, Portable Air Conditioners for Home Office

Portable Air Conditioners, wobuzhi Evaporative Air Cooler with LCD Screen, Fan Speed&Spray, 7 RGB Lights,USB Powered,1-8H Timer, Personal Air Conditioners, Portable Air Conditioners for Home Office

(32)
$39.99
FREE delivery Sun, Aug 10
200+ bought in past month
Loading...
llano RGB Laptop Cooling Pad with Powerful Turbofan Gaming Cooler Radiator with Infinitely Variable Speed, Touch Control, LCD Screen, 3-Port USB Hub, Seal Foam for Notebook Computer 15-19in

llano RGB Laptop Cooling Pad with Powerful Turbofan Gaming Cooler Radiator with Infinitely Variable Speed, Touch Control, LCD Screen, 3-Port USB Hub, Seal Foam for Notebook Computer 15-19in

(1,404)
$129.99
Prime
200+ bought in past month
Loading...
Neck Fan with Cooling Plate,Portable Neck Fan Rechargeable Battery Powered,Bladeless Personal Air Conditioner Wearable Neck Cooler Fans,USB Electric Quiet Necklace AC Fans for Travel Outdoor Black

Neck Fan with Cooling Plate,Portable Neck Fan Rechargeable Battery Powered,Bladeless Personal Air Conditioner Wearable Neck Cooler Fans,USB Electric Quiet Necklace AC Fans for Travel Outdoor Black

(35)
$39.99
600+ bought in past month
Loading...
MSI MAG CORELIQUID A15 240 - AIO ARGB CPU Liquid Cooler - 240mm Radiator - AM5, LGA 1851 Ready - Dual 120mm ARGB PWM Fans, Black

MSI MAG CORELIQUID A15 240 - AIO ARGB CPU Liquid Cooler - 240mm Radiator - AM5, LGA 1851 Ready - Dual 120mm ARGB PWM Fans, Black

(21)
$89.99$85.49
FREE delivery Sat, Jan 3
Loading...
Skytech Azure Gaming PC, Intel i7 14700F 2.1 GHz, RTX 4070 Super 12GB GDDR6X, 1TB NVME Gen4, 32GB DDR5 RAM RGB, 750W Gold PSU, Wi-Fi, Win 11 Home

Skytech Azure Gaming PC, Intel i7 14700F 2.1 GHz, RTX 4070 Super 12GB GDDR6X, 1TB NVME Gen4, 32GB DDR5 RAM RGB, 750W Gold PSU, Wi-Fi, Win 11 Home

(137)
$2,530.00
FREE delivery Wed, Jun 18
Loading...
Skytech Omega Gaming PC, Ryzen 7 7800X3D 4.2 GHz, RTX 4070 Super, 1TB NVME Gen4, 32GB DDR5 RAM RGB, 750W Gold PSU, Wi-Fi, Win 11 Home

Skytech Omega Gaming PC, Ryzen 7 7800X3D 4.2 GHz, RTX 4070 Super, 1TB NVME Gen4, 32GB DDR5 RAM RGB, 750W Gold PSU, Wi-Fi, Win 11 Home

(231)
$2,400.00
FREE delivery Wed, Jun 18
Loading...
Skytech Omega Gaming PC, Ryzen 7 7700X 4.5 GHz, RTX 4070 Super 12GB GDDR6X, 1TB NVME Gen4, 32GB DDR5 RAM RGB, 750W Gold PSU, Wi-Fi, Win 11 Home

Skytech Omega Gaming PC, Ryzen 7 7700X 4.5 GHz, RTX 4070 Super 12GB GDDR6X, 1TB NVME Gen4, 32GB DDR5 RAM RGB, 750W Gold PSU, Wi-Fi, Win 11 Home

(133)
$2,100.00
FREE delivery Wed, Jun 18
Loading...
Logitech G203 Wired Gaming Mouse, 8,000 DPI, Rainbow Optical Effect LIGHTSYNC RGB, 6 Programmable Buttons, On-Board Memory, Screen Mapping, PC/Mac Computer and Laptop Compatible - Black
Best Seller

Logitech G203 Wired Gaming Mouse, 8,000 DPI, Rainbow Optical Effect LIGHTSYNC RGB, 6 Programmable Buttons, On-Board Memory, Screen Mapping, PC/Mac Computer and Laptop Compatible - Black

(17,871)
$27.98$22.38
FREE delivery Tue, Oct 14 on your first order
500+ bought in past month
Loading...
Logitech K250 Bluetooth Keyboard with Numpad, Easy Connectivity, Compact Wireless Keyboard Made with Recycled Plastic, Spill-Resistant, Comfortable Keys - Windows/MacOS - Graphite
Best Seller

Logitech K250 Bluetooth Keyboard with Numpad, Easy Connectivity, Compact Wireless Keyboard Made with Recycled Plastic, Spill-Resistant, Comfortable Keys - Windows/MacOS - Graphite

(49)
$19.99$18.59
FREE delivery Mon, Aug 18 on your first order
Loading...
Logitech G305 Lightspeed Wireless Gaming Mouse, Hero 12K Sensor, 12,000 DPI, Lightweight, 6 Programmable Buttons, 250h Battery Life, On-Board Memory, PC/Mac - Black

Logitech G305 Lightspeed Wireless Gaming Mouse, Hero 12K Sensor, 12,000 DPI, Lightweight, 6 Programmable Buttons, 250h Battery Life, On-Board Memory, PC/Mac - Black

(35,879)
$49.99$44.99
FREE delivery Mon, Jan 26
1K+ bought in past month
Loading...
Logitech K400 Plus Wireless Touch TV Keyboard With Easy Media Control and Built-in Touchpad, HTPC Keyboard for PC-connected TV, Windows, Android, Chrome OS, Laptop, Tablet - Black
Best Seller

Logitech K400 Plus Wireless Touch TV Keyboard With Easy Media Control and Built-in Touchpad, HTPC Keyboard for PC-connected TV, Windows, Android, Chrome OS, Laptop, Tablet - Black

(38,516)
$39.98$35.98
FREE delivery Thu, Sep 4
500+ bought in past month
Loading...
KOORUI 24 Inch IPS Gaming Monitor, FHD 1920×1080p, 165Hz 200Hz Monitors, 1ms with Adaptive Sync, DCI-P3 90% Color Gamut, HDR400, 2 x HDMI 2.0, DisplayPort 1.4, Tilt Adjustable, G2411P

KOORUI 24 Inch IPS Gaming Monitor, FHD 1920×1080p, 165Hz 200Hz Monitors, 1ms with Adaptive Sync, DCI-P3 90% Color Gamut, HDR400, 2 x HDMI 2.0, DisplayPort 1.4, Tilt Adjustable, G2411P

(4,083)
$139.99$126.47
FREE delivery Tue, Aug 12
400+ bought in past month