Azure Databricks using Python with PySpark

Bryan Cafferky • October 31, 2019

Bryan Cafferky

About

Technical training on Big Data, Machine Learning, Spark, Azure, Databricks, SQL Server, and automation with PowerShell and state-of-the-art technology topics. Primary topics include: - Databricks and Apache Spark - Python - Developing Apps with Python - PowerShell - Azure Cloud Data Services - R Programming - Structured Query Language (SQL) and Databases

Azure Databricks using Python with PySpark

Bryan Cafferky

About

Latest Posts

Core Databricks: Understand the Hive Metastore

Understanding Delta Lake - The Heart of the Data Lakehouse

Apache Airflow Architecture 101

Dimensional Modeling

You May Also Like

Essential Azure Databricks Tools

Freenove Ultimate Starter Kit for BBC micro bit (V2 Included), 316-Page Detailed Tutorial, 225 Items, 44 Projects, Blocks and Python Code

SAMSUNG 870 EVO SATA SSD 500GB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E500B/AM [Canada Version]

SAMSUNG 870 EVO SATA III SSD 4TB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E4T0B/AM [Canada Version]

Samsung 990 EVO Plus - 4TB PCIe Gen4. X4, Gen5. X2 NVMe 2.0 - M.2 Internal SSD, Speed Up to 7,250 MBs, Upgrade Storage for PC-Laptops, HMB Technology and Intelligent Turbowrite (MZ-V9S4T0B/AM)

SAMSUNG EVO Select Micro SD-Memory-Card + Adapter, 128GB microSDXC 160MB/s Full HD &amp; 4K UHD, UHS-I, U3, A2, V30, for Android Smartphones, Tablets, Nintendo-Switch (MB-ME128SA/AM) [Canada Version]

PowerA Advantage Wired Controller for Xbox Series X|S - Sparkle, gamepad, wired video game controller, gaming controller, USB-C, Works with Xbox One, Officially Licensed for Xbox

Finish® Quantum Ultimate® Dishwasher Detergent Pods, No pre sinse needed, For Deep clean &amp; sparkling shine, 82 Tabs

FSSODWT 4Pairs Crystal Ball Stud Earrings for Women Hypoallergenic Stainless Steel Flat Back Stud Earrings Sparkly Cubic Zirconia Disco Ball Earrings Set 3 4 5 6 MM

tomtoc 360° Protective Laptop Sleeve for 15-inch MacBook Air M4/A3241 2025, M3/A3114 2024, M2/A2941 2023, 15-inch MacBook Pro A1990 A1707, Dell XPS 15 Plus Laptop, Water-Resistant Computer Case Bag Global Recycled Standard

Replacement for Dell 130W Laptop Charger USB C - XPS 17 15 7590 9700 9500 9510 Precision 5560 3560 5540 5570 5550 3561 3550 5510 5520 Latitude 7410 7310 7210 Type C Computer AC Adapter Power Cord

MOSISO 360 Protective Laptop Bag 15 inch, 15 inch Computer Shoulder Bag Compatible with MacBook Air 15 M4 M3 M2 2025-2023, Dell XPS 15, Side Open Messenger Case &amp;4 Zipper Pockets&amp;Handle, Black Global Recycled Standard

45W 65W AC Adapter Laptop Charger for Dell Inspiron 15 14 13 17 3000 5000 7000 Series 5558 5559 Charger Latitude E6440 E6430 3520 3420 XPS 13 14 9333 9350 Notebook Dell Computer Power Supply Cord

Intel NUC 13 Pro Mini PC, NUC13ANKI7 Intel Core i7-1360P (12C/16T &amp; Up to 5.0GHz), 32GB 3200Mhz DDR4 RAM &amp; 1TB PCIe 4.0 NVMe SSD, Support 8K/HDR/WiFi6E/BT5.3/Windows 11 Pro/Office/Business

GEEKOM IT13 2025 Mini PC 2025 Edition with 13th Gen Intel i9-13900HK, NUC 13 Mini Computers(14C/20T), 32GB RAM&amp;1T M.2 2280 NVMe Gen4*4 SSD, Windows 11 Pro/Wi-Fi 6E/Bluetooth 5.2/USB 4.0/2.5G LAN

PowerA Advantage Wired Controller for Xbox Series X|S - Sparkle, gamepad, wired video game controller, gaming controller, USB-C, Works with Xbox One, Officially Licensed for Xbox

Finish® Quantum Ultimate® Dishwasher Detergent Pods, No pre sinse needed, For Deep clean &amp; sparkling shine, 82 Tabs

FSSODWT 4Pairs Crystal Ball Stud Earrings for Women Hypoallergenic Stainless Steel Flat Back Stud Earrings Sparkly Cubic Zirconia Disco Ball Earrings Set 3 4 5 6 MM

Loading...

SAMSUNG EVO Select Micro SD-Memory-Card + Adapter, 128GB microSDXC 160MB/s Full HD & 4K UHD, UHS-I, U3, A2, V30, for Android Smartphones, Tablets, Nintendo-Switch (MB-ME128SA/AM) [Canada Version]

Finish® Quantum Ultimate® Dishwasher Detergent Pods, No pre sinse needed, For Deep clean & sparkling shine, 82 Tabs

MOSISO 360 Protective Laptop Bag 15 inch, 15 inch Computer Shoulder Bag Compatible with MacBook Air 15 M4 M3 M2 2025-2023, Dell XPS 15, Side Open Messenger Case &4 Zipper Pockets&Handle, Black Global Recycled Standard

Intel NUC 13 Pro Mini PC, NUC13ANKI7 Intel Core i7-1360P (12C/16T & Up to 5.0GHz), 32GB 3200Mhz DDR4 RAM & 1TB PCIe 4.0 NVMe SSD, Support 8K/HDR/WiFi6E/BT5.3/Windows 11 Pro/Office/Business

GEEKOM IT13 2025 Mini PC 2025 Edition with 13th Gen Intel i9-13900HK, NUC 13 Mini Computers(14C/20T), 32GB RAM&1T M.2 2280 NVMe Gen4*4 SSD, Windows 11 Pro/Wi-Fi 6E/Bluetooth 5.2/USB 4.0/2.5G LAN

Finish® Quantum Ultimate® Dishwasher Detergent Pods, No pre sinse needed, For Deep clean & sparkling shine, 82 Tabs