Stop Struggling with DataFrames – Try DuckDB for SQL on Pandas

ArjanCodes • February 7, 2025

View Channel

About

No channel description available.

Latest Posts

PT4M

Retry Pattern: The Secret to Resilient Python Code

ArjanCodes3 months ago

25692

PT4M

How to Refactor Insanely Complicated Business Logic (Step by Step)

ArjanCodes3 months ago

114601

PT4M

The Lazy Loading Pattern: How to Make Python Programs Feel Instant

ArjanCodes4 months ago

39607

PT4M

Stop Hardcoding Everything: Use Dependency Injection

ArjanCodes4 months ago

113239

Video Description

➡️ Try Convex here: https://convex.link/arjancodes. In this video, I’ll talk about the power of DuckDB, a lightweight, embedded database that lets you run SQL queries directly on Pandas DataFrames—no servers, no hassle. I’ll show you how it simplifies analytics, from in-memory operations to persistent storage and Jupyter integrations. 👷 Review code better and faster with my 3-Factor Framework: https://arjan.codes/diagnosis. 🔥 GitHub Repository: https://git.arjan.codes/2025/duckdb. 🎓 ArjanCodes Courses: https://www.arjancodes.com/courses. 🔖 Chapters: 0:00 Intro 0:37 What is DuckDB 1:18 Backing of the project 2:09 Running SQL on DataFrames 7:49 In-memory storage 9:09 Persistent storage 10:50 Jupyter Notebooks 11:50 Multithreading and multiprocessing 15:12 Extended SQL 18:52 Final thoughts #arjancodes #softwaredesign #python

Stop Struggling with DataFrames – Try DuckDB for SQL on Pandas

About

Latest Posts

Retry Pattern: The Secret to Resilient Python Code

How to Refactor Insanely Complicated Business Logic (Step by Step)

The Lazy Loading Pattern: How to Make Python Programs Feel Instant

Stop Hardcoding Everything: Use Dependency Injection

Video Description

You May Also Like

Learning Python Feels Easy. Until It Isn’t.

Why Your Code Isn’t Pythonic (And How to Fix It)

You’re Passing Way Too Many Arguments (and How to Fix It)

The Best Way to Share Code Between Python Apps

I Hate Long If-Elif Chains: This Design Pattern Solved It Once and For All

Anatomy of a Scalable Python Project (FastAPI)

SOLID: Writing Better Python Without Overengineering

Avoid Messy Code: Design Patterns for AI Agents in Python

Python Has the Best Standard Library Ever: 10 Modules You Need to Know

How to Write Great Unit Tests in Python

UV Just Got A Serious Upgrade

Why Are Not More People Using These Python Libraries?

I Designed a Python SDK That Relies on… Deep Inheritance?!

This Is Why Your Python Code Turns Into Spaghetti

Why Dataclasses Disappear in Real Python Applications

Stop Using map() and filter() Like This in Python

Stop Struggling with DataFrames – Try DuckDB for SQL on Pandas

About

Latest Posts

Retry Pattern: The Secret to Resilient Python Code

How to Refactor Insanely Complicated Business Logic (Step by Step)

The Lazy Loading Pattern: How to Make Python Programs Feel Instant

Stop Hardcoding Everything: Use Dependency Injection

Video Description

You May Also Like

Learning Python Feels Easy. Until It Isn’t.

Why Your Code Isn’t Pythonic (And How to Fix It)

You’re Passing Way Too Many Arguments (and How to Fix It)

The Best Way to Share Code Between Python Apps

I Hate Long If-Elif Chains: This Design Pattern Solved It Once and For All

Anatomy of a Scalable Python Project (FastAPI)

SOLID: Writing Better Python Without Overengineering

Avoid Messy Code: Design Patterns for AI Agents in Python

Python Has the Best Standard Library Ever: 10 Modules You Need to Know

How to Write Great Unit Tests in Python

UV Just Got A Serious Upgrade

Why Are Not More People Using These Python Libraries?

I Designed a Python SDK That Relies on… Deep Inheritance?!

This Is Why Your Python Code Turns Into Spaghetti

Why Dataclasses Disappear in Real Python Applications

Stop Using map() and filter() Like This in Python

Essential Garden Bed Kits

Outsunny 3-Tier Wood Raised Garden Bed, Elevated Planting Box, Outdoor Vegetable Flower Container, Herb Garden Indoor Kit, Gray

Umaeost Hydrocolloid Roll for Wound Care: 2IN*6.5FT - Waterproof Ultra Thin Self Adhesive Patch for Blisters Acne Bedsores Pressure Diabetic Ulcers - DIY Size

COZSINOOR Queen Size Cooling Bed Pillows - Premium Down Alternative Pillows Set of 2 for Side, Back, and Stomach Sleepers Hotel Quality Fluffy Soft Microfiber Fill Breathable Skin-Friendly

Pillows Queen Size 2 Pack for Sleeping - Hotel Pillows Premium Down Alternative Bed Cooling Pillow for Side, Back, and Stomach Sleepers, Fluffy Soft Microfiber Fill Breathable Skin-Friendly

Pillows Queen Size 2 Pack for Sleeping - Premium Down Alternative Cooling Bed Pillow for Side, Back, and Stomach Sleepers Hotel Quality Fluffy Soft Microfiber Fill Breathable Skin-Friendly

HEYCUZI Pillows Queen Size 2 Pack - Premium Down Alternative Cooling Bed Pillow for Side, Back, and Stomach Sleepers Hotel Quality Fluffy Soft Microfiber Fill Breathable Skin-Friendly

STAEDTLER pencil sharpener, premium quality sharpener with screw-on lid, prevents accidental openings, compact size for pencil case and work-station, 511 63BK (Pack of 1) , Assorted colors.

CIYOYO Head Strap for Meta Quest 3/3S, 10000mAh Battery Pack for Oculus Quest 3S/3 Accessories, Extended 6H Playtime with Enhanced Comfort and Balance, Adjustable Elite Strap, Free Lens &amp; Case Cover

eazpower for Magsafe Power Bank 10000mAh, Magnetic Battery Pack Wireless, 20W PD Fast Charging, Compact Portable Charger with Built-in Cables and Stand for iPhone 16/15/14/13/12/ Apple Watch/Airpods

Outsunny Raised Garden Bed Wood, Freestanding Planter Stand with 5 Planting Boxes and 4 Hooks, Good for Herbs, Flowers, or Vegetables in Patio Balcony Indoor Outdoor

Outsunny 3-Tier Wood Raised Garden Bed, Elevated Planting Box, Outdoor Vegetable Flower Container, Herb Garden Indoor Kit, Gray

6-Ft Raised Garden Bed - Vertical Garden Freestanding Elevated Planter with 4 Container Boxes - Good for Patio or Balcony Indoor and Outdoor - to Grow Vegetables Herbs Flowers (1-Pack/Espresso Brown)

Outsunny 3-Tier Wood Raised Garden Bed, Elevated Planting Box, Outdoor Vegetable Flower Container, Herb Garden Indoor Kit, Gray

Outsunny Raised Garden Bed Wood, Freestanding Planter Stand with 5 Planting Boxes and 4 Hooks, Good for Herbs, Flowers, or Vegetables in Patio Balcony Indoor Outdoor

6-Ft Raised Garden Bed - Vertical Garden Freestanding Elevated Planter with 4 Container Boxes - Good for Patio or Balcony Indoor and Outdoor - to Grow Vegetables Herbs Flowers (1-Pack/Espresso Brown)

Active Era Premium Queen Air Mattress - Elevated Inflatable Double Air Bed, Built-in Electric Pump, Raised Pillow, Structured Air-Coil Technology, 3 Minute Self Inflating Air Mattress, 20&quot; Height

Hydroponics Growing System Indoor Garden - Herb Garden with Grow Light, 15 Pods Stainless Steel Indoor Garden Kit, Auto Timer, Gardening Gift for All Ages

Smart Hydroponics Growing System, LetPot 12 Pods Indoor Garden, 24W Light, App&amp;WiFi Control, Water Shortage Remind, 20&quot; Adjustable Rod, 5.5L Tank, Herb Garden for Home Kitchen, Stainless Steel

100 ft Expandable Garden Hose - 2025 Upgraded Retractable Water Hose with 3/4&quot; Solid Brass Fittings, Extra Strength Fabric - Flexible Expanding Hose

75 ft Expandable Garden Hose - All New 2025 Retractable Water Hose with 3/4&quot; Solid Brass Fittings, Extra Strength Fabric - Flexible Expanding Hose

100 ft Expandable Garden Hose - All New 2025 Retractable Water Hose with 3/4&quot; Solid Brass Fittings, Extra Strength Fabric - Flexible Expanding Hose

Outsunny Raised Garden Bed Wood, Freestanding Planter Stand with 5 Planting Boxes and 4 Hooks, Good for Herbs, Flowers, or Vegetables in Patio Balcony Indoor Outdoor

Outsunny 3-Tier Wood Raised Garden Bed, Elevated Planting Box, Outdoor Vegetable Flower Container, Herb Garden Indoor Kit, Gray

6-Ft Raised Garden Bed - Vertical Garden Freestanding Elevated Planter with 4 Container Boxes - Good for Patio or Balcony Indoor and Outdoor - to Grow Vegetables Herbs Flowers (1-Pack/Espresso Brown)

Outsunny Raised Garden Bed Wood, Freestanding Planter Stand with 5 Planting Boxes and 4 Hooks, Good for Herbs, Flowers, or Vegetables in Patio Balcony Indoor Outdoor

Outsunny 3-Tier Wood Raised Garden Bed, Elevated Planting Box, Outdoor Vegetable Flower Container, Herb Garden Indoor Kit, Gray

6-Ft Raised Garden Bed - Vertical Garden Freestanding Elevated Planter with 4 Container Boxes - Good for Patio or Balcony Indoor and Outdoor - to Grow Vegetables Herbs Flowers (1-Pack/Espresso Brown)

Outsunny Raised Garden Bed Wood, Freestanding Planter Stand with 5 Planting Boxes and 4 Hooks, Good for Herbs, Flowers, or Vegetables in Patio Balcony Indoor Outdoor

Outsunny 3-Tier Wood Raised Garden Bed, Elevated Planting Box, Outdoor Vegetable Flower Container, Herb Garden Indoor Kit, Gray

6-Ft Raised Garden Bed - Vertical Garden Freestanding Elevated Planter with 4 Container Boxes - Good for Patio or Balcony Indoor and Outdoor - to Grow Vegetables Herbs Flowers (1-Pack/Espresso Brown)

Loading...

CIYOYO Head Strap for Meta Quest 3/3S, 10000mAh Battery Pack for Oculus Quest 3S/3 Accessories, Extended 6H Playtime with Enhanced Comfort and Balance, Adjustable Elite Strap, Free Lens & Case Cover

Active Era Premium Queen Air Mattress - Elevated Inflatable Double Air Bed, Built-in Electric Pump, Raised Pillow, Structured Air-Coil Technology, 3 Minute Self Inflating Air Mattress, 20" Height

Smart Hydroponics Growing System, LetPot 12 Pods Indoor Garden, 24W Light, App&WiFi Control, Water Shortage Remind, 20" Adjustable Rod, 5.5L Tank, Herb Garden for Home Kitchen, Stainless Steel

100 ft Expandable Garden Hose - 2025 Upgraded Retractable Water Hose with 3/4" Solid Brass Fittings, Extra Strength Fabric - Flexible Expanding Hose

75 ft Expandable Garden Hose - All New 2025 Retractable Water Hose with 3/4" Solid Brass Fittings, Extra Strength Fabric - Flexible Expanding Hose

100 ft Expandable Garden Hose - All New 2025 Retractable Water Hose with 3/4" Solid Brass Fittings, Extra Strength Fabric - Flexible Expanding Hose