Code along - build an ELT Pipeline in 1 Hour (dbt, Snowflake, Airflow)

jayzern February 26, 2024
Video Thumbnail

About

No channel description available.

Video Description

How to build an ELT pipeline in 1 hour, using industry standard tools such as dbt, Snowflake and Airflow. This is a live coding tutorial, where I’ll walk you through the thinking process, and show you every step. We’ll cover basic data modeling techniques (fact tables, data marts), snowflake RBAC concepts, and how to orchestrate a dbt project using Airflow. Drop down in the comments section what Data Engineering topics you would like to see in the future! Timestamps ⏰ 0:00 - Intro 1:35 - Setup dbt + Snowflake 7:52 - Configure dbt_project.yml and packages 11:45 - Create source and staging tables 17:41 - Transformed models (fact tables, data marts) 20:25 - Macro functions 24:23 - Generic and singular tests 29:35 - Deploy models using Airflow Live Coding notes 🎴 https://bittersweet-mall-f00.notion.site/Code-along-build-an-ELT-Pipeline-in-1-Hour-dbt-Snowflake-Airflow-cffab118a21b40b8acd3d595a4db7c15 Who am I? 🙋🏻‍♂️ I'm Jay, I love making videos about travel, self-help and tech. I currently work in New York City as a data engineer, but I grew up in Malaysia and lived in the UK when I was 19. Back then, I had no idea what life was about, moving to so many places, navigating career in Tech. Today, I've learned a lot and wanna share my perspective through filmmaking. Socials 📱 linkedin: https://www.linkedin.com/in/jayzern/ insta: https://www.instagram.com/jayzern/ Sub Count: 7,163

You May Also Like

Data Engineer's Toolkit

AI-recommended products based on this video

Loading...
2025 Portable Waist Fan 12000mAh Rechargeable Waist Clip Fan,6 Speeds 16000RPM Strong Airflow Personal Fans with Max 30H Working Time,Hands-Free Hanging Neck Fan,Wearable Belt Fans for Outdoor/Jobsite

2025 Portable Waist Fan 12000mAh Rechargeable Waist Clip Fan,6 Speeds 16000RPM Strong Airflow Personal Fans with Max 30H Working Time,Hands-Free Hanging Neck Fan,Wearable Belt Fans for Outdoor/Jobsite

(207)
$35.99
FREE delivery Wed, Aug 20
1K+ bought in past month
Loading...
Portable Waist Fan with 5 Speeds, 16000RPM Strong Airflow, 10000mAh Rechargeable Hands-Free Neck Fan with Flashlight & SOS Mode, Wearable Clip Belt Fans for Camping Travel Jobsite Farms Fishing

Portable Waist Fan with 5 Speeds, 16000RPM Strong Airflow, 10000mAh Rechargeable Hands-Free Neck Fan with Flashlight & SOS Mode, Wearable Clip Belt Fans for Camping Travel Jobsite Farms Fishing

(19)
$19.99
FREE delivery Wed, Aug 20 on your first order
600+ bought in past month
Loading...
10ft Rolling Library Ladder Hardware Kit, Sliding Track Kit with Floor Rollers, Loft Hardware for Home Bookshelf Warehouse (No Ladder)

10ft Rolling Library Ladder Hardware Kit, Sliding Track Kit with Floor Rollers, Loft Hardware for Home Bookshelf Warehouse (No Ladder)

(4)
$144.99
FREE delivery Sat, Jun 28
Loading...
6 Packs Ultrasonic Pest Repeller, Electronic Pest Repellent Plug in Indoor for Insect Roaches Spider Ant Bug Mosquito Mouse Repellent for House Kitchen Garage Warehouse

6 Packs Ultrasonic Pest Repeller, Electronic Pest Repellent Plug in Indoor for Insect Roaches Spider Ant Bug Mosquito Mouse Repellent for House Kitchen Garage Warehouse

(26)
$39.99
FREE delivery Wed, Feb 4
Loading...
6 Packs Ultrasonic Pest Repeller, Electronic Pest Repellent Plug in Indoor for Insect Roaches Spider Ant Bug Mosquito Mouse Repellent for House Kitchen Garage Warehouse

6 Packs Ultrasonic Pest Repeller, Electronic Pest Repellent Plug in Indoor for Insect Roaches Spider Ant Bug Mosquito Mouse Repellent for House Kitchen Garage Warehouse

(203)
$37.99$28.99
FREE delivery Mon, Sep 22
2K+ bought in past month
Loading...
TP-Link Tapo 2K Pan/Tilt Indoor Security WiFi Camera, Baby & Pet Camera w/ 360° Motion Tracking, 2-Way Audio, Night Vision, Cloud & Local Storage (Up to 256 GB), Works w/ Alexa & Google (Tapo C210)
Amazon's Choice

TP-Link Tapo 2K Pan/Tilt Indoor Security WiFi Camera, Baby & Pet Camera w/ 360° Motion Tracking, 2-Way Audio, Night Vision, Cloud & Local Storage (Up to 256 GB), Works w/ Alexa & Google (Tapo C210)

(46,779)
32.99
FREE delivery Saturday, June 14 on your first order
2K+ bought in past month
Loading...
TP-Link Tapo 3K 5MP Pan/Tilt Security WiFi Camera, Baby & Pet Camera, 360° Motion Tracking, 2-Way Audio, 40Ft. Night Vision, Cloud & Local Storage (Up to 512 GB), Works w/Alexa & Google (Tapo C230)

TP-Link Tapo 3K 5MP Pan/Tilt Security WiFi Camera, Baby & Pet Camera, 360° Motion Tracking, 2-Way Audio, 40Ft. Night Vision, Cloud & Local Storage (Up to 512 GB), Works w/Alexa & Google (Tapo C230)

(49,118)
$49.99
FREE delivery Wed, Aug 20
500+ bought in past month