How to use SQL to Query S3 files with AWS Athena | Step by Step Tutorial
Be A Better Dev
@beabetterdevAbout
This channel is devoted to helping you become a better developer by learning about AWS, cloud computing, and system design concepts. My name is Daniel Galati and I have nearly a decade of experience working in tech. I am currently working as a senior software engineer at Amazon. On my channel, you'll find videos on software development topics such as databases, design principles, and cloud computing. I put an emphasis on making complicated topics easier to understand. From time to time, I'll also share developer career advice gathered through real-life industry experience for those of you looking to break into, or are already established in the software industry. If you want to join me in becoming a better developer, hit that subscribe button now. Patreon Link: https://www.patreon.com/beabetterdev --------------------- Videos created are based on my own opinion and not related to any company, organization or person.
Latest Posts
Video Description
In this video, I show you how to use AWS Athena to query JSON files located in an s3 bucket. I show you how to set up an Athena Database and Table using AWS Glue's Crawler. Looking to get hands on experience building on AWS with a REAL project? Check out my course - The AWS Learning Accelerator! https://courses.beabetterdev.com/courses/aws-learning-accelerator 00:16 Introduction to our S3 Dataset 01:57 Specifying an Athena Output Path 02:35 Connecting S3 Data Source to Athena Database 04:08 Using a Glue Crawler to Populate our Database 06:38 Testing our Athena Database with a Simple Query 🎉SUPPORT BE A BETTER DEV🎉 Become a Patron: https://www.patreon.com/beabetterdev 📚 MY RECOMMENDED READING LIST FOR SOFTWARE DEVELOPERS📚 Clean Code - https://amzn.to/37T7xdP Clean Architecture - https://amzn.to/3sCEGCe Head First Design Patterns - https://amzn.to/37WXAMy Domain Driver Design - https://amzn.to/3aWSW2W Code Complete - https://amzn.to/3ksQDrB The Pragmatic Programmer - https://amzn.to/3uH4kaQ Algorithms - https://amzn.to/3syvyP5 Working Effectively with Legacy Code - https://amzn.to/3kvMza7 Refactoring - https://amzn.to/3r6FQ8U 🎙 MY RECORDING EQUIPMENT 🎙 Shure SM58 Microphone - https://amzn.to/3r5Hrf9 Behringer UM2 Audio Interface - https://amzn.to/2MuEllM XLR Cable - https://amzn.to/3uGyZFx Acoustic Sound Absorbing Foam Panels - https://amzn.to/3ktIrY6 Desk Microphone Mount - https://amzn.to/3qXMVIO Logitech C920s Webcam - https://amzn.to/303zGu9 Fujilm XS10 Camera - https://amzn.to/3uGa30E Fujifilm XF 35mm F2 Lens - https://amzn.to/3rentPe Neewer 2 Piece Studio Lights - https://amzn.to/3uyoa8p 💻 MY DESKTOP EQUIPMENT 💻 Dell 34 inch Ultrawide Monitor - https://amzn.to/2NJwph6 Autonomous ErgoChair 2 - https://bit.ly/2YzomEm Autonomous SmartDesk 2 Standing Desk - https://bit.ly/2YzomEm MX Master 3 Productivity Mouse - https://amzn.to/3aYwKVZ Das Keyboard Prime 13 MX Brown Mechanical- https://amzn.to/3uH6VBF Veikk A15 Drawing Tablet - https://amzn.to/3uBRWsN 📚 Resources: Part 2 - Query Athena from Lambda - https://youtu.be/a_Og1t3ULOI Athena Overview - https://youtu.be/1lzpeVV2hDQ Getting started with AWS: https://youtu.be/lTyqzyk86f8 ☁Topics covered include: AWS Athena AWS Athena Database Setup AWS Athena Table Setup AWS Glue Crawler AWS Athena with S3 Json Files AWS Athena SQL Select 🌎 Find me here: Twitter - https://twitter.com/BeABetterDevv Instagram - https://www.instagram.com/beabetterdevv/ Patreon - Donations help fund additional content - https://www.patreon.com/beabetterdev #AWS #Serverless #BigData
You May Also Like
Upgrade Your Gaming Setup
AI-recommended products based on this video

CORSAIR iCUE Link XD5 RGB Elite LCD Pump-Reservoir Unit - D5 PWM Pump - 480x480 IPS LCD Screen - 22 Addressable RGB LEDs - 440ml Nylon Reservoir - White

CORSAIR iCUE Link XC7 RGB Elite CPU Water Block - Transparent Flow Chamber - 24 RGB LEDs - Fits Intel® LGA 1700, AMD® AM5 and Older - White

CORSAIR Hydro X Series iCUE Link XH405i Custom Cooling Kit – Hardline Water Cooling Loop – XC7 Elite CPU Water Block – XD5 Elite D5 Pump Res – XR5 360mm Radiator – 3X QX120 RGB Fans

Logitech G203 Wired Gaming Mouse, 8,000 DPI, Rainbow Optical Effect LIGHTSYNC RGB, 6 Programmable Buttons, On-Board Memory, Screen Mapping, PC/Mac Computer and Laptop Compatible - Black

Logitech K250 Bluetooth Keyboard with Numpad, Easy Connectivity, Compact Wireless Keyboard Made with Recycled Plastic, Spill-Resistant, Comfortable Keys - Windows/MacOS - Graphite

Logitech G305 Lightspeed Wireless Gaming Mouse, Hero 12K Sensor, 12,000 DPI, Lightweight, 6 Programmable Buttons, 250h Battery Life, On-Board Memory, PC/Mac - Black

Logitech K400 Plus Wireless Touch TV Keyboard With Easy Media Control and Built-in Touchpad, HTPC Keyboard for PC-connected TV, Windows, Android, Chrome OS, Laptop, Tablet - Black

5 Pcs Adult Keyboard Clicker Toys, Portable Mechanical Keyboard Keychain Toy, Decompression Toys, Funny Cube Key Button Stress Relief for Adults Present to Relief Pass Time

Asus ROG Azoth Wireless Mechanical Gaming Keyboard – 75% TKL, Tri-Mode Connectivity, Hot Swappable Pre-lubed ROG NX Snow Linear Switches, PBT Keycaps, RGB, OLED Display, PC/Mac Support - Black

Cmokifuly GMK67 65% Mechanical Keyboard Kit Tri-Mode South-Facing RGB LED for 3/5pin Switches,66 Keys+1 Knob Hotswap Socket PCB Gasket Mounted Plate Gaming DIY Keyboard Kit (White)

5 Pcs Adult Keyboard Clicker Toys, Portable Mechanical Keyboard Keychain Toy, Decompression Toys, Funny Cube Key Button Stress Relief for Adults Present to Relief Pass Time

Asus ROG Azoth Wireless Mechanical Gaming Keyboard – 75% TKL, Tri-Mode Connectivity, Hot Swappable Pre-lubed ROG NX Snow Linear Switches, PBT Keycaps, RGB, OLED Display, PC/Mac Support - Black




















