Big Data Processing Using Distributed Maps and AWS Step Functions (S3 + Lambda)

Video Description

AWS Step Functions are a powerful orchestration or workflow service. Distributed Maps are a feature that help you implement a series of tasks in parallel. They offer much higher scale over normal Step Function Maps and have useful features like S3 CSV / JSON readers for your event source. In this video, I show you how to use the distributed map feature by processing records in a CSV file located in S3 using a Lambda Function. Sign up for my Newsletter to receive regular AWS updates AND get a FREE PDF for 5 AWS Project Ideas: https://beabetterdev.com/aws-project-ideas-pdf/ 📚 My Courses 📚 AWS Learning Accelerator - Learn AWS Through a Hands On Project - https://courses.beabetterdev.com/courses/aws-learning-accelerator AWS Lambda - A Practical Guide - https://www.udemy.com/course/aws-lambda-a-practical-guide/?referralCode=F6D1A50467E579C65372 🎉SUPPORT BE A BETTER DEV🎉 Become a Patron: https://www.patreon.com/beabetterdev 📚 MY RECOMMENDED READING LIST FOR SOFTWARE DEVELOPERS📚 Clean Code - https://amzn.to/37T7xdP Clean Architecture - https://amzn.to/3sCEGCe Head First Design Patterns - https://amzn.to/37WXAMy Domain Driven Design - https://amzn.to/3aWSW2W Code Complete - https://amzn.to/3ksQDrB The Pragmatic Programmer - https://amzn.to/3uH4kaQ Algorithms - https://amzn.to/3syvyP5 Working Effectively with Legacy Code - https://amzn.to/3kvMza7 Refactoring - https://amzn.to/3r6FQ8U 🎙 MY RECORDING EQUIPMENT 🎙 Shure SM58 Microphone - https://amzn.to/3r5Hrf9 Behringer UM2 Audio Interface - https://amzn.to/2MuEllM XLR Cable - https://amzn.to/3uGyZFx Acoustic Sound Absorbing Foam Panels - https://amzn.to/3ktIrY6 Desk Microphone Mount - https://amzn.to/3qXMVIO Logitech C920s Webcam - https://amzn.to/303zGu9 Fujilm XS10 Camera - https://amzn.to/3uGa30E Fujifilm XF 35mm F2 Lens - https://amzn.to/3rentPe Neewer 2 Piece Studio Lights - https://amzn.to/3uyoa8p 💻 MY DESKTOP EQUIPMENT 💻 Dell 34 inch Ultrawide Monitor - https://amzn.to/2NJwph6 Autonomous ErgoChair 2 - https://bit.ly/2YzomEm Autonomous SmartDesk 2 Standing Desk - https://bit.ly/2YzomEm MX Master 3 Productivity Mouse - https://amzn.to/3aYwKVZ Das Keyboard Prime 13 MX Brown Mechanical- https://amzn.to/3uH6VBF Veikk A15 Drawing Tablet - https://amzn.to/3uBRWsN 🌎 Find me here: Twitter - https://twitter.com/BeABetterDevv Instagram - https://www.instagram.com/beabetterdevv/ Patreon - Donations help fund additional content - https://www.patreon.com/beabetterdev #stepfuctions #aws #serverless