Scaling 7M+ Postgres Tables! by Kailash Nadh CTO @zerodha

Perfology December 8, 2024
Video Thumbnail
Perfology Logo

Perfology

@perfology

About

​Welcome to Perfology – Where Technology meets Performance. ​We are dedicated to helping you build faster, scalable, and more reliable software. This channel focuses on: ✅ Performance Testing & Engineering ✅ In-depth Tech Talks & System Design ✅ Hands-on Tool Tutorials ✅ Application Optimization Strategies ​Hit that Subscribe button to stay ahead in the world of Performance Engineering! A Channel made for all the Performance Testing Enthusiasts. Learn Share Grow Connect with us 🎥 YouTube: https://www.youtube.com/channel/UCxUk2e3VhNKsuDw6ww-dv1Q 📘 Facebook: https://www.facebook.com/perfology 🔗 LinkedIn: https://www.linkedin.com/in/perfology 🔗 Instagram: https://www.instagram.com/perfologys Gmail : [email protected]

Video Description

In this video, explore the challenges of working with large databases and report retrieval and discover innovative solutions for performance optimization. Learn about asynchronous queuing for report generation, independent middleware for large queries, and the distributed system hack known as DungBeetle. Video Credits : @FOSSUnited Video posted here for educational purpose. Key topics include: 00:00 - Meet the Speaker: Kailash Nadh 00:52 - Overview of the Talk 01:59 - Tackling Challenges in Large Database Report Retrieval 06:35 - Optimizing Report Generation with Async Queuing 08:57 - Using Independent Middleware for Large Query Handling 10:36 - Introducing DungBeetle: The Scalable Hack 11:32 - Inside DungBeetle: Tasks, Jobs & Results Explained 14:28 - Leveraging Postgres for Results Database Optimization 18:28 - Achieving Scalability with Distributed Report Generation If you're a performance tester, this session is a must-watch for understanding how to manage large-scale data workflows and improve system scalability. - Follow Us on Facebook: https://www.facebook.com/perfology - Connect on Instagram: https://www.instagram.com/perfologys/ - Network on LinkedIn: https://www.linkedin.com/in/perfology/ #PerformanceTesting #BigData #DistributedSystems #Scalability #DatabaseOptimization #Middleware #AsyncProcessing #Postgres #PerformanceEngineering

You May Also Like