TAO: Facebook’s Distributed Data Store for the Social Graph

Gaurav Sen October 26, 2024
Video Thumbnail
Gaurav Sen Logo

Gaurav Sen

@gkcs

About

This channel is for software developers who want to learn artificial intelligence, system design, and algorithms. You will find content around LLMs, data structures, algorithms, game-playing AI, and system design.

Video Description

We look at the internals of Facebook's graph datastore, which is used to store social graphs. This system, called "The Associations and Objects (T.A.O)", is used across Facebook, Instagram and WhatsApp to represent objects and relations in memory. The graph is built over Memcached. Facebook engineers store petabytes of data in this graph and have scaled it to 1 billion queries per second. In this video, we look into the following sections: 00:00 The Social Graph 02:19 Internal Datastore 04:07 Design Decisions 05:49 API Design 09:31 High-level Architecture 13:40 Edge Consistency 16:56 Primary and Replica Shards 19:51 Read-after-writes 20:57 Managing Hot Shards 24:11 Thank you :D System Design Course at InterviewReady: https://interviewready.io/ Designing Data-Intensive Applications Book: https://amzn.to/3SyNAOy #SystemDesign #ResearchPaper #TAO

No Recommendations Found

No products were found for the selected channel.