Meta Triumphs with Threads: A Behind-the-Scenes Look at Infrastructure Mastery
By Laine Campbell, Chunqiang (CQ) Tang
In a remarkable feat of engineering prowess, Meta introduced Threads, its latest app, to unprecedented success, amassing over 100 million sign-ups within the initial five days of launch on July 5, 2023. What makes this achievement even more extraordinary is the fact that Threads was conceived, built, and launched by a small, agile team of engineers in just five months.
The decision to launch Threads came with a mere two days' notice to the infrastructure teams, a testament to Meta's confidence in its robust infrastructure and the team's track record. Despite the tight timeline, Meta's infrastructure seamlessly supported the rapid growth of Threads, showcasing over a decade of development in infrastructure and product evolution.
Meta's infrastructure, meticulously crafted for scale, growth, performance, and reliability, played a pivotal role in the app's stellar performance. While numerous components contribute to Threads' success, two key existing elements, ZippyDB and Async, stood out.
ZippyDB: Elevating Threads Storage Capabilities
At the heart of Threads' storage layer is ZippyDB, a distributed key/value database that proved instrumental in handling the surge in demand. ZippyDB, designed to leverage Meta's infrastructure, offers flexibility in scaling keyspaces up and down across multiple data centers. Notably, it played a crucial role in storing Threads posts and replies, managing counters, feed ranking/state, and search functionalities.
The scalability of ZippyDB is facilitated by its multi-tenancy and strong isolation features, allowing different keyspaces to share underlying hosts without compromising performance. Automation tools enable swift capacity allocation and the absorption of new hardware, ensuring the service can scale seamlessly, even in the face of sudden surges in demand.
The resharding protocol of ZippyDB allows for rapid and transparent scaling, crucial for accommodating the 100x growth anticipated for Threads. The team's strategic approach of starting small and proactively resharding in preparation for the launch ensured efficiency in capacity usage and a smooth user experience.
Async: Powering Scalable Workload Execution
Async, Meta's serverless function platform, played a pivotal role in offloading computing tasks, processing trillions of function calls daily across a vast server network. Supporting multiple programming languages, Async abstracts deployment complexities, enabling developers to focus on core logic while inheriting hyperscale attributes.
Async's role in Threads was paramount, especially in executing computationally intensive operations without impacting user experience. The platform's ability to defer tasks to off-peak hours and manage scalable execution ensured a seamless onboarding experience for Threads' massive user base. The surge in Async jobs generated by Threads' user onboarding was met with grace, as Async efficiently queued and executed tasks within specified rate limits, preventing overload on downstream services.
Where Infrastructure and Culture Converge
Threads' rapid development within a tight timeframe highlights the synergy of Meta's infrastructure and engineering culture. The shared infrastructure, marked by automation and scalability, empowers teams to move swiftly. Meta's engineering culture, emphasizing strong ownership and collaboration, played a pivotal role in accomplishing this shared goal. The success of the Threads launch stands as a testament to Meta's commitment to innovation, efficiency, and excellence in both infrastructure and culture.
