••• Curating Complex Systems •••
Abstract Performance isolation is a key challenge in cloud computing. Unfortunately, Linux has few defenses against performance interference in shared resources such as processor caches and memory buses, so applications in a cloud can experience unpredictable performance caused by other […]
Haystack was the primary storage storage system designed initially for Facebook’s Photos application. Its been around for almost 7 years now. Through this period it has served well through several optimizations such as reducing the number of disk seeks to […]
ABSTRACT Mesa is a highly scalable analytic data warehousing system that stores critical measurement data related to Google’s Internet advertising business. Mesa is designed to satisfy a complex and challenging set of user and systems requirements, including near real-time data […]
Abstract The system-to-administrator ratio is commonly used as a rough metric to understand administrative costs in high-scale services. With smaller, less automated services this ratio can be as low as 2:1, whereas on industry leading, highly automated services, we’ve seen […]
Abstract Cluster computing applications – frameworks like MapReduce and user-facing applications like search platforms have application-level requirements and higher-level abstractions to express them. However, there exists no networking abstraction that can take advantage of the rich semantics readily available from […]
Abstract HP’s StoreAll with Express Query is a scalable commercial file archiving product that offers sophisticated file metadata management and search capabilities. A new REST API enables fast, efficient searching to find all files that meet a given set of […]
A key feature of all distributed storage systems is their ability to replicate data not just across machines within a data center but also across geographically distributed data centers. Replication, while it aids ensuring higher availability of the data segments […]
Detailed post to follow… Link to paper
Abstract This paper presents Polybase, a feature of SQL Server PDW V2 that allows users to manage and query data stored in a Hadoop cluster using the standard SQL query language. Unlike other database systems that provide only a relational […]
With both the F1 and Spanner papers out its now possible to understand their interplay a bit holistically. So lets start by revisiting the key goals of both systems. Key Goals of F1’s design System must be able to scale […]