S4: An open-source distributed stream computing platform
Data streams abound in the world of Big Data: Twitter, search queries, stock quotes, website analytics, sensor data to name a few. …
Replication for Web Hosting Systems
Replication is a well-known technique to improve the accessibility of Web sites. It generally offers reduced client latencies and increases a site’s …
Paxos Made Live – An Engineering Perspective
We describe our experience building a fault-tolerant data-base using the Paxos consensus algorithm. Despite the existing literature in the field, building such …
Distributed Caching Protocols for Relieving Hot Spots on the World Wide Web
We describe a family of caching protocols for distributed networks that can be used to decrease or eliminate the occurrence of hot …
Astrolabe : A Robust and Scalable Technology For Distributed System Monitoring, Management, and Data Mining
Scalable management and self-organizational capabilities are emerging as central requirements for a generation of large-scale, highly dynamic, distributed applications. We have developed …
WhyHigh : Moving Beyond End-to-End Path Information to Optimize CDN Performance
Abstract: Replicating content across a geographically distributed set of servers and redirecting clients to the closest server in terms of latency has …
Large-scale Incremental Processing Using Distributed Transactions and Notifications
Updating an index of the web as documents are crawled requires continuously transforming a large repository of existing documents as new documents …
BigPipe: Pipelining web pages for high performance
Site speed is one of the most critical company goals for Facebook. In 2009, we successfully made Facebook site twice as fast, …
Dynamo : Amazon’s Highly Available Key-value Store
Reliability at massive scale is one of the biggest challenges we face at Amazon.com, one of the largest e-commerce operations in the …
The Anatomy of a Large-Scale Hypertextual Web Search Engine
Abstract: In this paper, we present Google, a prototype of a large-scale search engine which makes heavy use of the structure present …