We present Mesos, a platform for sharing commodity clusters between ...
Updating an index of the web as documents are crawled ...
We present Globule, a collaborative content delivery network developed by ...
Dryad is a general-purpose distributed execution engine for coarse-grain data-parallel ...
Google offers a variety of Internet services that require user ...
The ideal distributed file system would provide all its users ...
BANKS is a system that enables keyword based searches on a relational database. As a paper that was published 10 years ago in ICDE 2002, it has won the most influential paper award for past decade this year at ICDE. Hearty congrats to the teamContinue reading
The buzz about Hadapt and HadoopDB has been around for a while now as it is one of the first systems to combine ideas from two different approaches, namely parallel databases based on a shared-nothing architecture and map-reduce, to address the problem of large scaleContinue reading
Kafka, a system developed at LinkedIn, is essentially a messaging system that is designed to support aggregation of high throughput log messages arriving from different applications. Why would a traditional messaging system not be a good fit for log processing? Typical enterprise messaging systems tendContinue reading
Windows Azure Storage is a key component of the Windows Azure Cloud platform that offers an infinite disk in the cloud. It’s been in production since November 2008 and is used heavily within Microsoft in addition to being available as a public cloud service. ItContinue reading
This paper which appeared in this year’s VLDB talks about the internals of the SQL query engine atop Google’s Map Reduce framework. Its currently used by over 1000 people in Google serving over 10,000 queries each day that span across two data centers, with twoContinue reading
PNUTS is a geographically distributed database developed and in use at Yahoo!. PNUTS works off a simple relational model in which data is organized as tables and columns. It allows modifications to the schema without halting queries and updates but the current version does notContinue reading
Users upload a billion photos (about 60 terabytes) each week and Facebook serves over one million images per second at peak and Haystack is the system that is behind all this. Haystack is a system where data is written once, read frequently, never modified andContinue reading
Distributed key-value storage systems are widely used in corporations and across the Internet. Our research seeks to greatly expand the application space for key-value storage systems through application-specific customization. We designed and implemented Comet, an extensible, distributed key-value store. Each Comet node stores a collectionContinue reading
The size of data sets being collected and analyzed in the industry for business intelligence is growing rapidly, making traditional warehousing solutions prohibitively expensive. Hadoop is a popular open-source map-reduce implementation which is being used as an alternative to store and process extremely large dataContinue reading
The Bayou architecture provides scalability, availability, extensibility, and adaptability features that address database storage needs of world-wide applications. In addition to discussing these features, this paper presents Bayou’s mechanisms for permitting the replicas of a database to vary dynamically without global coordination. Key is theContinue reading