Want to Grok The Google File System?

Then start here, with the paper describing it. And here, with a blog entry that describes the virtues of having a product platform. Excerpt: We have designed and implemented the Google File Sys- tem, a scalable distributed file system for large distributed data-intensive applications. It provides fault tolerance while running…

Then start here, with the paper describing it. And here, with a blog entry that describes the virtues of having a product platform.

Excerpt:

We have designed and implemented the Google File Sys-
tem, a scalable distributed file system for large distributed
data-intensive applications. It provides fault tolerance while
running on inexpensive commodity hardware, and it delivers
high aggregate performance to a large number of clients.
While sharing many of the same goals as previous dis-
tributed file systems, our design has been driven by obser-
vations of our application workloads and technological envi-
ronment, both current and anticipated, that reflect a marked
departure from some earlier file system assumptions. This
has led us to reexamine traditional choices and explore rad-
ically different design points.
The file system has successfully met our storage needs.
It is widely deployed within Google as the storage platform
for the generation and processing of data used by our ser-
vice as well as research and development efforts that require
large data sets.

(Thanks Ross!)

Author: John Battelle

A founder of NewCo (current CEO), sovrn (Chair), Federated Media, Web 2 Summit, The Industry Standard, Wired. Author, investor, board member (Acxiom, Sovrn, NewCo), bike rider, yoga practitioner.

Leave a Reply