GFS: The Google File System

More documents

Recommendations

Info

Chunkserver • Stores 64 MB file chunks on local disk using standard Linux filesystem, each with version number and checksum • Read/write requests specify chunk handle and byte range • Chunks replicated on configurable number of chunkservers (default: 3) • No caching of file data (beyond standard Linux buffer cache) 12
Client • Issues control (metadata) requests to master server • Issues data requests directly to chunkservers • Caches metadata • Does no caching of data – No consistency difficulties among clients – Streaming reads (read once) and append writes (write once) don’t benefit much from caching at client 13
Page 1 and 2: GFS: The Google File System Michael
Page 5 and 6: Google Platform Characteristics •
Page 8 and 9: Google File System: Design Criteria
Page 10 and 11: GFS: Architecture (2) 10
Page 14 and 15: Client API • Not a filesystem in
Page 16 and 17: Client Write • Some chunkserver i
Page 18 and 19: Client Write (3) • All replicas a
Page 20 and 21: Client Record Append (2) • When d
Page 22 and 23: GFS: Consistency Model (2) • Chan
Page 24 and 25: Applications and Record Append Sema
Page 26 and 27: Chunk Leases and Version Numbers
Page 28 and 29: What if Chunkserver Fails? • Mast
Page 30: Limitations • Security? - Trusted
Page 37: Recovery Time • Experiment: kille

GFS: The Google File System

Create successful ePaper yourself

Delete template?

Save as template?