GFS: The Google File System
GFS: The Google File System GFS: The Google File System
Google Platform Characteristics • 100s to 1000s of PCs in cluster • Many modes of failure for each PC: – App bugs, OS bugs – Human error – Disk failure, memory failure, net failure, power supply failure – Connector failure • Monitoring, fault tolerance, auto-recovery essential 6
- Page 1 and 2: GFS: The Google File System Michael
- Page 5: Google Platform Characteristics •
- Page 9 and 10: GFS: Architecture • One master se
- Page 11 and 12: • Holds all metadata: Master Serv
- Page 13 and 14: Client • Issues control (metadata
- Page 15 and 16: Client Read • Client sends master
- Page 17 and 18: Client Write (2) 17
- Page 19 and 20: Client Record Append • Google use
- Page 21 and 22: GFS: Consistency Model • Changes
- Page 23 and 24: GFS: Data Mutation Consistency Writ
- Page 25 and 26: Logging at Master • Master has al
- Page 27 and 28: What If the Master Reboots? • Rep
- Page 29 and 30: File Deletion • When client delet
- Page 36 and 37: (for a single file) 36
- Page 40: GFS: Summary • Success: used acti
<strong>Google</strong> Platform Characteristics<br />
• 100s to 1000s of PCs in cluster<br />
• Many modes of failure for each PC:<br />
– App bugs, OS bugs<br />
– Human error<br />
– Disk failure, memory failure, net failure,<br />
power supply failure<br />
– Connector failure<br />
• Monitoring, fault tolerance, auto-recovery<br />
essential<br />
6
Change language