Loading…
This event has ended. View the official site or create your own event → Check it out
This event has ended. Create your own
View analytic
Wednesday, September 23 • 1:00pm - 1:50pm
f4: Facebook’s Warm BLOB Storage System

Sign up or log in to save this to your schedule and see who's attending!

Facebook’s corpus of photos, videos, and other Binary Large OBjects (BLOBs) that need to be reliably stored and quickly accessible is massive and continues to grow. As the footprint of BLOBs increases, storing them in our traditional storage system, Haystack, is becoming increasingly inefficient. To increase our storage efficiency, measured in the effective-replication-factor of BLOBs, we examine the underlying access patterns of BLOBs and identify temperature zones that include hot BLOBs that are accessed frequently and warm BLOBs that are accessed far less often. Our overall BLOB storage system is designed to isolate warm BLOBs and enable us to use a specialized warm BLOB storage system, f4. f4 is a new system that lowers the effective-replication-factor of warm BLOBs while remaining fault tolerant and able to support the lower throughput demands. f4 currently stores over 65PBs of logical BLOBs and reduces their effective-replication-factor from 3.6 to either 2.8 or 2.1. f4 provides low latency; is resilient to disk, host, rack, and datacenter failures; and provides sufficient throughput for warm BLOBs.

Speakers
avatar for Satadru Pan

Satadru Pan

Software Engineer, Facebook
Satadru Pan works at Facebook and He has a passion for building web scale distributed infrastructure. Currently he is working on building and scaling Facebook’s blob storage system, which stores and serves all the photos/videos of of the site. In past he has worked on search engine ranking and few other distributed system problems.


Wednesday September 23, 2015 1:00pm - 1:50pm
Winchester Room

Attendees (11)