Back To Schedule
Tuesday, September 22 • 2:00pm - 2:50pm
Petabyte-Scale Distributed File Systems in Open Source Land: KFS Evolution

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Over the past decade, distributed file systems based on a scale-out architecture that enables managing massive amounts of storage space (petabytes) have become commonplace. In this talk, I will first provide an overview of OSS systems (such as HDFS and KFS) in this space. I will then describe how these systems have evolved to take advantage of increasing network bandwidth in data center settings to improve application performance as well as storage efficiency. I will talk about these aspects by highlighting two novel features, multi-writer atomic append and (time-permitting) distributed erasure coding. These capabilities have been implemented in KFS and deployed in production settings to run analytic workloads.

avatar for Sriram Rao

Sriram Rao

Partner Scientist Manager, Microsoft
Sriram Rao leads the systems side of CISL, an applied research group that works closely with Microsoft's Big Data teams (namely, Scope/Cosmos/HDInsight). He has been closely involved in building a scale-out resource management infrastructure using Hadoop/YARN and tiered storage. Prior... Read More →

Tuesday September 22, 2015 2:00pm - 2:50pm PDT
Lafayette Room

Attendees (0)