Loading…
This event has ended. View the official site or create your own event → Check it out
This event has ended. Create your own
View analytic
Tuesday, September 22 • 2:00pm - 2:50pm
Petabyte-Scale Distributed File Systems in Open Source Land: KFS Evolution

Sign up or log in to save this to your schedule and see who's attending!

Over the past decade, distributed file systems based on a scale-out architecture that enables managing massive amounts of storage space (petabytes) have become commonplace. In this talk, I will first provide an overview of OSS systems (such as HDFS and KFS) in this space. I will then describe how these systems have evolved to take advantage of increasing network bandwidth in data center settings to improve application performance as well as storage efficiency. I will talk about these aspects by highlighting two novel features, multi-writer atomic append and (time-permitting) distributed erasure coding. These capabilities have been implemented in KFS and deployed in production settings to run analytic workloads.

Speakers
avatar for Sriram Rao

Sriram Rao

Partner Scientist Manager, Microsoft
Sriram Rao leads the systems side of CISL, an applied research group that works closely with Microsoft's Big Data teams (namely, Scope/Cosmos/HDInsight). He has been closely involved in building a scale-out resource management infrastructure using Hadoop/YARN and tiered storage. Prior to Microsoft, Sriram was the primary designer/implementer of KFS (Kosmos filesystem) which was subsequently released as an open source project. KFS has since been... Read More →


Tuesday September 22, 2015 2:00pm - 2:50pm
Lafayette Room

Attendees (9)