ApacheCon NA 2015

It has become common practice to statically partition a datacenter into siloed clusters for each application. But there is an increasing need to integrate Apache Hadoop with other datacenter services, ideally co-locating the data in HDFS/HBase with the services that need it. Myriad, recently submitted to the Apache Incubator, integrates Apache YARN into Apache Mesos, allowing Apache Hadoop jobs to run alongside other applications, all dynamically sharing a single pool of resources. Apache Mesos enables efficient resource sharing and isolation across a variety of distributed applications including Apache Spark, MPI, Jenkins, traditional linux applications, and docker images. In this talk, Adam will explain how Myriad enables Apache YARN and Apache Mesos to share the same physical datacenter resources, improving overall cluster utilization and operational efficiency.