ApacheCon NA 2015 has ended
Back To Schedule
Monday, April 13 • 4:00pm - 4:50pm
Elastic Compute for Batch Platform Using Apache Mesos, Docker - Muralidhar Sortur, Ebay

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Batch processing is common in industries for offline data compute. Typically it is bulk-oriented, non-interactive & long running—and is data & computation-intensive.
Batch platform requires business to maintain & operate huge backend infrastructure. While there are hadoop infrastructures, not all batch jobs can be run on hadoop. Compute requirement for batch jobs also varies widely. It is most desirable to have an infrastructure, which is shared, scale on demand, easy to maintain.
We propose an architecture for “Elastic compute for batch platform” using Mesos, Docker, swift object storage & chronos scheduler. We made sure user perception of state-full elastic workload is protected while giving flexibility to the backend infrastructure to isolate compute, storage, environment and monitoring.

avatar for Muralidhar Sortur

Muralidhar Sortur

MTS, Ebay
Muralidhar Sortur is Currently working as an Architect in Ebay Inc, for Global Platform Infrastructure. he is leading an effort in building next generation huge scale "Elastic compute batch platform". He is graduated from "Indian Institute of Science, Bangalore", one of the leading... Read More →

Monday April 13, 2015 4:00pm - 4:50pm CDT
Texas I

Attendees (0)