ApacheCon NA 2015

With companies having made heavy investments in MapReduce the emergence of Apache Spark as a new processing platform is both tempting and daunting. Refactoring code or altering processing steps can be a significant investment. The Apache Crunch project can help with the transition utilizing its built in support for reusing code in both execution environments. Teams can make incrementally migrate their processing workflows or utilize the appropriate execution engine depending on their use case while still utilizing a common set of concepts provided by Apache Crunch. The presentation will cover the basics of Apache Spark, how to reuse the same code in both MapReduce and Spark, as well as differences with using Apache Crunch over plain Apache Spark.