ApacheCon NA 2015

Apache Flink is one of the latest addition to the Apache family of data processing engines. Flink’s design aims to provide a system that is as fast as in-memory engines, while providing the reliability of Hadoop. Flink contains programming APIs in Java and Scala that unify batch processing and data streaming applications, a translation stack for transforming these programs to parallel data flows, and a runtime that supports both proper streaming and batch processing for executing these data flows in large compute clusters. Flink is compatible with the Hadoop ecosystem, and has a growing community of currently more than 70 contributors from industry and academia. In this presentation, Fabian will provide an overview of Flink both from the user standpoint and the system’s internal model, and discuss the project’s technical roadmap for the future.