ApacheCon NA 2015 has ended
Back To Schedule
Wednesday, April 15 • 9:00am - 9:50am
Kafka at Scale: Multi-Tier Architectures - Todd Palino, LinkedIn

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

If data is the lifeblood of high technology, Apache Kafka is the circulatory system in use at LinkedIn. It is used for moving every type of data around between systems, and it touches virtually every server, every day. This can only be accomplished with multiple Kafka clusters, installed at several sites, and they must all work together to assure no message loss, and almost no message duplication. In this presentation, we will discuss the architectural choices behind how the clusters are deployed, and the tools and processes that have been developed to manage them. Todd Palino will also discuss some of the challenges of running Kafka at this scale, and how they are being addressed both operationally and in the Kafka development community.

avatar for Todd Palino

Todd Palino

Staff Site Reliability Engineer, http://linkedin.com/
Todd Palino is a Staff Site Reliability Engineer at LinkedIn, tasked with keeping Zookeeper, Kafka, and Samza deployments fed and watered. He is responsible for architecture, day-to-day operations, and tools development, including the creation of an advanced monitoring and notification... Read More →

Wednesday April 15, 2015 9:00am - 9:50am CDT
Texas VI

Attendees (0)