

That way, you know if the application works on your machine, it will work on any machine you deploy it to. It allows you to package your applications into containers, which simplifies application distribution. Kafka version 2.8.0 introduced early access to a Kafka version without Zookeeper, but it’s not ready yet for production environments.ĭocker - An open-source platform for building, deploying, and managing containers. Zookeeper - Used to manage a Kafka cluster, track node status, and maintain a list of topics and messages. Sometimes a consumer is also a producer, as it puts data elsewhere in Kafka. Kafka consumer - A program you write to get data out of Kafka. Kafka producer - An application (a piece of code) you write to get data to Kafka. Imagine you had a large news site - each news category could be a single Kafka topic. Kafka topic - A category to which records are published. They handle producers and consumers and keeps data replicated in the cluster. Kafka broker - A single Kafka Cluster is made of Brokers. It’s written in Java and Scala, but you don’t have to know these to work with Kafka. It enables users to collect, store, and process data to build real-time event-driven applications. Kafka - Basically an event streaming platform. There’s a lot more going in to these concepts that are way beyond the scope of this article. The rest of the section will give only high-level definitions and overviews. Heck, it shouldn’t even be your first article on these topics. This article is by no means an extensive guide to Docker or Kafka. Terminology rundown - Everything you need to know
