Author: Danica Fine

In this third installment of a blog series examining Kafka Producer and Consumer Internals, we switch our attention to Kafka consumer clients, examining how consumers interact with brokers, coordinate their partitions, and send requests to read data from Kafka topics.

In this post, the second in the Kafka Producer and Consumer Internals Series, we follow our brave hero—a well-formed produce request—which is on its way to be processed by the broker and have its data stored on the cluster.

The beauty of Kafka as a technology is that it can do a lot with little effort on your part. In effect, it’s a black box. But what if you need to see into the black box to debug something? This post shows what the producer does behind the scenes to help prepare your raw event data for the broker.

On September 17-18, the data streaming world will descend upon Austin, Texas for Current 2024––bringing the community together to discuss all things Apache Kafka® and Apache Flink®. You’ll hear from tech leaders, industry giants, and startups as they drop a seemingly endless supply of knowledge...

If you know me, you know that I’m always looking for any excuse to bring the data streaming community together.

For the very first time, Kafka Summit is coming to Bangalore on May 2, 2024, at the Sheraton Grand Bengaluru Whitefield Hotel & Convention Center. And we’re bringing everything that makes Kafka Summit, well, Kafka Summit.

It’s that time of year again––Kafka Summit London is right around the corner. On March 19 and 20, the Kafka community will gather at ExCeL London to talk about all things new and exciting in the world of Apache Kafka®.

Kafka Summit London 2023 has come and gone like any other year… But now, with all 60+ of the Kafka Summit London 2023 sessions available online, you can relive all of your favorite talks again and again!

Hi there, it’s me, Danica Fine, your friendly neighborhood Kafka Summit London Program Committee Chair. Kafka Summit London 2023 is in just over two weeks, and I’ll be joining our incredible community members at the ExCeL in London to talk all things Apache Kafka® over two jam-packed days.

If you’ve used Kafka for any amount of time you’ve likely heard about connections; the most common place that they come up is in regard to clients. Sure, producer and consumer clients connect to the cluster to do their jobs, but it doesn’t stop there. Nearly all interactions across a cluster...

This Thanksgiving-themed blog post walks through a brand new stream processing use case recipe for analyzing survey responses in real-time and gives ideas for how to spice it up and make the recipe your own!

The call for papers for Kafka Summit London 2023 has opened, and we’re looking to hear about your experiences using and working with Kafka. Every great technical talk starts with an experience. If you’re stuck looking for ideas on what to talk about, write what you know...

Rebalancing comes into play in Apache Kafka® when consumers join or leave a consumer group. In either case, there is a different number of consumers over which to distribute the partitions from the topic(s), and, so, they must be redistributed and rebalanced....

It can be easy to go about life without thinking about them, but requests are an important part of Apache Kafka; they form the basis of how clients interact with data as it moves into and out of Kafka topics, and, in certain cases, too many requests can have a negative impact on your brokers...