Kafka easy
How does Kafka uniquely identify and track a consumer's progress within a specific partition?
- A By deleting the message from the server immediately after it is transmitted.
- B By using an 'Offset', which is a unique monotonically increasing integer assigned to every record in a partition.
- C By tracking the consumer's IP address and session duration.
- D Through a timestamp provided by the producer's local clock.
Answer: B. By using an 'Offset', which is a unique monotonically increasing integer assigned to every record in a partition.
An Offset acts as a 'bookmark'. The consumer tells the broker: 'I have successfully processed up to offset 500'. If the consumer crashes and restarts, it can resume from offset 501, ensuring no data is missed or duplicated.
One system design question a day, with spaced repetition so the ones you miss come back.
Get the appRelated questions
- When implementing 'Exactly-Once Semantics' (EOS) in a Kafka stream, what is the role of the `isolation.level=read_committed` setting on the Consumer?
- Historically, which external service was required by Kafka to manage cluster hierarchy, metadata, and leader election status?
- Once a message is successfully appended to a Kafka partition log, what is its mutability status?
- In a Kafka cluster, what is the role of a 'Broker'?
- What is the primary indicator of a bottleneck in a Kafka consumer's processing logic?
- What is the primary architectural role of Apache Kafka in a distributed system?