Managing Long Running Tasks medium
What is the 'Competing Consumers' pattern?
- A Two companies fighting.
- B Multiple worker instances reading from the SAME queue. Each message is delivered to only ONE worker to balance the load.
- C One worker reading from multiple queues.
- D Broadcasting to everyone.
Answer: B. Multiple worker instances reading from the SAME queue. Each message is delivered to only ONE worker to balance the load.
This allows horizontal scaling of workers. If the queue grows, just add more consumers.
One system design question a day, with spaced repetition so the ones you miss come back.
Get the appRelated questions
- What is the primary purpose of a Dead Letter Queue (DLQ)?
- The architectural pattern where one service creates tasks and another processes them is called:
- In a Priority Queue system (High vs Low), what is 'Starvation' and how do you fix it?
- How do you atomically update your local database AND publish a message to a queue without losing sync if the process crashes in between?
- What does 'Fire and Forget' mean?
- Why might you 'Throttle' (limit the speed of) your background workers?