Managing Long Running Tasks easy
What is 'Batch Processing'?
- A Processing one item at a time.
- B Cooking cookies.
- C Real-time processing.
- D Collecting a group of tasks (a batch) and processing them all together (e.g., sending 100 emails in one connection).
Answer: D. Collecting a group of tasks (a batch) and processing them all together (e.g., sending 100 emails in one connection).
Batching improves throughput by amortizing setup capability/costs (connections, transactions).
One system design question a day, with spaced repetition so the ones you miss come back.
Get the appRelated questions
- What is the primary purpose of a Dead Letter Queue (DLQ)?
- The architectural pattern where one service creates tasks and another processes them is called:
- In a Priority Queue system (High vs Low), what is 'Starvation' and how do you fix it?
- How do you atomically update your local database AND publish a message to a queue without losing sync if the process crashes in between?
- What does 'Fire and Forget' mean?
- Why might you 'Throttle' (limit the speed of) your background workers?