Competing Consumers Pattern

What does it consist of

  • Process of concurrent requests that have variable frequency and workload
  • Implementation of messaging system to pass requests through to consumer services
  • Can require a message queue system as a communication channel

What to consider

  • Is message processing order important 
  • Messages should be idempotent to cater for failures
  • Do we need to handle results (callback functions, results pool, ..)
  • Scalability of the messaging system would require multiple message queues
  • Reliability of the messaging system (no messages lost)

Is Node.JS an implementation ?

Competing Consumers

By hkoundi

Competing Consumers

  • 670