Queue-Based Load  Levelling

Use a queue that acts as a buffer between a task and a service it invokes 

When to use this pattern?  

• This pattern is useful to any application that uses services that are subject to overloading. 

When NOT to use this pattern?  

• This pattern isn't useful if the application expects a response from the service with minimal latency. 

Introduce a message queue(service bus queue) between the data source and consumer 

Considerations  

• Avoid overwhelming the target resource.  

• Message queues are a one-way communication mechanism.  

• Be careful if you apply autoscalling to services that are listening for requests on the queue.