Storage Queue
  • 19 Nov 2024
  • 3 Minutes to read
  • Dark
    Light
  • PDF

Storage Queue

  • Dark
    Light
  • PDF

Article summary

Introduction

Storage Queue is a service for storing over 80 GB of messages that can be accessed from anywhere in the world via authenticated calls using HTTP or HTTPS.

It provides cloud messaging between application components. In designing applications for scale, application components are often decoupled, so that they can scale independently.

Storage Queue delivers asynchronous messaging for communication between application components.

A single queue message can be up to 64 KB in size, and a queue can contain millions of messages, up to the total capacity limit of a storage account.

Challenges in processing messages

Azure portal offers limited capability for processing the messages in storage queue like enqueue, dequeue and view the message through the Storage Explorer.

Below are more useful capabilities not addressed in the portal:

  • updating the message content along with its properties

  • resubmitting the messages to the Storage queue

  • downloading the messages

  • uploading messages from a file into the Storage Queue

Users will have to either manually process or use custom code to achieve the above mentioned critical tasks.

That would turn out to be a tedious process, considering there is a high number of Storage queues with each containing a huge number of messages.

Solutions provided by Turbo360

  • Turbo360 intends to fix the above-mentioned gap in the Azure portal by extending its support to process the messages in Storage Queue.

Retrieve messages from Storage Queue

  • In Turbo360, users can retrieve the messages from Storage Queues in read-only mode. This will not remove the message from the Storage Queue.

  • Each time when a message is retrieved, its dequeue count will get increased by one.

  • Along with the message content, properties of the message can also be viewed

Retrieve messages.png

Update message in Storage Queue

The content of messages in a Storage Queue can be modified using the Update option.

Update message.png

Update message action will not remove the message from the Storage Queue. It will only retain the message with the modified content.

Resubmit messages in Storage Queue

  • Once the messages are received from the Storage Queue, users can perform a resubmit operation on them.

  • In this process, a new message will be submitted with the same content into the destination Storage Queue.

Resubmit message.png

  • The user is also provided with a list of Storage Queues to which the messages can be resubmitted. This operation can be carried out on one or more messages.

  • Multiple messages can be resubmitted simultaneously by selecting them and clicking Actions -> Resubmit.

Bulk.png

Resubmit action will remove the original messages being resubmitted from the source Storage Queue

Repair and Resubmit message in Storage Queue

  • Once the messages are received from the Storage Queue, users can perform a repair and resubmit operation on them.

  • In this process, a new message will be submitted with the updated content, visibility timeout and time to live into the destination Storage Queue.

  • The user is also provided with a list of Storage Queues to which the messages can be resubmitted. It should be noted that this will remove the resubmitted message from the source Storage Queue.

Repair and Resubmit.png

Resubmit action will remove the original messages being resubmitted from the source Storage Queue.

Delete Messages in Storage Queue

  • Once the messages are received from the Storage Queue, users can perform delete operation on them.

  • The delete operation can be carried out on one or more messages.

Delete message.png

Bulk.png

  • The delete operation can be also be automated in the Automated Tasks section.

Automated task.png

Inline task

  • In Storage Queue section, users can create a really quick task to purge messages from the source queue that is being explored.

  • The configuration created to run immediately can also be saved for future use in Automated Tasks section.

Inline task to purge messages

This feature allows users to quickly purge messages from the queue by providing the following inputs:

  • Message count (can be all or a specified number)
  • Message Enqueued At time
  • Configuration name (if Save configuration is enabled)

Inline task.png

Task status can be viewed by navigating to Automated Tasks section and switching to Task history tab.

  • Users can use this feature to quickly create a task that runs immediately.

  • Navigate to the Automated Tasks section in Turbo360 to create a task with a more detailed configuration, schedule tasks to run at a specific time, or automate the task to run on the specified hours, days, and more.

Automated task

  • Manually processing Storage queue messages in large applications is not a suggested approach as it is a very time consuming process and sometimes requires users to set up a separate application to perform this purging process.

  • The Automated Task feature of Turbo360 makes it possible to overcome all these drawbacks.

Automated task.png

Monitoring

The total message count of a Storage queue can be monitored using Turbo360

  1. Navigate to Storage Queue -> Monitoring
  2. Configure threshold for message count
  3. Click Save

Monitoring.png


Was this article helpful?