Azure Blob Storage Integration

Overview

Azure Integration

The Azure Blob Storage integration enables seamless interaction with Azure’s blob storage solution, automating workflows to enhance operational efficiency. This integration ensures that documents uploaded to Azure Blob Storage are automatically processed by super.AI and the results are uploaded back to Azure Blob Storage, minimising manual intervention and delivering significant value to businesses relying on Azure for their storage needs.

How the Integration Works

1. Event-Based Triggers

The integration leverages Azure Blob Storage’s event notification system:

• When a document is uploaded to a specified container in Azure Blob Storage, an event is triggered.
• The event sends metadata about the uploaded file to our system.

2. Fetch and Process Workflow

• Upon receiving the event notification, our system fetches the document using the provided metadata.
• The document undergoes the necessary processing based on predefined workflows, such as data extraction, transformation, or validation.

3. Upload Processed Results

• After processing, the document or its results are uploaded back to a designated container in the customer’s Azure Blob Storage account.

This process ensures real-time or near-real-time document handling, streamlining operations and eliminating the need for manual uploads or downloads.

Setup Process

Step 1: Azure Account Configuration

1. Set Up Containers:

   • Create a dedicated container for incoming documents.
   • Optionally, create a separate container for processed documents.

2. Grant Permissions:

   • Assign the necessary roles (e.g., Storage Blob Data Reader, Storage Blob Data Contributor) to ensure our system can access and manage blobs.

3. Enable Azure Event Grid:

   • Ensure Azure Event Grid is enabled in your subscription.
   • Create an event subscription for the desired blob storage container. Follow the guide here for step-by-step instructions.
   • In the "Subscribe to the Blob storage" section:
     • Event Types: Select only the "Blob creation" event type.
     • Endpoint Details: Contact our Customer Success Manager to provide you with the endpoint details.

Step 2: Provide Credentials and Access Details

To activate the integration, customers need to provide the following details:

Credential Requirements

1. Storage Account Name:

   • The name of the Azure storage account hosting the blob containers.

2. Access Key or Shared Access Signature (SAS):

   • A storage account access key or a SAS token with the required permissions.

3. Container Names:

   • Names of the containers for uploading and retrieving files.

4. Event Grid Endpoint:

   • The endpoint URL for receiving blob storage event notifications.

5. Super.AI Application ID:

   • The ID of your super.AI application.

Step 3: Test the Integration

1. Upload Documents:

   • Add test documents to your Azure Blob Storage.

2. Verify Processing:

   • Confirm that the documents are processed and outputs are available in the designated container.

FAQs

Security

Q: How secure is the integration?
A: The integration utilises Azure’s built-in security features and end-to-end encryption, ensuring data remains protected throughout the workflow.

File Support

Q: What file types are supported?
A: The integration supports all file types compatible with the super.AI platform. Refer to the list here.

Scalability

Q: Can the system handle high-volume uploads?
A: Yes, the system is designed to scale with demand, efficiently managing large volumes of data.

Conclusion

The Azure Blob Storage integration offers a powerful solution for automating document handling and processing workflows. Its real-time capabilities, robust security, and scalability make it an essential tool for businesses leveraging Azure for their storage needs. By following the steps outlined above, you can quickly and effectively set up the integration, maximising its benefits for your operations.