Linking Azure Storage Account

In this guide, we’ll link a private Azure storage account blob container to a Valohai project.

On Azure, you create storage accounts that have multiple services attached. One of those services is blob container, which is Valohai’s main interface on Azure-based installations.

1. Requirements

For this tutorial you will need:

  • Azure account you can administer
  • a Valohai project which to link the Azure storage account blob container to

2. Create an Azure storage account and a blob container

Naturally, skip this step if you already have a storage account and a blob container.

Azure portal storage account listing.

Create an Azure Storage Account through the Azure portal (https://portal.azure.com) by navigating to Storage accounts > + Add.

2.1 Select storage account name and location

Azure portal storage account creation page.

Throughout this guide, we will assume the name of the storage account name is tensorflow; be sure to replace this with the actual name of your storage account when copying in any example configuration!

Create the storage account in the location you’ll be running your work to reduce transfer costs.

2.2 Create a blob container

How to navigate to Blob Container creation page.

You will have to create a blob container inside the storage account to host your files.

Navigate to Blobs > + Container.

2.3 Name your blob container

Configuration options of your blog container.

You can name your container anything you want. In this guide, we assume it is mnisty.

Make sure that the public access level is Private.

3. Configure CORS for the blob container

If you wish to be able to upload files to the store using the app.valohai.com web UI, you will need to add a CORS policy document to the blob container.

Azure storage account CORS settings page.

Navigate Settings > CORS > Blob service and add the following 2 lines of configuration:

Origins Methods Allowed Headers Exposed Headers Max Age
* GET,OPTIONS content-type,x-ms-* x-ms-meta-* 3000
https://app.valohai.com POST,PUT content-type,x-ms-* x-ms-meta-* 3000

Now your blob container allows uploads through https://app.valohai.com web application.

4. Record access key for later usage

Azure storage account access key page.

Using the Azure portal, find and save access key under storage account Access keys tab. This will be added to Valohai in the next step.