Load Data from Azure Blob Storage
This section explains how to download and upload blobs on Azure Blob Storage using the IMPORT and EXPORT commands.
Create connection
We recommend that you use CREATE CONNECTION to create a connection object for connecting to the Microsoft Azure Portal account.
CREATE CONNECTION MY_BLOBSTORAGE
TO 'DefaultEndpointsProtocol=https;EndpointSuffix=core.windows.net'
USER '<AccountName>'
IDENTIFIED BY '<AccountKey>';
<AccountName>
|
Azure Blob Storage account name |
<AccountKey>
|
Azure Blob Storage account key |
For information about how to get the correct account details, see View account access keys in the Microsoft Azure documentation.
For security reasons, make sure that you add your account key only in the IDENTIFIED BY
field.
Import data
Run the following statement to import data from Azure Blob Storage.
Export data
Run the following statement to export data to Azure Blob Storage.
File size limits
By default, the IMPORT and EXPORT commands will download or upload data blocks of 10 MiB in parallel, using two threads. Because Azure Blob Storage allows a maximum of 50,000 blocks in a single blob, the maximum file size that you can import to is approximately 500 GiB. If you want to change the default settings, edit the following database parameters:
-
etlAzureBlockSize
-
The minimum block size in bytes for Azure blob IMPORT/EXPORT operations. The default value is 10 MiB.
-
etlAzureMaxThreads
-
The maximum number of threads to use for Azure blob IMPORT/EXPORT operations. The default value is 2.
For information about how to edit database parameters, see Database Management in the Administration section for your selected deployment platform in this documentation.
Invalid parameters or invalid configuration syntax will prevent the database from starting. To avoid unnecessary downtime, contact Support before you add or change database parameters.