Import/Export from/to Google Cloud Storage buckets

Details

Detail name Value
Changelog Number 7490
Type New Feature
Status Resolved
Fix Versions Exasol 6.1.2
Resolution Date 2019-03-01

IMPORT and EXPORT can now be used to read and write data directly from/to Google Cloud Storage buckets. Exasol automatically recognizes a Cloud Storage IMPORT/EXPORT based on the URL.

Note: Exasol only supports virtual-hosted-style Cloud Storage URLs (e.g., https://<bucket>.storage.googleapis.com). Path-style URLs (e.g., https://storage.googleapis.com/<bucket>) are not supported.

In order to use Cloud Storage with IMPORT/EXPORT, you must first set a default Google project and get a developer key for the Google account used for the IMPORT/EXPORT. For details, please see the following information regarding a "simple migration". https://cloud.google.com/storage/docs/migrating#migration-simple

For IMPORT/EXPORT authentication, provide the developer access key in the USER field and the developer key secret in the IDENTIFIED BY field.

Note: OAuth 2.0 authentication is not supported.

Examples:

IMPORT INTO testtable FROM CSV AT 'https://testbucket.storage.googleapis.com'
USER '<key>' IDENTIFIED BY '<key-secret>'
FILE 'testpath/test.csv';

EXPORT testtable INTO CSV AT 'https://testbucket.storage.googleapis.com'
USER '<key>' IDENTIFIED BY '<key-secret>'
FILE 'testpath/test.csv';

-- Alternate Cloud Storage endpoints
IMPORT INTO testtable FROM CSV AT 'https://testbucket.storage-download.googleapis.com'
USER '<key>' IDENTIFIED BY '<key-secret>'
FILE 'testpath/test.csv';

EXPORT testtable INTO CSV AT 'https://testbucket.storage-upload.googleapis.com'
USER '<key>' IDENTIFIED BY '<key-secret>'
FILE 'testpath/test.csv';