Load data from Google Cloud Storage

Learn how to load data into Exasol from Google Cloud Storage buckets.

You can use the IMPORT command to load data from files in Google Cloud Storage (GCS). Exasol automatically recognizes GCS as the source or destination based on the URL used with the IMPORT statement.

Prerequisites

An HMAC key for the Google project. For more information, see HMAC keysin the Google Cloud documentation.

Create connection

To prevent connection details from being exposed in logs and audit tables, we recommend that you always create a connection object using CREATE CONNECTION and authenticate using the saved connection instead of providing the details openly in the IMPORT/EXPORTstatements.

Example:
Copy 
CREATE CONNECTION <connection_name> 
TO '<bucket>.storage.googleapis.com' 
USER '<access_id>' IDENTIFIED BY '<secret>';

  • Exasol only supports virtually hosted cloud storage URLs using the following format:

    https://<bucket>.storage.googleapis.com.

    Path-style URLs such as https://storage.googleapis.com/<bucket> are not supported.

  • OAuth 2.0 authentication is not supported.

Import data

Example:
Copy 
CREATE CONNECTION my_conn 
TO 'https://my_bucket.storage.googleapis.com' 
USER 'my_access_id' IDENTIFIED BY 'my_secret';

IMPORT INTO testtable FROM CSV AT my_conn
FILE 'testpath/test.csv';