GCS: Support for backup files larger than 5 TiB
Details
| Detail name | Value |
|---|---|
| Changelog Number | 17758 |
| Type | Improvement |
| Status | Resolved |
| Fix Versions | Exasol 7.1.23 |
| Resolution Date | 2023-09-11 |
Background
Google Cloud Storage (GCS) has a max file limit of 5 TiB. If a backup file is larger than 5 TiB per node, then the backup will fail because it hits this 5 TiB limit.
Improvement
Remote volumes that point to a GCS bucket can be configured to support splitting files automatically. As a result, the 5 TiB limit per object can be bypassed. The parameters to configure the splitting is the same as in https://exasol.my.site.com/s/article/Changelog-content-15464 for AWS.
Changed behavior
Enables options to automatically split files on a remote archive volume based on GCS