GCS: Support for backup files larger than 5 TiB
Details
| Detail name | Value |
|---|---|
| Changelog Number | 17758 |
| Type | Improvement |
| Status | Resolved |
| Fix Versions | Exasol 7.1.23 |
| Resolution Date | 2023-09-11 |
Background
Google Cloud Storage (GCS) has a max file limit of 5 TiB. If a backup file is larger than 5 TiB per node, then the backup will fail because it hits this 5 TiB limit.
Improvement
Remote volumes that point to a GCS bucket can be configured to support splitting files automatically. As a result, the 5 TiB limit per object can be bypassed. The parameters to configure the splitting is the same as in Changelog 15464 for AWS.
Changed behavior
Enables options to automatically split files on a remote archive volume based on GCS