Configurable Retry Mechanism for Parquet Reader with MaxRetry and etlParquetMaxRetry Parameters
Details
| Detail name | Value |
|---|---|
| Changelog Number | 26841 |
| Type | Improvement |
| Status | Resolved |
| Fix Versions | Exasol 2025.1.3, Exasol 2025.2.0 |
| Resolution Date | 2025-09-17 |
Description
To enhance the reliability and robustness of the ETL process, the Parquet loader (ExaLoader) will be updated to support a retry strategy. This feature will allow ExaLoader to retry failed load attempts automatically, improving the success rate of data ingestion in scenarios involving transient or recoverable errors, such as network interruptions or temporary unavailability.
Improvement
The retry functionality can be configured by setting either the connection string parameter or the database parameter:
- Connection String Parameter: MaxRetry
- Database Parameter: etlParquetMaxRetry
Default Value
- The default value for retries is 10, regardless of the configuration source.
Validation Rules
- Connection String Parameter (MaxRetry)
- Database Parameter (etlParquetMaxRetry)
- The value must be greater than or equal to 0.
- If the value provided is less than 0, an exception will be thrown.
- If the value provided is less than 0, the parameter will automatically reset to the default value of 10.
This ensures retry behavior is always valid and predictable, preventing misconfigurations from affecting the ETL process.
