ETL: Parquet Import with Nested Structure Column - skipcols Not Working
Details
| Detail name | Value |
|---|---|
| Changelog Number | 26826 |
| Type | Bug |
| Status | Resolved |
| Affected Versions | Exasol 2025.1.0 |
| Fix Versions | Exasol 2025.1.3, Exasol 2025.2.0 |
| Resolution Date | 2025-09-17 |
Description
When importing Parquet files containing nested structures, the skipcols parameter is not functioning as intended. Instead of skipping specified columns within nested structures, all columns are being processed irrespective of the skipcols configuration.
Workaround
No workaround available.
Fix
Now it is possible to skip the nested columns completely. Partial skipping of nested columns is not possible.
Example
Parquet file with 3 columns Int, Map<Int, Int>, String SkipCols=1 Will skip the Map<Int, Int> column and import columns Int, and String.