ETL: Parquet Import with Nested Structure Column - skipcols Not Working

Details

Detail name Value
Changelog Number 26826
Type Bug
Status Resolved
Affected Versions Exasol 2025.1.0
Fix Versions Exasol 2025.1.3, Exasol 2025.2.0
Resolution Date 2025-09-17

Description

When importing Parquet files containing nested structures, the skipcols parameter is not functioning as intended. Instead of skipping specified columns within nested structures, all columns are being processed irrespective of the skipcols configuration.

Workaround

No workaround available.

Fix

Now it is possible to skip the nested columns completely. Partial skipping of nested columns is not possible.

Example

Parquet file with 3 columns
Int, Map<Int, Int>, String

SkipCols=1

Will skip the Map<Int, Int> column and import columns Int, and String.