Reduction of TEMP memory consumption for inserting many rows into a table
Details
| Detail name | Value |
|---|---|
| Changelog Number | 8987 |
| Type | Improvement |
| Status | Resolved |
| Fix Versions | Exasol 7.0.0 |
| Resolution Date | 2020-09-11 |
Background
In EXASOL-2265 we introduced PARTITION BY feature in Exasol 6.1. With this the data pipeline for inserting data was largely restructured to facilitate multi-partition inserts.
As a side effect of above architectural change TEMP consumption of all inserting statements (INSERT, IMPORT, MERGE) increased measurably (a few bytes per row inserted).
Improvement
The TEMP memory consumption of inserting statements was significantly reduced. For long running statements with large DBRAM needs even runtimes can improve.