Use the MAX_SPILLED_RESULT_SPOOLING_MEM
query option to
set the maximum amount of memory that can be spilled when spooling query
results.
If the amount of memory exceeds this value when spooling query results, the coordinator fragment will block until the client has consumed enough rows to free up more memory.
The MAX_SPILLED_RESULT_SPOOLING_MEM
query option is
applicable only when query result spooling is enabled with the
SPOOL_QUERY_RESULTS
query option set to
TRUE
.
The value must be greater than or equal to the value of
MAX_RESULT_SPOOLING_MEM
.
Setting the option to 0
or -1
means the
memory is unbounded.
Values below -1
are not allowed for this query
option.
Type:
INT
Default: 1024 * 1024 * 1024 (1 GB)
Added in: Impala 3.4
Related information: FETCH_ROWS_TIMEOUT_MS Query Option, MAX_SPILLED_RESULT_SPOOLING_MEM Query Option, SPOOL_QUERY_RESULTS Query Option