Impala 4.1.1 Change Log

Bug

• [IMPALA-5845] - Impala should de-duplicate row parsing error
• [IMPALA-7864] - TestLocalCatalogRetries::test_replan_limit is flaky
• [IMPALA-9410] - Support resolving ORC file columns by names
• [IMPALA-9823] - use_local_catalog and related flags shouldn't be hidden
• [IMPALA-10057] - TransactionKeepalive NoClassDefFoundError floods logs during JDBC_TEST/FE_TEST
• [IMPALA-10267] - Impala crashes in HdfsScanner::WriteTemplateTuples() with negative num_tuples
• [IMPALA-10865] - Query with select alias the same as column name rewrite error for grouping exprs
• [IMPALA-11034] - Resolve schema of old data files in migrated Iceberg tables
• [IMPALA-11160] - TestAcid.test_acid_compute_stats failed in ubuntu-16.04-dockerised-tests
• [IMPALA-11208] - CollectionItemsRead profile counter might be wrong in ORC scanner
• [IMPALA-11249] - Precommits are not running strict_hs2_protocol=True configurations for shell tests
• [IMPALA-11274] - CNF Rewrite causes a regress in join node performance
• [IMPALA-11280] - Zipping unnest hits DCHECK when querying from a view that has an IN operator
• [IMPALA-11281] - Consider loading the table metadata for a ResetMetadataStmt
• [IMPALA-11291] - minidump-test is flaky
• [IMPALA-11295] - TestParquet.test_multiple_blocks_mt_dop failed by unexpected ranges_complete_list
• [IMPALA-11301] - Extreme cardinality estimations if NDV=1
• [IMPALA-11302] - Improve error message for CREATE EXTERNAL TABLE iceberg command
• [IMPALA-11303] - Exception is not raised for Iceberg DDL that misses LOCATION clause
• [IMPALA-11305] - TypeError in impala-shell summary progress
• [IMPALA-11315] - TestImpalaShellInteractive.test_multiline_queries_in_history fails with python3
• [IMPALA-11316] - TestImpalaShell.test_http_socket_timeout fails on Python3 with different message
• [IMPALA-11317] - TestImpalaShellInteractive.test_http_interactions_extra fails on Python 3
• [IMPALA-11323] - Invalid inferred predicates based on casted null values being equivalent
• [IMPALA-11325] - Impala-shell hits UnicodeDecodeError when outputting Unicode via --output_file
• [IMPALA-11332] - impala-shell strips trailing whitespace from csv output
• [IMPALA-11335] - WriteId must be requested before taking locks during inserts
• [IMPALA-11337] - impala-shell can output the "Fetched X row(s)" line before the actual results
• [IMPALA-11342] - Hive UDFs are unable to use classes from the same Jar in catalogd
• [IMPALA-11344] - Selecting only the missing fields of ORC files should return NULLs
• [IMPALA-11345] - Query failed when creating equal conjunction map for Parquet bloom filter
• [IMPALA-11346] - Migrated partitioned Iceberg tables might return ERROR when WHERE condition is used on partition column
• [IMPALA-11358] - Kudu tables missing comment field if HMS-Kudu integration is enabled
• [IMPALA-11365] - Dereferencing null pointer in TopNNode
• [IMPALA-11368] - Iceberg time-travel error message shows timestamp in UTC
• [IMPALA-11391] - TestKuduHMSIntegration.test_drop_managed_kudu_table fails sometimes due to race condition
• [IMPALA-11406] - Incorrect duration logged in "Authorization check took n ms"
• [IMPALA-11412] - CodegenFnPtr<FuncType>::store() has a compile time error when instantiated
• [IMPALA-11414] - Off-by-one error in Parquet late materialization
• [IMPALA-11416] - SlotRef::tuple_is_nullable_ uninitialised for struct children
• [IMPALA-11434] - More than 1 2d arrays in select list causes analysis error
• [IMPALA-11443] - Possible overflow in SortNode.java
• [IMPALA-11445] - Fix the issue for partitions in different file systems
• [IMPALA-11447] - Fetching arrays/structs crashes Impala if result caching is enabled
• [IMPALA-11457] - Ozone parallelism reduced when backends are co-located
• [IMPALA-11464] - hasNext() throws FileNotFoundException on staging files and breaks file metadata loading
• [IMPALA-11489] - Async IO cannot handle >2GB ORC files
• [IMPALA-11492] - ExprTest.Utf8MaskTest fails when en_US.UTF-8 is not present
• [IMPALA-11528] - hive-exec.pom doesn't include UDAF class
• [IMPALA-11557] - Memory leak in BlockingRowBatchQueue
• [IMPALA-11558] - Looks like memory leak when select from kudu table concurrently
• [IMPALA-11567] - Error in left outer join if the right side is a subquery with complex types
• [IMPALA-11580] - Memory leak in legacy catalog mode when applying incremental partition updates
• [IMPALA-11631] - Impala crashes in impala::TopNNode::Heap::Close()
• [IMPALA-11648] - validate-java-pom-versions.sh should skip pom.xml in toolchain

Improvement

• [IMPALA-10794] - Improve observability of execDdl code paths
• [IMPALA-11275] - Dump thread debug information when crashing/generating a minidump
• [IMPALA-11401] - Catalogd should log the table names causing OOM on array limit
• [IMPALA-11573] - Certain methods used by the replan feature can be improved