Impala 3.4 Change Log
Release Notes - IMPALA - Version Impala 3.4.0
New Feature
- [IMPALA-4050] - Support starting webserver specified by hostname
- [IMPALA-5092] - Support for VARCHAR for Kudu tables
- [IMPALA-8046] - Support CREATE TABLE from an ORC file
- [IMPALA-8228] - Support for object ownership with Ranger authorization provider
- [IMPALA-8913] - Add query option for disabling HBase row estimation
- [IMPALA-8994] - Support Row Filtering in Impala
- [IMPALA-9009] - Core support for column mask transformation in select list
- [IMPALA-9010] - Support pre-defined mask types from Ranger UI
- [IMPALA-9092] - Add support for creating external Kudu table
- [IMPALA-9348] - Add flag to disable column masking feature
Epic
- [IMPALA-7916] - Support for Apache Ranger authorization provider
Improvement
- [IMPALA-4224] - Add backend support for join build sinks in parallel plans
- [IMPALA-4268] - Rework coordinator buffering to buffer more data
- [IMPALA-4400] - Aggregate runtime filters locally
- [IMPALA-6393] - live_summary and live_progress are not supported in impalarc
- [IMPALA-6501] - Optimize count(*) for Kudu scans
- [IMPALA-7117] - Lower debug level for HDFS S3 connector back to INFO
- [IMPALA-7322] - Add storage wait time to profile for operations with metadata load
- [IMPALA-7350] - More accurate memory estimates for admission
- [IMPALA-7504] - ParseKerberosPrincipal() should use krb5_parse_name() instead
- [IMPALA-7608] - Estimate row count from file size when no stats available
- [IMPALA-7637] - Include more hash table stats in profile
- [IMPALA-8065] - OSInfo produces somewhat misleading output when running in container
- [IMPALA-8361] - Bound predicates optimization doesn't work for InlineView
- [IMPALA-8451] - Default configs for admission control
- [IMPALA-8525] - preads should use hdfsPreadFully rather than hdfsPread
- [IMPALA-8548] - Include Documentation About Ordinal Substitution
- [IMPALA-8580] - Impala Doc: Explain SimpleDateFormat in Impala
- [IMPALA-8583] - Add metrics for authentication
- [IMPALA-8584] - Add support for cookie-based authentication
- [IMPALA-8586] - bin/bootstrap_toolchain.py should support URL environment variables for CDP components
- [IMPALA-8634] - Catalog client should be resilient to temporary Catalog outage
- [IMPALA-8656] - Support for eagerly fetching and spooling all query result rows
- [IMPALA-8759] - Use double precision for HLL
- [IMPALA-8797] - Blacklist "sys" and "information_schema" databases from Hive
- [IMPALA-8855] - Impala docs do not mention all places VALUES clause can be used
- [IMPALA-8863] - Add support to run tests over HS2-HTTP
- [IMPALA-8866] - Bump versions of components
- [IMPALA-8884] - Track Read(), Open() and Write() operation time per disk queue
- [IMPALA-8885] - Improve parquet version metadata error
- [IMPALA-8892] - Add tools to Docker images
- [IMPALA-8895] - Expose daemon health on /healthz endpoint
- [IMPALA-8897] - Fully qualify all paths on the webserver
- [IMPALA-8898] - Delete cookies on 401
- [IMPALA-8899] - Add cookie support to the webui
- [IMPALA-8905] - Add admission control metric to expose queue time out config for a pool
- [IMPALA-8912] - Avoid calling computeStats twice on HBaseScanNode
- [IMPALA-8923] - Don't need synchronized in HBaseTable.getEstimatedRowStats
- [IMPALA-8928] - Add query option to only set the mem limit on executors
- [IMPALA-8935] - Add links to other daemons from webui
- [IMPALA-8936] - Make queuing reason for unhealthy executor groups more generic
- [IMPALA-8942] - Set file format specific values for split sizes on non-block stores
- [IMPALA-9002] - Add flag to only check SELECT priviledge in GET_TABLES
- [IMPALA-9005] - Simplify distcc server bootstrapping
- [IMPALA-9026] - Add an option to use resolved IP address for Statestore subscriber
- [IMPALA-9028] - Impala shell should not try to reconnect when quitting
- [IMPALA-9033] - Log metrics for slow I/Os
- [IMPALA-9060] - Slow I/O logging is quite verbose on S3
- [IMPALA-9066] - Add a favicon to the webui
- [IMPALA-9070] - Include table location information in lineage graphs for external tables.
- [IMPALA-9090] - Scan node in HDFS profile should include name of table being scanned
- [IMPALA-9126] - Cleanly separate build and probe state in hash join node
- [IMPALA-9127] - Clean up probe-side state machine in hash join
- [IMPALA-9181] - Serialize TQueryCtx once per query
- [IMPALA-9195] - Using multithreaded execution to accelerate show tables/databases
- [IMPALA-9197] - Hash table lookup should be read-only
- [IMPALA-9198] - Add docs about impala-shell with tlsv1.2
- [IMPALA-9231] - Use simplified privilege checks for show databases
- [IMPALA-9235] - Backport Kudu socket stats for /rpcz
- [IMPALA-9268] - CreateKuduTableWithoutHMSTest caused TestLogFragments failed
- [IMPALA-9302] - Multithreaded scanners don't check for filter effectiveness
- [IMPALA-9330] - Support masking queries containing correlated collection references
- [IMPALA-9359] - Recover gracefully from corrupt kerberos credential cache
- [IMPALA-9384] - Improve Impala shell usability by enabling live_progress in interactive mode
- [IMPALA-9430] - Kerberos configs should be passed through to Kerberos libraries even if principal is not set
- [IMPALA-9439] - Make --scale a mandatory option in single_node_perf_run.py
- [IMPALA-9456] - Allow disabling kerberos for incoming internal and external connections even if --principal is set
- [IMPALA-9577] - Use `system_unsync` time for Kudu test clusters
Bug
- [IMPALA-2312] - Timing bug in both MonotonicStopWatch and StopWatch
- [IMPALA-4057] - Start webserver with interface"127.0.0.1" failed.
- [IMPALA-4618] - # hosts is inaccurate in exec summary when mt_dop > 0
- [IMPALA-6660] - -0/+0 floating point do not compare as equal in hash table
- [IMPALA-6772] - Enable test_scanners_fuzz for ORC format
- [IMPALA-7027] - Multiple Cast to Varchar with different limit fails with "AnalysisException: null CAUSED BY: IllegalArgumentException: "
- [IMPALA-7604] - In AggregationNode.computeStats, handle cardinality overflow better
- [IMPALA-7726] - Drop with purge tests fail against ABFS due to trash misbehavior
- [IMPALA-7784] - Partition pruning handles escaped strings incorrectly
- [IMPALA-7860] - Tests use partition name that isn't supported on ABFS
- [IMPALA-8059] - TestWebPage::test_backend_states is flaky
- [IMPALA-8115] - some jenkins workers slow to do real work due to dpkg lock conflicts
- [IMPALA-8498] - Write column index for floating types when NaN is not present
- [IMPALA-8501] - RpcMgrTest.SlowCallback and RpcMgrTest.AsyncCall sometimes have port conflicts
- [IMPALA-8533] - Impala daemon crash on sort
- [IMPALA-8557] - Impala on ABFS failed with error "IllegalArgumentException: ABFS does not allow files or directories to end with a dot."
- [IMPALA-8647] - The cardinality associated with a SelectNode is 0 even if its child node has a non-zero cardinality
- [IMPALA-8692] - Gracefully fail complex type inserts
- [IMPALA-8698] - test_bloom_filters fails when run on seq/gzip/record table format
- [IMPALA-8718] - Incorrect AnalysisException with outer join complex type column
- [IMPALA-8742] - ScannerContext::eosr() should depends on scan_range->bytes_to_read() instead of scan_range->len()
- [IMPALA-8760] - TestAdmissionControllerStress.test_mem_limit timed out waiting for query to end
- [IMPALA-8791] - Handle the case where there is no fragment scheduled on the coordinator for a query
- [IMPALA-8815] - Ranger fail to start in minicluster if you source set-classpath.sh
- [IMPALA-8842] - Impala should set correct value for 'engine' column in TAB_COL_STATS HMS table and read stats accordingly
- [IMPALA-8851] - Drop table if exists throws authorization exception when table does not exist
- [IMPALA-8858] - Add metrics to improve observability of idle executor groups
- [IMPALA-8867] - test_auto_scaling is flaky
- [IMPALA-8869] - Fix handling of HTTP keep-alive when returning 401
- [IMPALA-8873] - LdapImpalaShellTest.testShellLdapAuth failed because Python version is too old
- [IMPALA-8880] - EventsProcessorStressTest.testUsingRandomHiveQueries seems to be a flaky test
- [IMPALA-8891] - concat_ws() null handling is non-standard
- [IMPALA-8896] - alterPartitionsWithTransaction() emits too many alter table operations
- [IMPALA-8902] - TestResultSpooling.test_spilling is flaky
- [IMPALA-8904] - Daemons fails fast when statestore has not started up
- [IMPALA-8906] - TestObservability.test_query_profile_contains_query_compilation_metadata_load_events is flaky
- [IMPALA-8907] - TestResultSpooling.test_slow_query is flaky
- [IMPALA-8909] - Timestamp timezone conversion causes impalad crash
- [IMPALA-8915] - Re-fix # links on /catalog page.
- [IMPALA-8917] - Including hostnames in debug UI URLs breaks a lot of use cases
- [IMPALA-8921] - Use kerberos short name for ranger requests.
- [IMPALA-8931] - Fe not generating lineages when event hooks are configured
- [IMPALA-8932] - impala shell shouldn't retry with kerberos when connecting over http
- [IMPALA-8933] - Ranger column deny policies not respected under certain circumstances
- [IMPALA-8945] - Impala Doc: Incorrect Claim of Equivalence in Impala Docs
- [IMPALA-8946] - Prometheus histograms do not follow conventions
- [IMPALA-8947] - SCRATCH_ALLOCATION_FAILED error uses wrong utilisation metric
- [IMPALA-8948] - [DOCS] Review "How Impala Works with Hadoop File Formats"
- [IMPALA-8957] - TestFetchAndSpooling.test_rows_sent_counters is flaky
- [IMPALA-8960] - test_drop_if_exists fails on S3 due to incomplete URI
- [IMPALA-8962] - FETCH_ROWS_TIMEOUT_MS should apply before rows are available
- [IMPALA-8969] - Grouping aggregator can cause segmentation fault when doing multiple aggregations.
- [IMPALA-8973] - Update Kudu version to fix openssl1.1.1 compatibility issue
- [IMPALA-8977] - Native toolchain docker image build references non-existent maven tarball
- [IMPALA-8978] - Native toolchain Centos 6 docker image build is broken
- [IMPALA-8982] - Fix webserver handling of OPTIONS
- [IMPALA-8984] - Submit several same kudu table created query concurrently may result in table deleted in Kudu storage
- [IMPALA-8995] - TestAdmissionController.test_statestore_outage seems flaky
- [IMPALA-8996] - test_show_create_table in test_zorder.py failed
- [IMPALA-9001] - Fix SPNEGO for requests with no "Authorization"
- [IMPALA-9022] - test_query_profile_storage_load_time_filesystem is flaky
- [IMPALA-9023] - select statement fails with "ERROR: IllegalStateException: null" after expression rewrite
- [IMPALA-9025] - An Impala query fails with error "ERROR: IllegalStateException: null"
- [IMPALA-9030] - Handle translated external Kudu tables
- [IMPALA-9034] - ccache + distcc doesn't work with local ccache
- [IMPALA-9036] - Unable to CTRL+C an unfinished query in impala-shell
- [IMPALA-9045] - Filter base directories of open/aborted compactions
- [IMPALA-9047] - Some Ranger related test cases fail when using a newer version of Ranger
- [IMPALA-9052] - Events processor goes into error state if there are events on blacklisted db or table
- [IMPALA-9054] - Flaky test: test_misformatted_profile_text in query_test/test_cancellation.py
- [IMPALA-9055] - HDFS Caching with Impala: Expiration 26687997791:19:48:13.951 exceeds the max relative expiration time of <maxTtl>
- [IMPALA-9067] - Impala Doc: Relabel the Ports table correctly
- [IMPALA-9068] - Impala should respect the distinction between the managed warehouse and the external warehouse
- [IMPALA-9071] - When metastore.warehouse.dir != metastore.warehouse.external.dir, Impala writes to the wrong location for external tables
- [IMPALA-9073] - Failed test during pre-commit: custom_cluster.test_executor_groups.TestExecutorGroups.test_executor_concurrency
- [IMPALA-9085] - Impala Doc: Refactor impala_s3.html
- [IMPALA-9087] - test_mt_dop_fallback appears flaky
- [IMPALA-9093] - Fix ACID upgrade tests to account for HIVE-22158 (table translation)
- [IMPALA-9094] - Update test_hms_integration.py test_compute_stats_get_to_hive to account for separate Hive/Impala statistics
- [IMPALA-9095] - Alter table events generated by renames are not renaming the table to a different DB.
- [IMPALA-9098] - TestQueries.test_union failed
- [IMPALA-9100] - tests/run-tests.py should handle duplicate --skip-stress flags
- [IMPALA-9101] - Unneccessary REFRESH due to wrong self-event detection
- [IMPALA-9105] - Catalog debug page top-n table has a URL generation issue
- [IMPALA-9108] - Unused leveldbjni dependency triggers some security scanners
- [IMPALA-9116] - SASL server fails when FQDN is greater than 63 characters long in Kudu RPC
- [IMPALA-9122] - Ignore FileNotFoundException when loading a table
- [IMPALA-9128] - Improve debugging for slow sends in KrpcDataStreamSender
- [IMPALA-9132] - Explain statements should not cause NPE in LogLineageRecord()
- [IMPALA-9136] - IllegalStateException in calling Table.toThrift() without holding the table lock
- [IMPALA-9146] - Limit the size of the broadcast input on build side of hash join
- [IMPALA-9150] - Restarting minicluster breaks HBase on CDH GBN 1582079
- [IMPALA-9151] - Number of executors during planning needs to account for suspended executor groupa
- [IMPALA-9152] - AuthorizationStmtTest.testColumnMaskEnabled failed in precommits.
- [IMPALA-9154] - KRPC DataStreamService threads blocked in PublishFilter
- [IMPALA-9157] - TestAuthorizationProvider.test_invalid_provider_flag fails due to Python 2.6 incompatible code
- [IMPALA-9159] - test_concurrent_ddls.py's test_ddls_with_invalidate_metadata_sync_ddl timed out after 17 hours
- [IMPALA-9162] - Incorrect redundant predicate applied to outer join
- [IMPALA-9165] - Precommit jobs getting stuck in testdata/bin/create-hbase.sh
- [IMPALA-9166] - Need to restore HIVE_MAJOR_VERSION=2 limitation for resource-requirements.test
- [IMPALA-9167] - stress/test_acid_stress.py gets TimeoutError on s3
- [IMPALA-9168] - TestConcurrentDdls flaky on s3 (Could not resolve table reference)
- [IMPALA-9171] - Update to impyla 0.16.1 is not Python 2.6 compatible
- [IMPALA-9177] - TestTpchQuery.test_tpch query 18 on Kudu sometimes hits memory limit on dockerised tests
- [IMPALA-9188] - Dataload is failing when USE_CDP_HIVE=true
- [IMPALA-9202] - Fix flakiness in TestExecutorGroups
- [IMPALA-9209] - TestRPCException.test_end_data_stream_error is flaky
- [IMPALA-9211] - CreateTable with sync_ddl may fail with concurrent INVALIDATE METADATA
- [IMPALA-9241] - Minicluster service status ambiguous when pids wrap around
- [IMPALA-9248] - test_krpc_rpcz breaks on Centos6 with missing "bytes_acked"
- [IMPALA-9250] - HdfsOrcScanner crash in calling orc::createReader
- [IMPALA-9251] - HdfsOrcScanner crash in AssembleRows
- [IMPALA-9257] - Events processor last synced event does not advance if all the events are filtered out
- [IMPALA-9262] - Blacklist test test_kill_impalad_with_running_queries fails in exhaustive mode
- [IMPALA-9265] - Add support for toolchain Kudu to provide maven artifacts
- [IMPALA-9266] - TestLogFragments.test_log_fragments fails due to missing log
- [IMPALA-9267] - Impala hits DCHECK in ClientRequestState due to invalid state transition
- [IMPALA-9272] - PlannerTest.testHdfs fails due to dependence on result of year(now())
- [IMPALA-9277] - Crash due to unhandled exception thrown from orc::ColumnSelector::updateSelectedByTypeId
- [IMPALA-9279] - Update the Kudu version to include VARCHAR support (and other functionality)
- [IMPALA-9280] - Time string with signed TZH token preceded by dash cannot be cast to timestamp
- [IMPALA-9288] - Crash due to memory leak in scan node of orc scanner
- [IMPALA-9289] - TestConcurrentKuduCreate is flaky
- [IMPALA-9291] - MemTracker's TryConsume() should behave consistent with Consume()/Release()
- [IMPALA-9295] - RPC failures don't always trigger a blacklist
- [IMPALA-9296] - Move FragmentInstanceExecStatus' AuxErrorInfo to StatefulStatus
- [IMPALA-9297] - HdfsOrcScanner crash in orc::RleDecoderV2::next
- [IMPALA-9306] - HdfsOrcScanner crashes in orc::readFully
- [IMPALA-9309] - Crash in failure/test_failpoints.py with PREPARE:FAIL debug option
- [IMPALA-9312] - run_clang_tidy.sh hides errors in buildall.sh
- [IMPALA-9324] - HdfsOrcScanner crashes in DCHECK failure in OrcSchemaResolver::BuildSchemaPath
- [IMPALA-9329] - Table masking view should not have nested columns in select list
- [IMPALA-9335] - Rebase KRPC
- [IMPALA-9340] - statestore_max_missed_heartbeats is off by one
- [IMPALA-9345] - Hang in TestOrc::test_type_conversions when running create table in hive
- [IMPALA-9346] - TestImpalaShell.test_config_file failing on CentOS6/Python 2.6
- [IMPALA-9349] - output_unmatched_batch_ holds onto buffers for too long
- [IMPALA-9351] - AnalyzeDDLTest.TestCreateTableLikeFileOrc failed due to non-existing path
- [IMPALA-9357] - Fix race condition in alter_database event
- [IMPALA-9358] - Query slowdown with inline views and hundreds of columns
- [IMPALA-9372] - PartialCatalogInfoTest.testGetSqlConstraints fails in comparison of PK table name
- [IMPALA-9383] - HS2 HTTP server hangs on large chunked requests
- [IMPALA-9385] - Orc scanner does UTC->local conversion if use_local_tz_for_unix_timestamp_conversions=1
- [IMPALA-9386] - IMPALA-9287 breaks catalog table loading
- [IMPALA-9390] - Maven download location change breaks all Impala builds
- [IMPALA-9395] - RuntimeFilter causes impalad crash
- [IMPALA-9402] - bootstrap_system.sh fails to configure PostgreSQL 9 on some CentOS 7 systems
- [IMPALA-9423] - Fix cookie auth with Knox
- [IMPALA-9425] - Statestore may fail to report when an impalad has failed
- [IMPALA-9429] - Unioned partition columns break partition pruning
- [IMPALA-9444] - Invalid URL to get postgresql from central.maven.org
- [IMPALA-9445] - custom_cluster/test_local_tz_conversion.py fails on S3 configuration
- [IMPALA-9447] - TupleRowCompareTest.DecimalTest crashes on release build
- [IMPALA-9449] - Crash in LZO scan with fuzz test
- [IMPALA-9452] - test_spilling_aggs fails with missing SpilledPartitions
- [IMPALA-9492] - TestRecoverPartitions::test_unescaped_string_partition failing on S3
- [IMPALA-9513] - query_test.test_kudu.TestKuduOperations.test_column_storage_attributes fails on exhaustive tests
- [IMPALA-9529] - Bound predicates optimization doesn't work for InlineView
- [IMPALA-9555] - TestDateQueries.test_queries failing because Hive3 switched back to the hybrid Julian Gregorian calendar
- [IMPALA-9560] - Changing version from 3.4.0-SNAPSHOT to 3.4.0-RELEASE breaks TestStatsExtrapolation
- [IMPALA-9571] - Impala fails to start up due to exception from boost::filesystem::remove_all()
- [IMPALA-9582] - Update thift_sasl 0.4.1 --> 0.4.2 for impala-shell
Task
- [IMPALA-7984] - Port UpdateFilter() and PublishFilter() to KRPC
- [IMPALA-8768] - Clarifying the conditions in which audit logs record a query
- [IMPALA-8879] - Upgrade bootstrap.js
- [IMPALA-9014] - Impala Doc: Update the logging doc
- [IMPALA-9029] - Impala Doc: 3.4 Release Notes
- [IMPALA-9048] - Impala Doc: Document the global INVALIDATE METADATA on fetch-on-demand impalad
- [IMPALA-9196] - Dump jstack and backup logs when Jenkins job timeouts
- [IMPALA-9293] - Impala Doc: Revise explanation of HDFS trashcan usage on S3
- [IMPALA-9304] - Add script to launch Hive with Ranger in minicluster
Sub-task
- [IMPALA-1618] - Impala server should always try to fulfill requested fetch size
- [IMPALA-5802] - COMPUTE STATS uses MT_DOP=4 by default
- [IMPALA-6894] - Use an internal representation of query states in ClientRequestState
- [IMPALA-7312] - Non-blocking mode for Fetch() RPC
- [IMPALA-7351] - Add memory estimates for plan nodes and sinks with missing estimates
- [IMPALA-7506] - Support global INVALIDATE METADATA on fetch-on-demand impalad
- [IMPALA-8198] - Add DATE type support to Avro scanner
- [IMPALA-8290] - Display constraint information in 'SHOW CREATE' statement
- [IMPALA-8572] - Move query hook execution to before query unregistration
- [IMPALA-8587] - Show inherited privileges in show grant w/ Ranger
- [IMPALA-8607] - Update documentation to reflect IMPALA-6042
- [IMPALA-8703] - SQL:2016 datetime patterns - Milestone 1
- [IMPALA-8704] - SQL:2016 datetime patterns - Milestone 2
- [IMPALA-8705] - SQL:2016 datetime patterns - Milestone 3
- [IMPALA-8706] - SQL:2016 datetime patterns - Milestone 4
- [IMPALA-8712] - Convert ExecQueryFInstance() RPC to become asynchronous
- [IMPALA-8801] - Add DATE type support to ORC scanner
- [IMPALA-8803] - Coordinator should release admitted memory per-backend rather than per-query
- [IMPALA-8818] - Replace deque queue with spillable queue in BufferedPlanRootSink
- [IMPALA-8819] - BufferedPlanRootSink should handle non-default fetch sizes
- [IMPALA-8825] - Add additional counters to PlanRootSink
- [IMPALA-8826] - Impala Doc: Add docs for PLAN_ROOT_SINK and result spooling
- [IMPALA-8845] - Close ExecNode tree prior to calling FlushFinal in FragmentInstanceState
- [IMPALA-8861] - Impala Doc: Document Jaro-winkler edit distance and similarity built-in functions
- [IMPALA-8878] - Impala Doc: Query Profile Exported to JSON
- [IMPALA-8890] - DCHECK(!page->attached_to_output_batch) in SpillableRowBatchQueue::AddBatch
- [IMPALA-8893] - Impala Doc: Document cookie-based authentication
- [IMPALA-8903] - Impala Doc: TRUNCATE for Insert-only ACID tables
- [IMPALA-8920] - Impala Doc: Document the query option for disabling HBase row estimation
- [IMPALA-8924] - DCHECK(!closed_) in SpillableRowBatchQueue::IsEmpty
- [IMPALA-8930] - Impala Doc: Document object ownership with Ranger authorization provider
- [IMPALA-8934] - Add failpoint tests to result spooling code
- [IMPALA-8970] - Impala Doc: Document Prometheus integration
- [IMPALA-8971] - Impala Doc: Document the PARQUET_OBJECT_STORE_SPLIT_SIZE query option
- [IMPALA-8988] - Impala Doc: Document that DATE type supports Avro
- [IMPALA-8997] - Allow graceful fallback to mt_dop=0
- [IMPALA-8998] - Admission control accounting for mt_dop
- [IMPALA-8999] - Parallelise all plans, including UNION, when mt_dop > 1
- [IMPALA-9003] - Document IMPALA-8376 Add per-directory limits for scratch disk usage
- [IMPALA-9015] - Use better algorithm for allocating scan ranges to finstances within a daemon in schedule
- [IMPALA-9019] - Fix runtime filter bugs with mt_dop
- [IMPALA-9027] - Update planner decisions to factor in mt_dop
- [IMPALA-9065] - Fix cancellation of RuntimeFilter::WaitForArrival()
- [IMPALA-9081] - testMtDopValidationWithHDFSNumRowsEstDisabled toggles isTestEnv() changing table loading behaviour
- [IMPALA-9104] - Add support for retrieval of primary keys and foreign keys in impala-hs2-server.
- [IMPALA-9125] - Add general mechanism to find DataSink from other fragments
- [IMPALA-9134] - Parallelise flush in data stream sender
- [IMPALA-9137] - Blacklist node if a DataStreamService RPC to the node fails
- [IMPALA-9141] - Impala Doc: Document SQL:2016 datetime patterns - Milestone 2
- [IMPALA-9158] - Support loading PK/FK constraints in LocalCatalog.
- [IMPALA-9207] - Impala Doc: Document adding #Inst in exec summary
- [IMPALA-9219] - Impala Doc: Document SQL:2016 datetime patterns - Milestone 3
- [IMPALA-9243] - Coordinator Web UI should list which executors have been blacklisted
- [IMPALA-9256] - Refactor constraint information into a separate class.
- [IMPALA-9274] - Implement phased barrier synchronisation construct
- [IMPALA-9308] - TSAN data race in ReservationTracker::used_reservation_ updates
- [IMPALA-9313] - TSAN data race in TmpFileMgr::File::Blacklist
- [IMPALA-9334] - Log node blacklisting removals in ClusterMembershipMgr
- [IMPALA-9336] - Impala doc: Document the create table syntax for Primary Key and Foreign Keys spec.
- [IMPALA-9342] - Membership updates should only remove quiescing nodes from the blacklist
- [IMPALA-9361] - Support running kerberized minicluster against manually configured KDC
- [IMPALA-9381] - Lazily convert and/or cache different representations of the query profile
- [IMPALA-9392] - Replace Boost-1.57.0-p3 to Boost-1.61.0.-p2 for aarch64 supporting
- [IMPALA-9396] - Add arm64 openjdk version for Ubuntu 18.04 in bootstrap_system.sh
- [IMPALA-9399] - Optimise RuntimeProfile::ToThrift()
Test
- [IMPALA-8944] - Update and re-enable S3PlannerTest
- [IMPALA-8950] - Add -d and -f option to copyFromLocal and re-enable disabled S3 tests
- [IMPALA-9117] - test_lineage.py and test_mt_dop.py are failing on ABFS
- [IMPALA-9311] - test_show_create_table failed with primary key mismatch
- [IMPALA-9321] - TestParquetMaxPageHeader.test_large_page_header_config failed with error "Invalid configuration of tez jars"
- [IMPALA-9322] - authorization.test_grant_revoke.TestGrantRevoke.test_grant_revoke failed with "Unable to start Sentry"