presto Release notes for 0.179-t

Generated by git log 0.179..release-0.179-t --no-decorate --format="- [ ] %an (committed by %cn) %H %s" | sort + manually dividing up the sections

Akshat Nair

[x] Akshat Nair (committed by Akshat Nair) 00fe4850c6361c6c32958d8cafe9766b43fb112e Add unit tests for DetermineSemiJoinDistributionType
[x] Akshat Nair (committed by Akshat Nair) 9a7dfaf8a3c6b83ba2b4404bb8fdda91df627eaf Get the correct distribution type for ROJ and LOJ
[x] Akshat Nair (committed by Akshat Nair) a25882a8f1a3ee294814da90a936406a38f3e1b8 Remove costing for DetermineSemiJoinDistributionType
[x] Akshat Nair (committed by Akshat Nair) d4698f38c62574e43d590d1f6bb0e8a66dfe7908 Add options information in the CLI documentation
[x] Akshat Nair (committed by Akshat Nair) ddf2a39217a1c83cdcc60bbc4b9fba099776eecc Fix PlanPrinter formatting
[x] Akshat Nair (committed by Akshat Nair) e103b6e1f6a7fd9a032870e1315eac830f6a9c41 Update doc for Cost in Explain
[x] Akshat Nair (committed by Akshat Nair) fd40256a5e79bc7e1fd1572a21d9285417c2c39f Migrate DeteremineJoinType to Iterative optimizer
[x] Akshat Nair (committed by Rebecca Schlussel) 36b54a87431f42309aa35b7145bfe1ccf021d60b Document current rule based optimizer
[x] Nezih Yigitbasi (committed by Akshat Nair) b75ed522257631f3a41fa129e80fecc7088fd14b Fix formatting in EXPLAIN ANALYZE output

Alan Post

[x] Alan Post (committed by Alan Post) 33158e66d9e1e9ff5aeca556d2a3642b3d4ad603 Merge branch 'support_ldap_authentication_between_nodes_rebase_59' into sprint-59
[x] Alan Post (committed by Alan Post) 7d173f8137a319a79be934191d48f7429be27a85 Don't ask Hive for statistics for hidden columns
[x] Alan Post (committed by Alan Post) d99ae363b1f2fddd4924b6f2024ddff764ac7e02 Fix InlineProjections on subqueries

Amruta Gokhale

[x] Amruta Gokhale (committed by Amruta Gokhale) 3f8070f00a107e2659aec73e83a7a12f3e9fd32c Add tests for selectivity estimates for parts of TPC-H queries
[x] Amruta Gokhale (committed by Amruta Gokhale) 5a1804ad2d44fd230c4b7a80427b7b1c33ed51b1 Quarantine test selectFromPartitionedNation on EMR
[x] Amruta Gokhale (committed by Amruta Gokhale) 9988a194b49364e66ddec9341c43349eb59bed6f Revert "Quarantine failing product-test"
[x] Amruta Gokhale (committed by Amruta Gokhale) b21b650b8257fa3a2de371033ee86523af4be690 Modify tests to account for an additional ExchangeNode in the plan
[x] Amruta Gokhale (committed by Amruta Gokhale) bb3e5e01c94c88db416695a976d70aaa2412034b Add a configuration option to disable creating non-managed Hive table
[x] Amruta Gokhale (committed by Amruta Gokhale) ca06cb1dfb19f4e29b5e3c640d3fd2040a1edd43 Document note about authorization without authentication
[x] Amruta Gokhale (committed by Amruta Gokhale) d2a8eb9d0c4ce274e0f791ade62a07a8f259f86a Minor cleanup in event listener tests
[x] Amruta Gokhale (committed by Christina Wallin) 703634cb236e68b66c9b7b8504005d42887e8722 Wait longer for schema agreement in Cassandra tests
[x] Amruta Gokhale (committed by Christina Wallin) 74e5f8f8c57be8450ece9dc4b9f3414ce2915782 Retry when retrieving metadata in Cassandra tests

Andrii Rosa

[ ] Andrii Rosa (committed by Alan Post) 5d0af1f1fcf6ac7f1a0197e5246ef2254086c3f3 Non interactive presto-cli password
[ ] Andrii Rosa (committed by Alan Post) a60f3ae2e36f5a0976f90ad69470173ccbd2ad01 Secured internal communication with LDAP product tests
[ ] Andrii Rosa (committed by Alan Post) ac1ab24cb2314e7764d54d18d2cf140b3577edfe Document LDAP secured internal communication
[ ] Andrii Rosa (committed by Alan Post) ef94661f740bf81dc58e242c39e8c32fc8e82ed1 Implement LDAP authentication for internal communication
[ ] Andrii Rosa (committed by Amruta Gokhale) 0194f7fdbc6770defc08a2dd362fbb7af874a2e1 Simplify checkTablePermission
[ ] Andrii Rosa (committed by Amruta Gokhale) 0ed59fdba77b796caa7f82f4c57c8bba6a23ea86 Move parsePrivilege to MetastoreUtil
[ ] Andrii Rosa (committed by Amruta Gokhale) 134a0173121a3ad90e72acc604b2dcc8bfb90920 Introduce APPLICABLE_ROLES view
[ ] Andrii Rosa (committed by Amruta Gokhale) 17570c6758a9ce16824508265eae40cb04c371ba Remove redundant checkDatabasePermission methods
[ ] Andrii Rosa (committed by Amruta Gokhale) 1a2f9c2ad3180590024273b679108217fce0b0df Refactor HivePrivilegeInfo
[ ] Andrii Rosa (committed by Amruta Gokhale) 1ed43c895fba90524819f4e42927c15bc0861ac1 Introduce CREATE ROLE and DROP ROLE statements
[ ] Andrii Rosa (committed by Amruta Gokhale) 266b2c5b7c2dd1d0062fd635d9e78a1a4bca246c Speedup TestHiveFileBasedSecurity
[ ] Andrii Rosa (committed by Amruta Gokhale) 3094513e7f04550b9e3a5f2efecd368553422cdf Reorder methods in HivePrivilegeInfo
[ ] Andrii Rosa (committed by Amruta Gokhale) 345352cadd131b8972f94c1dd79f55d5cce35c54 Store catalog selected roles in Identity
[ ] Andrii Rosa (committed by Amruta Gokhale) 35da07efcada47feb51b7ea1ff743bf78d5993c3 Introduce ConnectorIdentity
[ ] Andrii Rosa (committed by Amruta Gokhale) 4737448a2351831218f71b3a69d88e7fcd76e08c Implement SET ROLE in Hive Connector
[ ] Andrii Rosa (committed by Amruta Gokhale) 473ba041e883965a45b8efde77706dab22b684c4 Expose Create/Drop/List roles methods in SPI
[ ] Andrii Rosa (committed by Amruta Gokhale) 4e10da7d70c78b8b30a20fe936458cdda2e663cf Remove unused InMemoryHiveMetastore
[ ] Andrii Rosa (committed by Amruta Gokhale) 4ffea19a646f2650790b1ed76b0b7e7992fe668e Rename getGrantOptionForPrivilege to hasGrantOptionForPrivilege
[ ] Andrii Rosa (committed by Amruta Gokhale) 5a91f22588d8dd3b0d66172e163bee4db108ceb5 Catalog access control for roles
[ ] Andrii Rosa (committed by Amruta Gokhale) 60454eb3dc7a0bdad5e1b8d58ec33bd321b87628 Prepare metastore interface to accept ROLE for GRANT/REVOKE
[ ] Andrii Rosa (committed by Amruta Gokhale) 6206ecb68c49659498aba81180002ff3613a9dc1 More product tests for SET ROLE
[ ] Andrii Rosa (committed by Amruta Gokhale) 6ab9036061ad003d8d3c6efd2dd829abcae8b143 Add grantor to HivePrivilegeInfo
[ ] Andrii Rosa (committed by Amruta Gokhale) 7fca5723e85c68df66b70f356eae5075bd7627a0 Implement SET ROLE
[ ] Andrii Rosa (committed by Amruta Gokhale) 807b8e1a42fc5a6c775aae9687c13ea87d3bb278 Reorder methods in SqlStandardAccessControl
[ ] Andrii Rosa (committed by Amruta Gokhale) 808d5d6b1d80e5ec8c623ab53a9fda56cd5c52ee Consider enabled roles for permissions
[ ] Andrii Rosa (committed by Amruta Gokhale) 80bd7b28b593e2b4123499e17a194da68e44d220 Implement Grant/Revoke/ListApplicableRoles in Hive
[ ] Andrii Rosa (committed by Amruta Gokhale) 819df9592153808721620402e9cd74a2611bf3d7 Introduce .information_schema.roles table
[ ] Andrii Rosa (committed by Amruta Gokhale) 8433700362a47aa1eaf117f8b38d53c7b382e5ac Introduce SET ROLE statement
[ ] Andrii Rosa (committed by Amruta Gokhale) 89091e15138ed4969b5017c24e87dad4c26ef1a4 Add grantor_type and grantee_type columns to table_privileges
[ ] Andrii Rosa (committed by Amruta Gokhale) 9c0b61eac0d27528282223e9613be31474866364 Allow all for admin role
[ ] Andrii Rosa (committed by Amruta Gokhale) a561d989676e803c73cadf23da5e9473263aa9a2 Refactor GRANT/REVOKE in Hive
[ ] Andrii Rosa (committed by Amruta Gokhale) afb23c3bded6e36da1b9281e55f4526050ada927 Introduce ENABLED_ROLES view
[ ] Andrii Rosa (committed by Amruta Gokhale) bbde32c6a36608672c93c201bdbc0a71b6492375 Introduce GRANT/REVOKE roles statements
[x] Andrii Rosa (committed by Amruta Gokhale) c55547195b349a710e6e8714fc69b22a4f851625 Assign admin role to subset of users in FileHiveMetastore
[x] Andrii Rosa (committed by Amruta Gokhale) c77e9b998dd31b26108ada0550c247aa947bea1e Force an exchange to avoid potential coordinator overload
[x] Andrii Rosa (committed by Amruta Gokhale) d2fc4b3b86fc9467882bd8ffa30c55ea5fef6079 Accept ROLE in GRANT/REVOKE Privileges statements
[x] Andrii Rosa (committed by Amruta Gokhale) d69272cae61594b112766afb7785f07de85bc3b5 Remove hive privilege null check
[x] Andrii Rosa (committed by Amruta Gokhale) dc1ff6dd37e8b0ca660675e58a26fa3b5fc68a6c Introduce access control for GRANT/REVOKE ROLE
[x] Andrii Rosa (committed by Amruta Gokhale) dd38d52ddb92050f9e7db9d8fd11e94c9cff6c2f Implement Create/Drop/List roles in Hive connector
[x] Andrii Rosa (committed by Amruta Gokhale) e48b56b0cdcd606440dd0430d760f404a3edc15b Add Grant/Revoke/List roles authorization to the SPI
[x] Andrii Rosa (committed by Amruta Gokhale) e8c03f8c0da274517fea48f879c030927fa4cb56 Introduce isTableOwner method for readability
[x] Andrii Rosa (committed by Amruta Gokhale) f2376a89b103253c5bf35730b447c62c5a0ed199 Move PrincipalType to presto-spi
[x] Andrii Rosa (committed by Amruta Gokhale) fea21e6c07af175f00353938701f14000f6a03a0 Refactor canCreateView security checks
[x] Andrii Rosa (committed by Andrii Rosa) 9d83483d8982a3b7170d43275764d91d3c96b84f Consider local exchange in cost calculators
[x] Andrii Rosa (committed by Anton Petrov) 854c7b04fafb843151097cf5818f8699db5b42e0 Clear interrupt flag after exiting from pager
[x] Andrii Rosa (committed by Christina Wallin) 2e20eaa30333bff75fe3d877274861385272983c Add property that allows to disable sort redistribution
[x] Andrii Rosa (committed by Christina Wallin) 30accd04075599f35a938ad9407c96954ec8d90b Use binary heap in MergeSort algorithm
[x] Andrii Rosa (committed by Christina Wallin) 5ba204570df1a4cba82d85961b4c055d4530724b Compile merge sort comparator
[x] Andrii Rosa (committed by Christina Wallin) 704a971ee9b8b839df8d9308866110f04d2c9527 Add product test that verifies HTTP port is closed on multinode-tls
[x] Andrii Rosa (committed by Christina Wallin) 878d923a4621895473e3d3051f40a8e543dab91b Implement MergeSortProcessor
[x] Andrii Rosa (committed by Christina Wallin) 89cf4becba24a41c6fecad79d2b87aa0a95b73c2 Add product tests suite for secured internal communication
[x] Andrii Rosa (committed by Christina Wallin) 8a2dd966c22344cdf4c8c5b90869d9b4ed9c3de9 Support secure internal communication
[x] Andrii Rosa (committed by Christina Wallin) 93f413e059c7067b089bbb939a54c58e60b64f98 Process pending reads upon noMorePages event
[x] Andrii Rosa (committed by Christina Wallin) 9592366d183f267217cedac5129701799fe200b9 AbstractTestQueries for Distributed sort
[x] Andrii Rosa (committed by Christina Wallin) b6bdaaf43e5948cca93085152d3e813e3c221ffb Temporary workaround for providing keystore for Presto JDBC
[x] Andrii Rosa (committed by Christina Wallin) c6e02a25b52640a711a269dab8351d26c6c83420 Implement local merge sort
[x] Andrii Rosa (committed by Christina Wallin) d233e844805d74142167971ad8ed33e2c9bb393c Implement MergeOperator
[x] Andrii Rosa (committed by Christina Wallin) f4da5559f6d3336aed628caa8cfea0d4b558d7ad Document encryption performance impact
[x] Andrii Rosa (committed by Christina Wallin) fbae5b753986827335a8e74db136da1bd32aaa98 Separate product tests into 2 builds on travis
[x] Andrii Rosa (committed by Maciej Grzybek) 5d95cb7a520896dd6d076d7cfd220ca0d477d440 Pass list of projection columns to SplitManager
[x] Andrii Rosa (committed by Maciej Grzybek) 761e66636adb0d8ea801f7bc570dbe0d8d98a738 Pass list of projection columns to ConnectorSplitManager
[x] Andrii Rosa (committed by Maciej Grzybek) 77f0e3cd1358463e55e2e776849f0b4b0b3b1696 Fix failing tests in presto-main
[x] Andrii Rosa (committed by Maciej Grzybek) 99ed9dbc7678969f1b6f4a4d69b2cf54d488382e Print window node specific statistics in explain analyze
[x] Andrii Rosa (committed by Maciej Grzybek) 9ab3ecb8c357a12886ec5fdf376afaf8e2e707ab Log tests executed by AbstractTestQueryFramework
[x] Andrii Rosa (committed by Maciej Grzybek) b0243e23a577d463660c56cbc2e81735b8ada46e Treat fixed pointer literals as DECIMAL
[x] Andrii Rosa (committed by Maciej Grzybek) d1bcac18516e8dfb521ed45667b39a467dd5b5ca Add decimal as default literal unit tests
[x] Andrii Rosa (committed by Maciej Grzybek) f5ac832b0017bb9ede7ec5970b5a15fff61acd56 Add "parse decimal literal as double" legacy switch
[x] Andrii Rosa (committed by anusudarsan) 8a462b505bf2c85637ed13ca8c3f43a8d6a7a79f Support _HOST placeholder in Kerberos internal communication

Andrzej Fiedukowicz

[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 03075420897694bb69d8452b868385cd55edb060 Add stats calculation for FilterNode logical operations
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 03a0ffc1e6779e656df89d399e5f86dcb30c02c1 Split ErrorMessages into regions
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 06b53abe7dcbf33646a91de2dafb21d49f469789 Add FilterStatsCalculator
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 0d5d1e25e194f562493f1505bf9ff5cb46cf95a0 Add new TIME/TIMESTAMP parsing/printing to DateTimeUtils
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 0f08d1a56dff5705f0e56027580956dcf14ed2e4 Add config and session property deprecated.legacy-timestamp
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 111ebec129138733df5b22f4ad09f6b2a0961f6e Add default error message for Exceptions on CLI side
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 14a297551f76adb092cce405605d720f67064c47 Introduce CLI custom message for Server starting up/shutting down error
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 163bbb7193399ead0709c054ed6bb86837d9e619 Fix current_time, localtime & localtimestamp semantics
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 16b744d8e09b8c489b29696c482042183e8945fc Introduce CLI custom message for server not found error
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 2e506e20b16cb6f2c3e39ce9e947e9053ffa5748 Add tests covering Time types representation
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 393879761cf0aeef0be8b7bbde858811c411c927 Fix at_timezone(TIME WITH TIME ZONE)
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 3e338143e57784431f22b7a9bb9f443b6eb0f622 Empty commit for triggering build
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 403cb5213fb63124d408097a66b3988e3b6e9985 Split TestDateTimeFunctions into variants based on isLegacyTimestamp
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 4100946b64e3ed11a33e50cf09561d28d91175fd Introduce new TIMESTAMP semantics to to_iso8601 scalar
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 4a39f120ed89b3c61431f0d3a07d4b062e8079bc fixup! Migrate MetadataQueryOptimizer to iterative optimizer
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 4dab1220b663c82bd478c3d6b786bcc2ca446b46 Add isLegacyTimestamp flag to ConnectorSession
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 524f456c2017cfe544be0897a902c328688fb070 Add new date time semantics to date time cast operators
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 544d0681d13d71fd18e3795029474d47d5c82df4 Fix references in docs
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 594d8b5cbe0edf9e0b35d429eeb6ccbf20ed1c1a Use new stats calculator by default
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 5e87fe52f560f1f156f04ccdfb913169d4844aad Make travis upload PR artifacts to different directory
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 5f32ddee043c4445c53a8d851561a0c404281615 Introduce CLI custom message for 404 http status error
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 5fc709de352e6c9498562a6c21c8807fc8ec7394 Change default TIME/TIMESTAMP semantics to ANSI SQL
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 65a45ad57f5859ebb6515f108e0d87eedaf02350 Fix current_time timezone offset
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 6989a50e2c60ce1d330f0876d0ba35f94bb1a89e Introduce new TIME/TIMESTAMP semantics SPI types
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 6b607993d604493638e829df81eaac064cc6ff45 Split TestDateTimeOperators into variants based on isLegacyTimestamp
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 86a0a1c7bc84c15f23fee52f6209f52ae6d73717 Add CLI --quiet option allowing to remove tips from error messages
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 88b21d3545243c177051d0b83e979580170b7fef Quarantine failing product-test
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 8de1b630bf107668230bc7fcc72e1ee32ffdbf35 Always use fixed TIME as session base in TestDateTimeFunctions
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 9b30960407371b6d65a47ccb3a0b2d761f807083 Add stats calculation for FilterNode comparison related operators
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 9be41be495181c211aa6ea4c87f0a302c1d7731b Add rule for computing stats for FilterNode
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) 9f54334546504e3d08e8b543df1ffef80a157a29 Introduce new TIME/TIMESTAMP semantics to scalar functions
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) ad14ce32ee1a5c93381f0922bf4627d8ee94447b Add stats calculation for FilterNode boolean expressions
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) ad97b55ed5c0a86bcfb44dec7aa53a1a4e4af400 fixup! Add UnionStatsRule
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) ae13afc5f70cc71f9f0bacafb692aef8a90a9d08 Add stats calculation for FilterNode comparisons
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) b12c275f4c4dc122ef84293b97c3a5d5bb775409 Add new TIME/TIMESTAMP semantic variant to Expression parsing
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) bdec2225225b8c1fd832d98ff022bd2cc7322d85 Add more detailed description of Hive connector properties
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) c6b8bc7bb3d47ec9c0e7ec7b5e6a0597f48a8ba3 Add query properties description
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) cca9c71017af53d8784949b4aa0d940e88fed6c8 Add basic comments to ErrorMessages class
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) cfdb6a2dda7d14572bca42a4e89c7048058d2271 Add session properties description
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) d009bcfce258942ad10237f907aec3d406cfcd28 Add stats calculation for FilterNode is (not) null expression
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) d726bbc8b1f53a9683f64f64f5f130c12fa1b09e Extract ErrorMessages class for CLI readable user messages creation
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) d90a281240e9b2734f56dfdc74afb0bf69c2c3b2 Introduce new TIME/TIMESTAMP semantics to SQL types
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) e9aeaae7ad08eba9917130442584be4adac6b08c Make product-tests quiet about CLI errors
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) fb527f908d224ee86f6ac5942d0506d6ae61d493 Unify --debug output for all errors in CLI
[x] Andrzej Fiedukowicz (committed by Andrzej Fiedukowicz) fd3f2082d0462f5e8f71f3fca9ab79e5ec0cb39d Introduce DomainConverted

Anton Petrov

[x] Anton Petrov (committed by Anton Petrov) 759fe32a65b96c8f084f55af7a31fc600caed8ad Add documentation for the TPC-DS connector
[x] Anton Petrov (committed by Anton Petrov) aae372c2e5273c81754fd4056a71661a13dbbe75 Unquarantine TPC-DS q27, q36, q70 and q86
[x] Anton Petrov (committed by Anton Petrov) b2cedb0493d475bf14814a27aa294c001d401c7c fixup! update version
[x] Anton Petrov (committed by Anton Petrov) bc0c6c8233b5cf1db757014abd7b9fe0aa445b71 Remove stale comments on TPC-DS q27, q36, q70, q86
[x] Anton Petrov (committed by Anton Petrov) c57d247c641fae3742a4fa01f1bf904f79d62173 Add the metadata portion of the TPC-DS connector
[x] Anton Petrov (committed by Anton Petrov) d5d266bc812cce79a0782d3affac3f575a944ad3 Minor re-writes to TPC-DS q36, q70 and q86
[x] James Sun (committed by Anton Petrov) 36c6bdc54f6395545f45cd10f125c4bbfe314627 Fix native memory leak in RCFile writer
[x] Min(Dongmin Yu) (committed by Anton Petrov) 77ade869d355904930c7b8296c2a9505dfa15804 Add missing JsonCreator annotation
[x] Nezih Yigitbasi (committed by Anton Petrov) de048526d2c8f8df35965edf65f19cf4e7f86ef7 Remove unused fields

Anu Sudarsan

[x] Anu Sudarsan (committed by anusudarsan) 0466ebe1d10e33a0f05397588c66ed9ade8dabb4 Add profile for testing Kerberos secured internal communication
[x] Anu Sudarsan (committed by anusudarsan) 04e4c33b4520455eafdf21d0a4fca91d9012a846 Document Kerberos secured internal communication
[x] Anu Sudarsan (committed by anusudarsan) 0d79db3acb86fdf8def37022d790396e50391e9a Add tests infrastructure for Kerberos secured internal communication
[x] Anu Sudarsan (committed by anusudarsan) e5b55bfb5a18a7cb890a28c70a59cfba8f9849c1 Support for Kerberos secured internal communication
[x] Anu Sudarsan (committed by Łukasz Osipiuk) 45a359e172c34073a13c91e7a5a12fc4ffbc6b94 Add product-tests for bucketed hive tables
[x] anusudarsan (committed by Brian Rickman) 17cc4eea71d85bea8803e00b1a5b30790b773cb0 Fix the http client used in tests to use kerberos credentials
[x] anusudarsan (committed by anusudarsan) 0a9a809208feb3e1d719cff03ab6e38e88a73e6d Migrate OptimizeMixedDistinctAggregations to iterative optimizer
[x] anusudarsan (committed by anusudarsan) 2d9eb8426761078661150240bbcee11643dcaf0a fixup! Check violation
[x] anusudarsan (committed by anusudarsan) 7929b911e688e10ce9eae1e3c09aef452d39ca54 Migrate MetadataQueryOptimizer to iterative optimizer
[x] anusudarsan (committed by anusudarsan) ac4e24b08755cdefd18ad9295354448bfc5feb01 Fix incorrect results bug in legacy MetadataQueryOptimizer

Artur Gajowy

[x] Artur Gajowy (committed by Andrzej Fiedukowicz) 028d7f4ec7323b175f462199050a210aa1e4b7aa Add Optionals.{checkPresent,withBoth,combine} util methods
[x] Artur Gajowy (committed by Andrzej Fiedukowicz) 126b7673cd9fd7c98cd33b523dbd1adcff4d5cf9 Support column stats in TPCH connector
[x] Artur Gajowy (committed by Andrzej Fiedukowicz) 5d33a99270d320a5414165af552cfd7cb0a5e0f3 Change argument type in TpchMetadata.getPrestoType to TpchColumn
[x] Artur Gajowy (committed by Andrzej Fiedukowicz) 875256303421d9d934691f02aa791c13b4aa9aa2 Add Types.{checkType,checkSameTypes,tryCast} util methods
[x] Artur Gajowy (committed by Andrzej Fiedukowicz) b96752fbcf46dee74ba08470ccd15baa918668db Add RecordTpchTableStatsTool for recording stats summaries in .json
[x] Artur Gajowy (committed by Andrzej Fiedukowicz) c10c3292a5aaad67bb3afc2b7790ba2dd66349ad Add EstimateAssertion
[x] Artur Gajowy (committed by Andrzej Fiedukowicz) cec3dd718986dab6dbad74e3931908b2c571655c Add Constraint.alwaysFalse() method
[x] Artur Gajowy (committed by Andrzej Fiedukowicz) cfde85ac048e469aa342508a7499d1be573ac595 Add TestTpchMetadata
[x] Artur Gajowy (committed by Andrzej Fiedukowicz) dc65d1664bdc5dcbac6a8ddf832d3f9b6cfcbf21 Add statistics recordings for tpch.{tiny,sf1}
[x] Artur Gajowy (committed by Artur Gajowy) 254bd6e0d9e1323e59af96966e48376651f60773 fixup! Remove explicit data_size from PlanNodeStatsEstimate
[x] Artur Gajowy (committed by Artur Gajowy) 27a904f3adc8f98477fa290604551a49f26d1de3 Make unknown costs the default in PlanNodeCostEstimate.Builder
[x] Artur Gajowy (committed by Artur Gajowy) 325a51c9a28dea7d7472c6dd2827f0a6e9e3e5af Mention spill for join in release notes
[x] Artur Gajowy (committed by Artur Gajowy) 42cb285edd5231641c29f71ac81fa4725d3ea0f3 Add 0.179-t release notes placeholder
[x] Artur Gajowy (committed by Artur Gajowy) 5353ee2bb026a535765d5f2cb50591950d650a40 Mention spill for join in properties documentation
[x] Artur Gajowy (committed by Artur Gajowy) 6d3633ce0358ab4c76e2b88bb36c99c19a64c2ac fixup! Introduce CostCalculator interface
[x] Artur Gajowy (committed by Artur Gajowy) 6e0e66a6d9dbd18a2ea41bd1480e17dd474baaa3 Add TestCostCalculator.CostAssertionBuilder#cpu/network/memoryUnknown()
[x] Artur Gajowy (committed by Artur Gajowy) 70005e692c47d8a435e7fa7a58eb6b96a2b89c2c Quarantine TestReorderJoins tests depending on cost calculation details
[x] Artur Gajowy (committed by Artur Gajowy) 7d27870b550261f721a580f86415ef3e61550357 fixup! Introduce CostComparator
[x] Artur Gajowy (committed by Artur Gajowy) aa646500fb6b5b249b47eb7e2c229d4c5c4c7257 fixup! Introduce CostCalculator interface
[x] Artur Gajowy (committed by Artur Gajowy) ca886de6fc64f1a2c92627e6646fbfde2c9c67b9 fixup! Introduce CostCalculator interface
[x] Artur Gajowy (committed by Artur Gajowy) cf0d36984d30f15b07287bf2846b1d1894587bef Replace the 'experimental' word with 'beta' when referring to spill
[x] Artur Gajowy (committed by Artur Gajowy) dda08fc6596bbb59b53bc66e8a24de4af92a1292 Test that CostCalculator successfully returns unknown costs for no stats
[x] Artur Gajowy (committed by Artur Gajowy) deb7fbd294ff57a097c7acf5053d5fded8c8b301 fixup! Add ReorderJoins rule to pick the best join order
[x] Artur Gajowy (committed by Karol Sobczak) fab27b6d68cfe550166933b37aa472b697005619 fixup! Remove explicit data_size from PlanNodeStatsEstimate
[x] Artur Gajowy (committed by Łukasz Osipiuk) 2af6299a5c44ba58280c5d630543769eb2f6cd32 Add TestDistributedSpilledQueries
[x] Artur Gajowy (committed by Łukasz Osipiuk) 4033e333b7871b69fa477a1147e0e989c8bf814f Add getAllSpilledPages method to SingleStreamSpiller
[x] Artur Gajowy (committed by Łukasz Osipiuk) 8d79e023cb1a14b16b484094998315d36c448692 Introduce PartitionedConsumption
[x] Artur Gajowy (committed by Łukasz Osipiuk) 9e26e9e92e0cb7d01e2b20afc511a554150bc00c Check no write after read in FileSingleStreamSpiller

Brian Rickman

[x] Brian Rickman (committed by Brian Rickman) 0c01a4c4e276753419a54e1be2b82dbede8467d1 Support running tests with alternative JDBC drivers
[x] Brian Rickman (committed by Brian Rickman) 145c4aa34b95f2951312c8bb2c657d2cd860c72a Add tests for GRANT and REVOKE
[x] Brian Rickman (committed by Brian Rickman) 2e34c7967a8c330cef581bf0e8eb81bc670c943b Export ports used by Kerberos services This facilitates testing clients that run on the host machine.
[x] Brian Rickman (committed by Brian Rickman) 34e7a28fc907980a04545fc0619f6f070e8a092e Fix Simba specific JDBC tests
[x] Brian Rickman (committed by Brian Rickman) 3b35b61008ee8e06ee554193c453c22b995055a3 Test PreparedStatement * Test INSERT with all supported data types * Test SELECT * Test PreparedStatement SQL syntax
[x] Brian Rickman (committed by Brian Rickman) 6bce71ea2aacf4e41f9a84d0743aa850c15d53b0 Quarantine testRevokeRoleFromUser until the Presto bug it demonstrates is fixed.
[x] Brian Rickman (committed by Brian Rickman) 8bb3e954c2a4f7cbf048bdad77ae14977202881e Update expected error message for LdapTests.shouldFailForUserWithColon()
[x] Brian Rickman (committed by Brian Rickman) 8c575205d26766bb1ed6e9c0e2332a69870b6fbb Fix TestAllDatatypesFromHiveConnector.testSelectAllDatatypesParquetFile for Simba JDBC
[x] Brian Rickman (committed by Brian Rickman) 8fe652499a060dd8d2e9648841fe0393efa3af20 Expand testRevokeRoleFromUser The test now verifies that prilileges from the role are not available to the user after the role has been revoked.
[x] Brian Rickman (committed by Brian Rickman) 94f671b2f83fe2a514b5ba10d66c4c7d0cd06c67 Fix test failures for Simba JDBC driver
[x] Brian Rickman (committed by Brian Rickman) a70f27f8961b3fbaea4c95b239e5669f9981a477 Refactor with static string CREATE_TABLE_SQL
[x] Brian Rickman (committed by Brian Rickman) bb5d62cfbad300b5cd1666fe85a77022b438e0d1 Package product-test scripts
[x] Brian Rickman (committed by Brian Rickman) bcedef4a9adef110927d126db7d6d299d59691e7 New SSL certificate to replace expired certificate.
[x] Brian Rickman (committed by GitHub) 9cb4e1b26d352c9fedf375c798a2c1237cc808ff Merge pull request #673 from Teradata/docker-cluster-ssl-certificate
[x] Brian Rickman (committed by GitHub) ec38a04fefd841452f2976ac829cd76f798fc347 Merge pull request #672 from Teradata/docker-kerberos-ports
[x] Brian Rickman (committed by Łukasz Osipiuk) 9bd6da6f56c5a39065c64858988518fec4135b69 Fix checkstyle issue

Christina Wallin

[x] Christina Wallin (committed by Alan Post) de2a937c5b0d04e8c475647f981071216f5cfd48 Add a note about LDAP service user for secure communication
[x] Christina Wallin (committed by Amruta Gokhale) 1509ab40c6936644f65c2dc7353cc7bba5a8472a Add SHOW CURRENT ROLES
[x] Christina Wallin (committed by Amruta Gokhale) 19513d09e780ea7b088577010ee1f93ba3ae8591 Implement listRoleGrants() in Hive
[x] Christina Wallin (committed by Amruta Gokhale) 2ab7ae59178a2334391e5d8a6e6dcfb81417d844 Add SHOW ROLE GRANTS syntax
[x] Christina Wallin (committed by Amruta Gokhale) 31ff122881958bedcb44943c175983540cdbcb10 Add access control checks for SHOW ROLES
[x] Christina Wallin (committed by Amruta Gokhale) 5583243daea2b85a545c05bb7a37ef1724c7a365 Product tests for SHOW ROLES
[x] Christina Wallin (committed by Amruta Gokhale) 6ba87d2304847b63f336215ff998858b38c1edb2 Add SHOW ROLES to the parser
[x] Christina Wallin (committed by Amruta Gokhale) 7558fa6b0e96414bd3afabc58f0f08c09ae11fba Add listRoleGrants to the SPI
[x] Christina Wallin (committed by Amruta Gokhale) a5b9ad2a88f4db3291b23017ab4a6d3dc3ccd880 Implement SHOW ROLE GRANTS rewrite
[x] Christina Wallin (committed by Amruta Gokhale) bc501c859c76d6fc17713929c93b63272dc6f7ac Add docs for SHOW ROLES
[x] Christina Wallin (committed by Amruta Gokhale) c24a04cf6b89f7b5ec874b292a0887d3952666cc Add docs for SHOW ROLE GRANTS
[x] Christina Wallin (committed by Amruta Gokhale) cc1a626faa33a6f2333c71f6c711b8a2d2fb596c Access control for SHOW ROLE GRANTS and SHOW CURRENT ROLES
[x] Christina Wallin (committed by Amruta Gokhale) f1f1e9e4a2ee41435f34b98c0652bbda42e1355e Rewrite SHOW ROLES as a select query
[x] Christina Wallin (committed by Christina Wallin) 000c92e01a216ac2c178c8b12a57a1e795be45a6 Add TableLayout to the TableScanMatcher
[x] Christina Wallin (committed by Christina Wallin) 1abe85311d8ca94da13025bc4cdbc4a3f46fbdb9 Remove trailing spaces from CHAR function results
[x] Christina Wallin (committed by Christina Wallin) 1ad4176e5060245eeb549e3647a711e82b7e81ca Pass prepared statements in HTTP request body
[x] Christina Wallin (committed by Christina Wallin) 1fa8b77b4876c203247c463b7129eb30aa2d8251 Update docker images version to 19
[x] Christina Wallin (committed by Christina Wallin) 23aaf0f9fc3cff7fc27fa7567f40f19842b6e977 Unquarantine TPC-DS q85 because SUBSTR(CHAR) now works
[x] Christina Wallin (committed by Christina Wallin) 2f48e861dbd2700c56a134e02ce1af4f21bca1de Extract HttpClientHandler from TestExchangeOperator
[x] Christina Wallin (committed by Christina Wallin) 32f68487d969e8f3e9bab5439aae5e653e906bec Add docs for Kerberos principal access control
[x] Christina Wallin (committed by Christina Wallin) 4329b18cbbc5535988c4ef3b61dafd1dafdc375a fixup! Update MultiJoinNodeBuilder to limit the number of sources
[x] Christina Wallin (committed by Christina Wallin) 58fa0b86fb6978fa3e32b9fcc072165573ca6e59 Migrate PickLayout to the iterative optimizer
[x] Christina Wallin (committed by Christina Wallin) 5b19ec34544a9ba7d54f10d43dd6dd3af7ae3e20 Add ordering to RemoteSourceNode and ExchangeNode
[x] Christina Wallin (committed by Christina Wallin) 89947ad3e9f6f1db16b292d6fd2530ee2b87ad9c Add Kerberos exact match to file access control
[x] Christina Wallin (committed by Christina Wallin) 8e939c36915adf7b8c492f1718c2a631fe59dcef Planner part of Merge
[x] Christina Wallin (committed by Christina Wallin) 9b8fd28e3325f94026e23c96767cd12e5064b9f6 Expose extra information from RuleTester
[x] Christina Wallin (committed by Christina Wallin) aa5222546a18392a5f63eab16228d9c6e21c76ef Extract TableLayout rewrite to a separate class
[x] Christina Wallin (committed by Christina Wallin) b51d6c4196e69c8bdb7c758ebd2ae37b921f4997 Add tests for long prepared statements
[x] Christina Wallin (committed by Christina Wallin) b8de2af9b7c6c8e59cd8fa6e3698e7204070ee68 Update MultiJoinNodeBuilder to limit the number of sources
[x] Christina Wallin (committed by Christina Wallin) c5b09aa58f00655909a652775a5c173e05c65d23 Modify CLI to support long prepared statements
[x] Christina Wallin (committed by Christina Wallin) c65de0bd838b639902f473c47e6e71dcfc71cc04 Support long prepared statements in QueryResults
[x] Christina Wallin (committed by Christina Wallin) d12fc3db7c07f34bdd0c39ca55be3704989e20cb Prepare for next development iteration
[x] Christina Wallin (committed by Christina Wallin) e3e1bc03e93540d4a6a6312d06f9190f8859b1e7 Add TableLayout to PlanBuilder
[x] David Phillips (committed by Christina Wallin) 0d5a05900eeac1b8e549ee3c830d3594c83043ba Use older Travis image
[x] David Phillips (committed by Christina Wallin) 312f0b2f5a364fb2ed5afe72ecca2263d62bc516 Allow configuring JDBC HTTP client per connection
[x] David Phillips (committed by Christina Wallin) 3dd914f110864dfdf6831326ffcf18fff355ec59 Extract base class for LDAP JDBC tests
[x] David Phillips (committed by Christina Wallin) 4096870eb7a0e93af3fec46727696ead6cb0598c Use OkHttp for CLI and JDBC driver
[x] David Phillips (committed by Christina Wallin) 5c5a9c9c43a6543ae05bebf74deee36bfc0fdc2f Simplify assertions in TestPrestoDriverUri
[x] David Phillips (committed by Christina Wallin) 83506ff7a80d85748d6361f6c05b433a84742a47 Add Kerberos support for JDBC driver
[x] David Phillips (committed by Christina Wallin) b0c1fe10558dd71154168d8fb023238d3ce2554f Add SSL LDAP product tests for Presto JDBC driver
[x] David Phillips (committed by Christina Wallin) ceee9732f13e88c7bda08e89a176090db05afa3f Add HTTP proxy support for JDBC driver and CLI
[x] David Phillips (committed by Christina Wallin) efc80a3717c6d15d85e13c5caf30233c971abf55 Add SOCKS proxy support for JDBC driver
[x] Eric Diven (committed by Christina Wallin) 2eca484a6b0ba362720c57b54e23df1eb1056857 Add support for SSL in JDBC driver
[x] Eric Diven (committed by Christina Wallin) 51f0b8f39a12ed2a9adf84979c1394fa2016b44a Improve properties/URL parameter handling
[x] Eric Diven (committed by Christina Wallin) e6ea41b2d911c63309995a5c847a30a435425f86 Document encrypted internal communication

Grzegorz Kokosinski

[x] Grzegorz Kokosiński (committed by Andrzej Fiedukowicz) 0e7b37e20858fc4ad58f1ad27ceaf4cf82782b39 Use Set collection to store stats estimation rules
[x] Grzegorz Kokosiński (committed by Andrzej Fiedukowicz) 1023df2d9615c932e9c7a27369a9ca80a6dde15d Use pattern matching in ComposableStatsCalculator
[x] Grzegorz Kokosiński (committed by Andrzej Fiedukowicz) 11812a02718e6fa04c9888bca64148ddd195899a Add UnionStatsRule
[x] Grzegorz Kokosiński (committed by Andrzej Fiedukowicz) 1cfdc4fb197ad50a099bbf8be5b1c024df7c646e Cap distinct values count to ouptut rows count
[x] Grzegorz Kokosiński (committed by Andrzej Fiedukowicz) 4fa9c7ce2840f16abb2d7be8ed3e62a97179d107 Make StatsCalculaterTester to be closeable
[x] Grzegorz Kokosiński (committed by Andrzej Fiedukowicz) 67b29c8b6ecc4cdd9d1f86747b79d1b2a6f0ff86 Ensure all output symbols have stats estimates
[x] Grzegorz Kokosiński (committed by Andrzej Fiedukowicz) 68e0993fa6badeb66a27566fe2de97661bbf5041 Introduce stats Normalizer
[x] Grzegorz Kokosiński (committed by Andrzej Fiedukowicz) 6f8b7740740f36b82e5af72c7fa0ae5a9cdff7cd Remove display-only stats tests
[x] Grzegorz Kokosiński (committed by Andrzej Fiedukowicz) 71d5c4e1f9d175270d29a7e9ad98ba0f38cb226e Support multi source exchange
[x] Grzegorz Kokosiński (committed by Andrzej Fiedukowicz) 787511ee0e04a957374b82bc461c597b8fd11c78 Add scalar stats estimation for CoalesceExpression
[x] Grzegorz Kokosiński (committed by Andrzej Fiedukowicz) 8684b497e8916cc0b353a875cf1675b9053f2249 Cap distinct values count to type domain range length
[x] Grzegorz Kokosiński (committed by Andrzej Fiedukowicz) 8d05a3f49d2f5a4f67c3b12ff112d4e5b6780eb0 Use TreeTraverser in MatchingEngine
[x] Grzegorz Kokosiński (committed by Andrzej Fiedukowicz) acba05760d3c1cfca0b813d9a15a0411569ede3b Use nearlyEquals for estimate comparison
[x] Grzegorz Kokosiński (committed by Andrzej Fiedukowicz) cb0e3133d115a2b099bd5ac0efa460c41c11efb0 Add statistic estimation for simple AggregationNode
[x] Grzegorz Kokosiński (committed by Andrzej Fiedukowicz) d06d384356fed379a77bb542b786e77dc7c34425 Test for cost/stats calculation done by CoefficientBasedStatsCalculator
[x] Grzegorz Kokosiński (committed by Andrzej Fiedukowicz) d35f1d71e206d4940c42b276220c3c07441e1b7f Add scalar stats estimation for ArithmeticBinaryExpression
[x] Grzegorz Kokosiński (committed by Andrzej Fiedukowicz) d8a55cb9f3e4e8d6b0042554e4fb073aba88f92d Move pattern matching to separate package
[x] Grzegorz Kokosiński (committed by Andrzej Fiedukowicz) e58f0a21bd109c17ca1687d351a5d066c3eebece Check interfaces of given object when checking pattern
[x] Grzegorz Kokosiński (committed by Andrzej Fiedukowicz) ffcb0eb9757fcb629affa32b8c18e5655661ad1c Add mapping functions to SymbolStatsEstimate
[x] Grzegorz Kokosiński (committed by Grzegorz Kokosiński) 063d3ba74da2ae2e5ea6402861497a05edfc1f55 fixup! Add stats calculation for FilterNode comparisons
[x] Grzegorz Kokosiński (committed by Grzegorz Kokosiński) 1f1fb86941b5fbfd8eafd8eef6b2d6de9a06f1bc fixup! Introduce CostCalculator interface
[x] Grzegorz Kokosiński (committed by Grzegorz Kokosiński) 5431913d5d8d144640eed4f671ac9729cdf83255 Add test for join ordering for part of TPCH q2
[x] Grzegorz Kokosiński (committed by Grzegorz Kokosiński) 741086094d6438b3c2b316fd87698e26857189e2 fixup! Introduce CostCalculator interface
[x] Grzegorz Kokosiński (committed by Grzegorz Kokosiński) 79ede595f020df8144719f12a1347096df0fef42 fixup! Introduce caching cost and stats calculator
[x] Grzegorz Kokosiński (committed by Grzegorz Kokosiński) a77194f61c2be074f8e4573fa13a5e1aec3c14d7 Rename TestReorderJoins to TestElminateCrossJoins
[x] Grzegorz Kokosiński (committed by Grzegorz Kokosiński) ada21fb54d2b1d7e3538ae93e410386e305e1e51 Add IntersectStatsRule
[x] Grzegorz Kokosiński (committed by Grzegorz Kokosiński) e46571da3d3b36ffc0882badae1647333a615470 fixup! Introduce CostCalculator interface
[x] Grzegorz Kokosiński (committed by Grzegorz Kokosiński) ee9b9f202b870254bbe9b0b49198a9c40a502734 fixup! Add UnionStatsRule
[x] Grzegorz Kokosiński (committed by Grzegorz Kokosiński) ff667934b2f76757f092d2839d62311e1105382d fixup! Add JoinStatsRule to support equi-conditions and filters
[x] Grzegorz Kokosiński (committed by Łukasz Osipiuk) 0bb5981f7352d7041ad42870004107a88580fdc4 Expose TPCDS statistics
[x] Grzegorz Kokosiński (committed by Łukasz Osipiuk) 4ab5e1a89e96fc90df01b9425d80ebeecae36597 Check checksum of LookupSourceSupplier in HashBuilderOperator
[x] Grzegorz Kokosiński (committed by Łukasz Osipiuk) 59034a449454ce168104aa76a16e26b2df5ae2c0 Port TPCH statistics recorder to TPCDS
[x] Grzegorz Kokosiński (committed by Łukasz Osipiuk) 7e0e2f73289700fd5639749f4eb50a864227d684 Calculate checksum of spilled LookupSource
[x] Grzegorz Kokosiński (committed by Łukasz Osipiuk) 87abbea759853c6e07326d012248219286114456 Extend and refactor TestReorderJoins to verify just join order
[x] Grzegorz Kokosiński (committed by Łukasz Osipiuk) ad4673ea2f9b68a107393b68184a910f191a1e24 Close spill files as soon as they are read
[x] Grzegorz Kokosiński (committed by Łukasz Osipiuk) b1b985857b14c0e2849965acfa31f844443c7752 TPCDS statistics data
[x] Grzegorz Kokosiński (committed by Łukasz Osipiuk) c102dd7b0894ba5847a82d3fa0f2d73b94e8f649 Return TPCDS statistics values in Presto internal representation

Karol Sobczak

[x] Karol Sobczak (committed by Akshat Nair) 532e068d7560e471c705b2a9abd80a875f6678ed Fix the TODO in LimitStatsRule
[x] Karol Sobczak (committed by Andrzej Fiedukowicz) 5cef6b148b7951f5f2c791647a8bb186ba36c70f Add verifyExactColumnStatistics utility method to StatisticsAssertion
[x] Karol Sobczak (committed by Andrzej Fiedukowicz) bc5fd2831d1a04f17c1c16584752272360cba783 Add JoinStatsRule to support equi-conditions and filters
[x] Karol Sobczak (committed by Karol Sobczak) 014853b2d3533770ac9737c91ba3197ad929e3bd Adjust PushPartialAggregationThroughExchange to sprint branch
[x] Karol Sobczak (committed by Karol Sobczak) 0e7ae5883413b621509592755722d7d09cc3c90e Migrate PushPartialAggregationThroughJoin as a rule
[x] Karol Sobczak (committed by Karol Sobczak) 0fd980cd23966eccfa3c362dcc592173e7a941ef Migrate PushPartialAggregationThroughExchange as a rule
[x] Karol Sobczak (committed by Karol Sobczak) 12285d6ce3518e12ada9081da4ad7019045e128e fixup! Introduce CostCalculator interface
[x] Karol Sobczak (committed by Karol Sobczak) 13943d932789dad355b97092552a4b2096b25018 Handle symbol = symbol explicitly in stats
[x] Karol Sobczak (committed by Karol Sobczak) 29d87e192a6d6258b8728b8f5cfb483635a9e235 Adjust PushPartialAggregationThroughJoin to sprint branch
[x] Karol Sobczak (committed by Karol Sobczak) 30596a590f41035282e6c3edbed845531ccdd8bd Skip PushPartialAggregationThroughJoin when hash symbol is present
[x] Karol Sobczak (committed by Karol Sobczak) 3915b3c66ce3d63d819c9647190e320c1044dc86 Preserve symbols required by join during partial aggregation pushdown
[x] Karol Sobczak (committed by Karol Sobczak) 4fb2b4920368f2cfae6869467a60d36cbc8043a3 fixup! Support multi source exchange
[x] Karol Sobczak (committed by Karol Sobczak) 52a56dba1d5d1c9248b6af2eeb15ed719cde11c8 fixup! Stats calculator for simple Filter+Project+SemiJoin
[x] Karol Sobczak (committed by Karol Sobczak) 59e04c6dab6b886d712a156dc3acf33705919fd6 Restrict output of join after partial aggregation pushdown
[x] Karol Sobczak (committed by Karol Sobczak) 5ea92f314738d32108dcfc33dc7c7a7ac03271dc fixup! Add JoinStatsRule to support equi-conditions and filters
[x] Karol Sobczak (committed by Karol Sobczak) 708e37b7a714a944c49b29fcb634b583aafcdbc4 Introduce caching cost and stats calculator
[x] Karol Sobczak (committed by Karol Sobczak) 813d19f3ec2af883b75c878af88cf5a2eb0accd8 Adjust PlanOptimizers to sprint branch
[x] Karol Sobczak (committed by Karol Sobczak) 82368dda07f3875554c3696425cce57208c77f13 Remove remapping of pushed partial aggregation
[x] Karol Sobczak (committed by Karol Sobczak) 89ca2ff26af4f4536f1fcb11dd89868b091befa2 fixup! Cap distinct values count to ouptut rows count
[x] Karol Sobczak (committed by Karol Sobczak) 8a8736b50c4d08a634ae8f7bb58140667ffea689 Add rule test for PushPartialAggregationThroughJoin
[x] Karol Sobczak (committed by Karol Sobczak) 994af68405ed79e631d50efd14beaed074c10bc4 Remove @ThreadSafe annotation from CostCalculator interface
[x] Karol Sobczak (committed by Karol Sobczak) a4b7e43e007b0d34e268375b3c022caaea19b889 Adjust TestPushPartialAggregationThroughJoin to sprint branch
[x] Karol Sobczak (committed by Karol Sobczak) ac06bde960c8b12a3d7160e398673808060b2aa9 Add pcollections library dependency
[x] Karol Sobczak (committed by Karol Sobczak) bf72dee5966d9b1e01f685ba61091e1446181c2a Estimate anti join selectivity by least-selective equi-join-clause
[x] Karol Sobczak (committed by Karol Sobczak) c0171808894bc8865d1c44678c529a3a2948bdf7 Use HashTreePMap in PlanNodeStatsEstimate to reduce map copying
[x] Karol Sobczak (committed by Karol Sobczak) c061372d2847b970b0e833fc4bf270894c54f6f6 fixup! Add UnionStatsRule
[x] Karol Sobczak (committed by Karol Sobczak) c5dd64b46d8b2b3759eb6e54146a25219c57bb43 Add support for filter functions in partial aggregation pushdown
[x] Karol Sobczak (committed by Karol Sobczak) d34fed13dda63a45d068ff23bb9e20083b9ae25a Use stats calculator that is join aware in ReorderJoins
[x] Karol Sobczak (committed by Karol Sobczak) ea75972bdab3556009c089983ec291f6513a152d Remove legacy PartialAggregationPushDown optimizer
[x] Karol Sobczak (committed by Łukasz Osipiuk) 99cfd1a32cf7c830bf0e26388209b0f841da05af fixup! Add JoinStatsRule to support equi-conditions and filters

Lukasz Osipiuk

[x] Lukasz Osipiuk (committed by Andrzej Fiedukowicz) 0624f1e3d7a1d7d88a5425e72a1f428a8ec06578 Expose min/max value in statistics for Hive tables
[x] Lukasz Osipiuk (committed by Andrzej Fiedukowicz) 1007f447ef20975a059ecb8d67102e9cac5b0185 Allow using ComposableStatsCalculator instead of CoefficientBasedStatsCalculator
[x] Lukasz Osipiuk (committed by Andrzej Fiedukowicz) 1332459203ca220f91dc6eccdd752873be8f1f45 Add stats calculator unit testing framework
[x] Lukasz Osipiuk (committed by Andrzej Fiedukowicz) 18d975d56ce3623ce72ed93696f8302948fcb10b Add support for low/high values in StatisticsAssertion
[x] Lukasz Osipiuk (committed by Andrzej Fiedukowicz) 194d01732e21883f607aecb83fe6e19ea81ab801 Add scalar stats estimation for SymbolReference
[x] Lukasz Osipiuk (committed by Andrzej Fiedukowicz) 1ad351cc8d234f3d8e3ad25f084639a0dfb11ff4 Remove explicit data_size from PlanNodeStatsEstimate
[x] Lukasz Osipiuk (committed by Andrzej Fiedukowicz) 1e96d345ea4a669f8eeb970575a6e32f920da5dc Add OutputStatsRule
[x] Lukasz Osipiuk (committed by Andrzej Fiedukowicz) 21edd86f75665347c36f6a13a01038192dbbc919 Add doc for statistics
[x] Lukasz Osipiuk (committed by Andrzej Fiedukowicz) 27d7c1390a5be35d3edfe2b937be4878cdbb4d36 Add TestTpchLocalStats stub
[x] Lukasz Osipiuk (committed by Andrzej Fiedukowicz) 40b1f351bcdc63f7f0317a9ce80d7a85a563cffa Add ProjectStatsRule (TODO)
[x] Lukasz Osipiuk (committed by Andrzej Fiedukowicz) 4750ea4671136cae02ba2c2b01dfc7f52fbf890b Introduce range column statistics
[x] Lukasz Osipiuk (committed by Andrzej Fiedukowicz) 59e3e07f745310dac8578a98fd22d3f58152355f Replace nulls count with nulls fraction in column statistics
[x] Lukasz Osipiuk (committed by Andrzej Fiedukowicz) 63a3a40e3df1747f7eeb15cd3f98df114cda258e Add ColumnStatistics.UNKNOWN_COLUMN_STATISTICS
[x] Lukasz Osipiuk (committed by Andrzej Fiedukowicz) 950c7f76aa3a1e5e0a72160eea87af508e51be17 Add support for LocalQueryRunner in StatisticsAssertion
[x] Lukasz Osipiuk (committed by Andrzej Fiedukowicz) 9546667068a28b8f5aecad1c1fc5560b2716521e Add PlanNodeStatisticsAssertion
[x] Lukasz Osipiuk (committed by Andrzej Fiedukowicz) 9af6ed235c9f9642845be88b940d79dc218281c9 Add rule for computing stats for ValuesNode
[x] Lukasz Osipiuk (committed by Andrzej Fiedukowicz) a56926bf29be350fe1e448d4daf4024b79ac8103 Add LimitStatsRule (TODO)
[x] Lukasz Osipiuk (committed by Andrzej Fiedukowicz) a6057181593e1f5941d02517de597d98dcd1a651 Implement ExchangeStatsRule for single source
[x] Lukasz Osipiuk (committed by Andrzej Fiedukowicz) a9dbeab692870ea372b86119911f34e6c5a0aa0e Add ComposableStatsCalculator
[x] Lukasz Osipiuk (committed by Andrzej Fiedukowicz) b535bd8845834bcc34ab11a41075197bdeda6d14 Return low/high value in show stats
[x] Lukasz Osipiuk (committed by Andrzej Fiedukowicz) b886e45660bd93d872e06c79fdfd209bd08ad773 Add TableScanStatsRule
[x] Lukasz Osipiuk (committed by Andrzej Fiedukowicz) d66506fd574a2481af6a77c92f3144a62315a5e9 Add OutputNode support to PlanBuilder
[x] Lukasz Osipiuk (committed by Andrzej Fiedukowicz) ef31d705befaf7d535774f2f89eaf334609ad4dd Allow passing external QueryRunner to RuleTester
[x] Lukasz Osipiuk (committed by Andrzej Fiedukowicz) f0af2e3d44211d2caeada9c61fa21164a083068e Add clearRanges to ColumnStatistics.builder()
[x] Lukasz Osipiuk (committed by Andrzej Fiedukowicz) f0e5e32dd77725a077666d987f40cdd0e1082264 Add scalar stats estimation for Cast
[x] Lukasz Osipiuk (committed by Andrzej Fiedukowicz) f51edeedfe236db607ea8ff5180fbb4a364a3920 Support column stats in StatisticsAssertion
[x] Lukasz Osipiuk (committed by Łukasz Osipiuk) 1c7f4dad192c94f849c83413c8995cdadf24c246 Add doc for multi-file hive buckets support
[x] Lukasz Osipiuk (committed by Łukasz Osipiuk) 293a7cb8382d0207c524cf8a7e2f170caf85764e Refactor OperatorContext::reserveMemory
[x] Lukasz Osipiuk (committed by Łukasz Osipiuk) 327159bce87f5db32ba62d6d4c97b821a8e74031 Add tests for bucketed table with empty partitions
[x] Lukasz Osipiuk (committed by Łukasz Osipiuk) 4b620421e4894a186342279512bcc7cc78ca0a17 Allow multiple files per bucket in hive
[x] Lukasz Osipiuk (committed by Łukasz Osipiuk) 6f29bc61465bcc16931a0b08edb921ab1a16e712 Cleanup TestMemoryPools test
[x] Lukasz Osipiuk (committed by Łukasz Osipiuk) 74b7a8a553031005d146f58c4144c3e84942dd89 Allow empty partitions for clustered hive tables
[x] Lukasz Osipiuk (committed by Łukasz Osipiuk) 8f20152c0f320156ec573ebb75533ba84dc5dd88 Add revoking tests to TestMemoryPools
[x] Lukasz Osipiuk (committed by Łukasz Osipiuk) 9b42c264df2ae0643dbbd7f8e432fa78020ca0f9 Improve exception messages
[x] Lukasz Osipiuk (committed by Łukasz Osipiuk) af86e724f92bf17f35b3ede97d7dd6f6ed27069b Introduce MemoryRevokingScheduler
[x] Lukasz Osipiuk (committed by Łukasz Osipiuk) c8362a4a93253da784dafb98eb1f2bc922847173 Make memory pool aware of revocable allocation type
[x] Lukasz Osipiuk (committed by Łukasz Osipiuk) f20490f661bcabed6cab15431c96c90cb7a668c3 Add doc for Hive empty buckets support
[x] Lukasz Osipiuk (committed by Łukasz Osipiuk) f3c9dec92b1320665db4c043babbfd899c142103 Introduce QueryContextVisitor
[x] Nezih Yigitbasi (committed by Łukasz Osipiuk) 8206d701b962186aa8aff3be858202e0e711a474 Synchronize access to reservedBytes and reservedRevocableBytes
[x] Łukasz Osipiuk (committed by Andrzej Fiedukowicz) 0ea197326fbcf2268b73e065995243a3d4283457 Remove Filter above TableScan logic from CoefficientBasedStatsCalculator
[x] Łukasz Osipiuk (committed by Andrzej Fiedukowicz) 0fa14a92cc08dff006e9eaf08585dc3a70062d90 Add SymbolStatsAssertion.isEqualTo
[x] Łukasz Osipiuk (committed by Andrzej Fiedukowicz) 381648bc9fa301eca07228af6f23b84d94c52e85 Add precondition checks in PlanNodeStatsEstimate constructor
[x] Łukasz Osipiuk (committed by Andrzej Fiedukowicz) 3d5a4b4b666dac8be41c7740e1601154e61be916 Use doubles instead Estimates in PlanNodeStatsEstimate
[x] Łukasz Osipiuk (committed by Andrzej Fiedukowicz) 41db4f16c84c3417780aafb4236fccf32a735b9e Rename cost concept to stats
[x] Łukasz Osipiuk (committed by Andrzej Fiedukowicz) 51b4b2f32042d3d457158b5bec1dd45c162bdf41 Add test for symbol reference stats calculation
[x] Łukasz Osipiuk (committed by Andrzej Fiedukowicz) 9dd58effbbd037de71eef895c8d9e953717fa9e1 Do not check symobol statistics in PlanStatsMatcher
[x] Łukasz Osipiuk (committed by Andrzej Fiedukowicz) b65622233e16559a0c42c74f93b01a513056b8e3 Add EnforceSingleRowStatsRule (TODO)
[x] Łukasz Osipiuk (committed by Andrzej Fiedukowicz) bba4a5afe2c011d9121b705a1f2d99bfd39d3ccb Add ScalarStatsCalculator
[x] Łukasz Osipiuk (committed by Andrzej Fiedukowicz) c13d897ba0575c2e0cd6ebba7cfa86d77cb3d1ba TestStatsCalculator tests new version of calculator
[x] Łukasz Osipiuk (committed by Andrzej Fiedukowicz) c67f15f90a2618b645d8b3f1e21d4d8686e2f8ca Add scalar stats estimation for Literal
[x] Łukasz Osipiuk (committed by Andrzej Fiedukowicz) d22925fa2a907950e7b42a951ad396e9a33cb35d Add Symbol statistics to PlanNodeStatsEstimate
[x] Łukasz Osipiuk (committed by Łukasz Osipiuk) 0105c5bf0cc6aa4becb5f0609bf5dbf62c58b626 Estimate JOIN selectivity by most selective equi-join-clause
[x] Łukasz Osipiuk (committed by Łukasz Osipiuk) 07bb5ee45cc430eef63d4f1afdca469df44a59e6 Do not plan INNER join with just filter function
[x] Łukasz Osipiuk (committed by Łukasz Osipiuk) 1df231fa27c5736b551c515817a103f4de846694 fixup! Propagate unknown expression stats filtering from leaf
[x] Łukasz Osipiuk (committed by Łukasz Osipiuk) 3d5136d5ff0a2a31785d5b1e35c7f9c72db21efc fixup! Add JoinStatsRule to support equi-conditions and filters
[x] Łukasz Osipiuk (committed by Łukasz Osipiuk) 3e8e93788a35647393ee142bd6dc103129017de0 Change TestReorderJoins.q7
[x] Łukasz Osipiuk (committed by Łukasz Osipiuk) 426f81c243f1d8997ac9d6691bf4c2f2493caebb Fix ExpressionNotEqualExpression filter stats rule
[x] Łukasz Osipiuk (committed by Łukasz Osipiuk) 4d4cbd8ed26e4dc9a7596dd0b16e14bf0d95ae51 Cap distinctValuesCount in intersect in in FilterStatsCalculator
[x] Łukasz Osipiuk (committed by Łukasz Osipiuk) 503b126246c571ef00bb11809786f3e33ede25d3 Rename joinConditionBuilder variable in PredicatePushDown
[x] Łukasz Osipiuk (committed by Łukasz Osipiuk) 540887b4fb8e22854d599c16ac6da499d282bbd9 Propagate unknown expression stats filtering from leaf
[x] Łukasz Osipiuk (committed by Łukasz Osipiuk) 8b85d86e836743d367640cf626a5628eeac97cda Stats calculator for simple Filter+Project+SemiJoin
[x] Łukasz Osipiuk (committed by Łukasz Osipiuk) a2ebcb0ad40309b8f8987d81e18c5550d0eacd92 Add simple implementation of SemiJoinStatsRule
[x] Łukasz Osipiuk (committed by Łukasz Osipiuk) a729c141c17ed5202117e735d9db2474f89c9a7a Remove SATURATED_FLOOR_CAST real->[bigint,integer]
[x] Łukasz Osipiuk (committed by Łukasz Osipiuk) b34fe316d97840b4285fcf74a16802b91cd6e534 fixup! Add spill for join
[x] Łukasz Osipiuk (committed by Łukasz Osipiuk) b57a3081d75c85477f20957e65dcebbea5d32b0b Remove SATURATED_FLOOR_CAST double->bigint
[x] Łukasz Osipiuk (committed by Łukasz Osipiuk) b78219c7a64aed651c45d3e606ae5afc0a17310d fixup! Estimate JOIN selectivity by most selective equi-join-clause
[x] Łukasz Osipiuk (committed by Łukasz Osipiuk) ce9a756171affd5102edd2478fc6cf27c113a560 Remove SATURATED_FLOOR_CAST double->decimal
[x] Łukasz Osipiuk (committed by Łukasz Osipiuk) d7d62375f917fce9bf7fa8d430663808dc3ef705 Add simple SemiJoinStatsCalculator
[x] Łukasz Osipiuk (committed by Łukasz Osipiuk) db32a14eaaa589dab74805629f38b99f46fb6698 Refactor checks for unchanges stats in TestComparisonStatsCalculator
[x] Łukasz Osipiuk (committed by Łukasz Osipiuk) e872b1e046868b4ab6bbf87c83077e143697eb51 fixup! Add JoinStatsRule to support equi-conditions and filters
[x] Łukasz Osipiuk (committed by Łukasz Osipiuk) ea3d7b49dc88d6b3572a1c368147c9cbcd668091 Fix planning issue of LEFT coin converted to INNER
[x] Łukasz Osipiuk (committed by Łukasz Osipiuk) eddc386bd8390630dff7ea96225e8ad6750ccbfd Assume unknown value domain for types not representable as double
[x] Łukasz Osipiuk (committed by Łukasz Osipiuk) ff5ba80edf352c3e067ad3ef80262741d1217c4c fixup! Add Symbol statistics to PlanNodeStatsEstimate

Maciej Grzybek

[x] Maciej Grzybek (committed by Maciej Grzybek) 0473089e6e63252312691fd7be0217f437989838 Make PlanNodeStats Mergeable
[x] Maciej Grzybek (committed by Maciej Grzybek) 1393b4843079e318413ce3f0b16b8e5192f2a952 Add documentation for EXPLAIN ANALYZE VERBOSE mode
[x] Maciej Grzybek (committed by Maciej Grzybek) 251a124643e7b72d4cde0eb9928b80ca7766f505 Fix handling ConnectorSession in FunctionInvoker
[x] Maciej Grzybek (committed by Maciej Grzybek) 2f24d55e875d85536c6afec5cf2a3d52a06f3ad9 Unify ExpressionInterpreter.invoke and FunctionInvoker code
[x] Maciej Grzybek (committed by Maciej Grzybek) 535912affb96e017ea87eefcd6575e41bdc20479 Remove ExpressionInterpreter.invoke, use FunctionInvoker instead
[x] Maciej Grzybek (committed by Maciej Grzybek) 5dacc9143e8996d1ebaf5c9f46b89e68fe1446d7 Pass FunctionRegistry instead of whole Metadata
[x] Maciej Grzybek (committed by Maciej Grzybek) 60a3899b32f2b6db6be5a4c51fa96a953e55af1a Add additional statistics for WindowOperator
[x] Maciej Grzybek (committed by Maciej Grzybek) 6d303beee208b700b84241919fa4cfcfdab99b77 Add VERBOSE option to EXPLAIN
[x] Maciej Grzybek (committed by Maciej Grzybek) 88b5bf3e1ef2d4cc8162bafd9fca1c0db70a4320 Auto-reformat the WindowOperator
[x] Maciej Grzybek (committed by Maciej Grzybek) 93bcc6301a50c717e5d97d34ea77a15377a383b3 Change expected type to be Object instead of Block in Accumulator
[x] Maciej Grzybek (committed by Maciej Grzybek) 95c6acf6e7be8b5a0cf4fe772ddbffbfb562b099 Move Mergeable to Util package
[x] Maciej Grzybek (committed by Maciej Grzybek) a946c1caf1e4c3e663f05dfef8652901996d71e5 Fix formatting in AccumulatorCompiler
[x] Maciej Grzybek (committed by Maciej Grzybek) cd1ba79d8cbafa4d181559f63e918402d5b95924 Fix IntelliJ warnings in ExpressionInterpreter
[x] Maciej Grzybek (committed by Maciej Grzybek) e1539120dfdf012214fd481f101b51c4958069bb Add information about rows distribution per task to explain analyze
[x] Maciej Grzybek (committed by Maciej Grzybek) ea445757b7a9ec5b7ef893be7c831c3a5cfc0f3d Add missing test for explain analyze with type specified
[x] Maciej Grzybek (committed by Maciej Grzybek) f493e85c105c43d807c21f9c712a73d12d36638e Prevent providing WindowInfo before the operator finishes
[x] Maciej Grzybek (committed by Maciej Grzybek) f57412790c9ddb68cbb13c7a61c742245e490007 Make Mergeable capable of merging Optionals

Piotr Findeisen

[x] Nezih Yigitbasi (committed by Piotr Findeisen) c8b6e01d87dfd49c9b55f77c0679f793bc3c0acd Fix flaky test TestPrestoDriver::testQueryTimeout()
[x] Piotr Findeisen (committed by Christina Wallin) 0119258c5b1e0b2a5a2b96e6ed5359c90e277f8f Fix calls to HostAndPort.getHostText
[x] Piotr Findeisen (committed by Piotr Findeisen) 1e0f33c90ece60f794841ffc5b1e206b9777ddff fixup! Introduce CostComparator
[x] Piotr Findeisen (committed by Piotr Findeisen) 26595d17607591f761153b2234bbc892ae2f51e0 fixup! Introduce CostCalculator interface
[x] Piotr Findeisen (committed by Piotr Findeisen) 280203ad45aa047235f36b7203d1f851f1570ba2 Provide thread safe AggregatedMemoryContext implementation
[x] Piotr Findeisen (committed by Piotr Findeisen) 2b2757b0b604565ce624cf15f2c993fab124d6f2 fixup! Add PartitioningSpiller
[x] Piotr Findeisen (committed by Piotr Findeisen) 2c956e53fb7ee443d7d1ab98788f9e7ad7911971 fixup! Add doc for statistics
[x] Piotr Findeisen (committed by Piotr Findeisen) 318c8561841c49d328712545c97f735825aca60b fixup! Add PartitioningSpiller
[x] Piotr Findeisen (committed by Piotr Findeisen) 333312063042aa146741945ffc2cbb64eab976b5 Improve IN predicate statistics
[x] Piotr Findeisen (committed by Piotr Findeisen) 39aa48583a80257be3f1f215741662dbb3995185 fixup! Add doc for statistics
[x] Piotr Findeisen (committed by Piotr Findeisen) 3dacf66ac563d02e0a632814c3fccf303087eeab fixup! Add FilterStatsCalculator
[x] Piotr Findeisen (committed by Piotr Findeisen) 420201a9807e6be0df07bfda021ac8fd322b8042 fixup! Provide thread safe AggregatedMemoryContext implementation
[x] Piotr Findeisen (committed by Piotr Findeisen) 459a3c94df78c294b37dea30613c5ba5ac0b140c Generalize symbol-to-symbol comparisons to cover expressions
[x] Piotr Findeisen (committed by Piotr Findeisen) 4e14575b7fe5454fc74c8663726bb917647cacd7 fixup! Add stats calculation for FilterNode comparisons
[x] Piotr Findeisen (committed by Piotr Findeisen) 4f9b233184f7c264621b7c2dc09a15769ef1c726 Cache LookupSource to avoid construction cost
[x] Piotr Findeisen (committed by Piotr Findeisen) 5620f307ac0744538ebd59c90c958d476bc3908b fixup! Use stats calculator that is join aware in ReorderJoins
[x] Piotr Findeisen (committed by Piotr Findeisen) 5b7753e7543ab7998d2d34c0f16db8f3770f2c6d fixup! TMP TODO notes for my dear team ☺︎
[x] Piotr Findeisen (committed by Piotr Findeisen) 64f2c62c5c2c66e47d1d030f3e252a20bb28a22c fixup! Add FilterStatsCalculator
[x] Piotr Findeisen (committed by Piotr Findeisen) 6d80d8f76b6640b0c31bf9a541f3619f359beb69 fixup! Add stats calculation for FilterNode comparisons
[x] Piotr Findeisen (committed by Piotr Findeisen) 6fd45b9c8569e49521d05376241dbb6d741d4457 fixup! Add Symbol statistics to PlanNodeStatsEstimate
[x] Piotr Findeisen (committed by Piotr Findeisen) 700df66f78a540b75f79a5ba5d2f632d3aca8b79 fixup! Add Symbol statistics to PlanNodeStatsEstimate
[x] Piotr Findeisen (committed by Piotr Findeisen) 714117ad6738ac3139e93f341f8a014dd5e0af65 Add a TODO note to FileSingleStreamSpillerFactory
[x] Piotr Findeisen (committed by Piotr Findeisen) 79aada62e54eb58d175f1333b042646d81ff2cde Test combination of IN and cast literals
[x] Piotr Findeisen (committed by Piotr Findeisen) 7f652a2e3f40ff78565ff26366976a4cced7b5c8 fixup! Add stats calculation for FilterNode comparisons
[x] Piotr Findeisen (committed by Piotr Findeisen) 7f6c6af3f904537d9ede295f35489e093a55994d fixup! Add stats calculation for FilterNode comparisons
[x] Piotr Findeisen (committed by Piotr Findeisen) 932263ae069f43766090166ccc48760837a9b905 fixup! Add stats calculation for FilterNode comparisons
[x] Piotr Findeisen (committed by Piotr Findeisen) 936698d369b8cc939d5bcbe2064ae4bc760bc7ce fixup! Rename cost concept to stats
[x] Piotr Findeisen (committed by Piotr Findeisen) 97a42c307e3d0c133275c62be3408c2999e905dc fixup! Add Symbol statistics to PlanNodeStatsEstimate
[x] Piotr Findeisen (committed by Piotr Findeisen) a63bdbbdabc64f037457d533a44594a600397e7a fixup! Add stats calculation for FilterNode comparisons
[x] Piotr Findeisen (committed by Piotr Findeisen) ad1ba3f5bfa221f783fc8f528b3354949311223a fixup! Add PartitioningSpiller
[x] Piotr Findeisen (committed by Piotr Findeisen) adfc7eca09a21bd516b1aac3399aa2183e64bc67 fixup! Add stats calculation for FilterNode logical operations
[x] Piotr Findeisen (committed by Piotr Findeisen) aebfe288de62dc2404a29ccac95e75b6a3aac7be Merge PR #637 'statistics generalized comparisons' into release-0.179-t
[x] Piotr Findeisen (committed by Piotr Findeisen) b8a32d782d3b7e186bdd6768c1ded194d85af688 Use generalized expression-to-expression comparison stats calculations
[x] Piotr Findeisen (committed by Piotr Findeisen) b8c7059ab419991fa26c8db8fe0a888f7015890f Use generalized expression-to-literal comparison stats calculations
[x] Piotr Findeisen (committed by Piotr Findeisen) bdf290c94286d75196be986a91daeeff37efd9aa fixup! Add PartitioningSpiller
[x] Piotr Findeisen (committed by Piotr Findeisen) bfcf228ece97a061dc190c7d7cd6e28007ecaf3d Expose aggregation keys that are also source fields to ORDER BY
[x] Piotr Findeisen (committed by Piotr Findeisen) c04e40e1ece2424c2f16a866692de632e448bcd0 fixup! Introduce CostComparator
[x] Piotr Findeisen (committed by Piotr Findeisen) c4c23aa7a935c5c2e10976fa7ec0f2eeea462cd8 fixup! Add stats calculation for FilterNode logical operations
[x] Piotr Findeisen (committed by Piotr Findeisen) d49e611585453dd5804987a3591115f872e1639e fixup! Change StatsCalculator API to use Lookup for computing child costs
[x] Piotr Findeisen (committed by Piotr Findeisen) e284933c0d8e2af7bd70750987afabcde2bc04a8 fixup! Add PartitioningSpiller
[x] Piotr Findeisen (committed by Piotr Findeisen) e717a741270714b141694cba5167f302e69fa999 Generalize symbol-to-literal comparisons to cover expressions
[x] Piotr Findeisen (committed by Piotr Findeisen) eac8b1aa28676630b0d1a0fd02399b8ec8175367 Consider ranges overlap when stating symbols comparison
[x] Piotr Findeisen (committed by Piotr Findeisen) edd6a6c133377484983e4e0030274edc849da838 FIXUP don't create new local Spill context when invoking spiller factory :/
[x] Piotr Findeisen (committed by Piotr Findeisen) f871f28344c0b8db0fb59fc1ecb09106e2fd5608 fixup! Add stats calculation for FilterNode comparison related operators
[x] Piotr Findeisen (committed by Rebecca Schlussel) 00245fff3e144c016a78d43811623a412da980de Fix date constant in test
[x] Piotr Findeisen (committed by Rebecca Schlussel) 26baf615e584ca75af595b5be0c4be2d5dfde5c8 Test stat calculations for DATE comparisons
[x] Piotr Findeisen (committed by Rebecca Schlussel) 33670b92c3f6ffe04ce7ef1aa53abb2aad1449c2 Construct proper literal for DATE in LiteralInterpreter.toExpression
[x] Piotr Findeisen (committed by Rebecca Schlussel) 7b0b4b3e93bc54159d3b70631cc18b210eeb4ac7 Support DATE to double conversion in DomainConverter
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 05a8abc21e1baf90308e39c7fce8ede82e474ace Ensure everything is closed in SpillableHashAggregationBuilder
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 07be20e0dc713d642e61f646bd94ec41f53cb540 Refactor LookupJoinOperator so that it doesn't keep LookupSource
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 0cac9cdfa1de7924bd7f6ab7c7dc937fa43eea36 Fix formatting
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 0fe37858132f39efe9b4aeab54dd4aaf0d224634 Add factory method for constructing dictionary pages
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 10adfb6fc7e880f2694f7677b554118eb6793805 Trigger memory revoking quickly on over-allocation
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 11490b0bdb6ff448ba03f39fbba21ba15f7ed313 Rename PartitionFunction to BucketPartitionFunction
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 1769bdad6c60ef1943e8cbbb21a6ed3f8d357a7f fixup! Calculate checksum of spilled LookupSource
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 21db4d3f9e3d09e42c09043aed3ac8e85ebf71cf Extract join operator factory creation in TestHashJoinOperator
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 2e6e457444ee75b47961a24c00d3720b4e253e38 [superseded by airlift/airlift#534] Add utility functions aiding Operator implementations
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 2f5c6d51b15b0f44bdd9370577a3ca1c8a8a3665 Add spill for join
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 306362edb0aeabeb71c842a783b0ebcdc2bb5797 [spilled to #8263] Fix thread-safety of SpillContexts [...]
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 3bdc506c517640b625dd704f12aaa24978093dbf fixup! Cap distinct values count to type domain range length
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 3f2d318f1f61f261ee4e4771cd2914b6cd136884 Do not print configuration in tests to avoid Travis log limit
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 4557257eb3fa07478bac1e5a3731a1d4a23fceec Change memory revoking finish to continuations
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 45c102b39dcc9563b5a785dc0f13eed837cec5bc Keep calling build driver in TestHashJoinOperator after build is complete
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 47ed4c75c2218ce9ed74f502d1c05dd653071119 Add helper class for operating on Optionals
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 4cc0b064f01ac3b8cbe2c4a7e51d6dc6fcf25428 fixup! Add spill for join
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 4dadbac878df4a1f2444845a8986dfe9abf56b2a Prevent file leak in FileSingleStreamSpiller
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 4f53cbd85748353d5c956f438c23b5cb3d1ff6c3 Lazy create partition spillers to avoid spilling locations skew
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 4f7d73ea77a1d58cab310b401accb857512443fd TODO markers
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 5a3076061f8126799aea0c84f83c66c25836e640 TMP TODO notes for my dear team ☺︎
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 727510cb14b77f13141fefc40d3baa824ee1489d [spilled to #8236] Move providing OuterPositionIterator to LookupSourceFactory ...
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 740e37a7a21cc165a86bcd4a93d793b0145e48f4 Extract TaskManagementExecutor from SqlTaskManager
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 7478eb91bf2cb0c909ed7d235a39a9862726e761 squash! Add spill for join
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 7b77516891e08cf47a55db6a6a6c5aad49aa76d5 fixup! TMP test more
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 7b911e5594aab8edaece906f955fe29af86dbee6 TMP test more
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 800f56e5f509b0b9b2d49da987354a21ab9cf87c Update memory allocation when finishing in HashAggregationOperator
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 832781ea657a140abb2d2556cb98766e2ec600df Make LocalPartitionGenerator implement PartitionFunction
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 83c65badd149fc32e955f53427295016f3311e1d fixup! Assume unknown value domain for types not representable as double
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 88c4a30ba9fdb0444cee416b869af791c935598a Refactor supplying partition to PartitionedLookupSourceFactory
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 8a31b1940c5448a34d5c99338fe02eb9238f0e97 Make PagesIndex.clear() free memory
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 905abd1061c26a165eb878c31ed592dcbdb11021 Reliably call Operator.finish() even if blocked
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 9452f3b37a6bf5ac07e284c52cfdf1e0bb243bbb fixup! Lazy create partition spillers to avoid spilling locations skew
[x] Piotr Findeisen (committed by Łukasz Osipiuk) 9d7dcd91881f24453ea54abb52d8db6067741c62 Remove redundant parameter from DictionaryBlock constructor calls
[x] Piotr Findeisen (committed by Łukasz Osipiuk) ba4c07a4d4f375701496609b04495ced7a138c79 TODO marker
[x] Piotr Findeisen (committed by Łukasz Osipiuk) bb5337c8653615b3700f19bc5c358e28a1874442 fixup! Change memory revoking finish to continuations
[x] Piotr Findeisen (committed by Łukasz Osipiuk) c3f39243f569d2d489f35e336ca4168b5d0ec89d fixup! Check checksum of LookupSourceSupplier in HashBuilderOperator
[x] Piotr Findeisen (committed by Łukasz Osipiuk) cb1cf991867b7194c09230eb6b364a7a751d700c Change PartitionedLookupSourceFactory synchronization to RW-lock
[x] Piotr Findeisen (committed by Łukasz Osipiuk) d0f497399de8a9dfd342cc8fcdac5343347240e3 Add minimal DictionaryBlock constructor
[x] Piotr Findeisen (committed by Łukasz Osipiuk) d1522e0312849f0c3d607e5a361e19cad8378b05 Separate build side setup and execution in TestHashJoinOperator
[x] Piotr Findeisen (committed by Łukasz Osipiuk) d20d69137fed6d90cb15fad98a3b425fce51acac Reorder methods in HashBuildOperator to match lifecycle
[x] Piotr Findeisen (committed by Łukasz Osipiuk) e689f6f2fbda899e6c7988498601c8e11b0f5bed Fix PagesIndex.getEstimatedSize for empty index
[x] Piotr Findeisen (committed by Łukasz Osipiuk) e68bf8430b6a88fa22c9dca3575e511d842cae10 Try index compaction before spilling in HashBuilderOperator
[x] Piotr Findeisen (committed by Łukasz Osipiuk) f612f513ea851cbef59f86da419d86469695cd7d fixup! Consider ranges overlap when stating symbols comparison
[x] Piotr Findeisen (committed by Łukasz Osipiuk) f7014bab4399dcb429c8d97df32eae0d3adfaa2f Refactor JoinProbe so that it doesn't keep LookupSource

Piotr Nowojski

[x] Piotr Nowojski (committed by Andrzej Fiedukowicz) 56ac3a9b285f9bfa41abb86a5bb7ce97e6b6dedd Estimate default outputSizeInBytes based on outputRows
[x] Piotr Nowojski (committed by Andrzej Fiedukowicz) 8c7e641fab0f6b272cfa0846862938e0c4f83ab9 Print cost estimate in Explain
[x] Piotr Nowojski (committed by Andrzej Fiedukowicz) a177256c1a46484f499341c851f296d6f60c232f Add information about most important performance releated properties
[x] Piotr Nowojski (committed by Andrzej Fiedukowicz) aa11993b6f47d04843c34358abc24fd99271a60b Introduce CostComparator
[x] Piotr Nowojski (committed by Andrzej Fiedukowicz) bd5084cc412639efc07e3f2ca74b5762fe3e2e8c Add tuning for queries with fast processing splits
[x] Piotr Nowojski (committed by Andrzej Fiedukowicz) c85d7e8184610486c71f8eec252cb886a129a0d6 Refactor getQueryMaxMemory session property getter
[x] Piotr Nowojski (committed by Andrzej Fiedukowicz) ecf8540ac77b8642cdf6db4961efb7a672586338 Add spilling properties documentation
[x] Piotr Nowojski (committed by Andrzej Fiedukowicz) f12281c6b2e8f03e9a953ecff36c785ac9e58a1c Introduce CostCalculator interface
[x] Piotr Nowojski (committed by Rebecca Schlussel) dcb412ba2927ae368f90f94b5105fe995847629c Document join reordering
[x] Piotr Nowojski (committed by Łukasz Osipiuk) 02f0ed5f9af8636bbe5df0ed478bbf0197d464c1 Always revoke memory in TestHashAggregationOperator
[x] Piotr Nowojski (committed by Łukasz Osipiuk) 2e09de6bdf4d7dfa949e26a8dbe3fa173e7e1344 Revocable system memory in contexts
[x] Piotr Nowojski (committed by Łukasz Osipiuk) 5094f5dd8af65b663790bde1197b2851a9b131f3 Configure spill space limits in LocalQueryRunner
[x] Piotr Nowojski (committed by Łukasz Osipiuk) 5a15eeac7b4147d0754be14c4a463d767a0420ec Handle operator memory revoking in Driver
[x] Piotr Nowojski (committed by Łukasz Osipiuk) 622a52cf258403bb08eeaa4154d01cd541220af8 Ensure constant number of LookupJoinOperators
[x] Piotr Nowojski (committed by Łukasz Osipiuk) 75ec07f5845464ba9009e27fbb17a75051734040 Add custom TaskContext builder
[x] Piotr Nowojski (committed by Łukasz Osipiuk) 849218ca78c565c4943717c119f72a8bdc8d3ca4 Trigger memory revoking in OperatorAssertions
[x] Piotr Nowojski (committed by Łukasz Osipiuk) 867a8855a90f4315cf812a3e6c0da8d32a66ca7e Pass spilling parameters to HashBuildOperator & LookupJoinOperator
[x] Piotr Nowojski (committed by Łukasz Osipiuk) 983261ec34868b20dd07bdee25af075bed96f53b Always revoke memory in TestQuerySpillLimits
[x] Piotr Nowojski (committed by Łukasz Osipiuk) 9c79bae19f0efaf358b468f1a9f4ea1a97deb516 Use revocable memory for spilling in aggregation
[x] Piotr Nowojski (committed by Łukasz Osipiuk) a9657dcf2a8dd7bdc4b1127d362f5271fb91f589 Add getPages method to PagesIndex
[x] Piotr Nowojski (committed by Łukasz Osipiuk) e970b6e5bfe5827a4cee1344b5266331dc67594d Always revoke memory in TestLocalBinarySpilledQueries
[x] Piotr Nowojski (committed by Łukasz Osipiuk) ee86bc3e0d3ef22e5b4dbb5d0feaa60c822ca337 Rename memoryLimitBeforeSpill config/session property
[x] Piotr Nowojski (committed by Łukasz Osipiuk) f14778c5369780e16d525e5d13d6b376ee8c9b2b Add PartitioningSpiller

Rebecca Schlussel

[x] Rebecca Schlussel (committed by Andrzej Fiedukowicz) 08e768d6e034230105a685edccf5db63f0b0509b Add ATQ test for table constraints infinite loop bug
[x] Rebecca Schlussel (committed by Andrzej Fiedukowicz) 3973aad778a5e6eef97797a6ac7880c760eb54b6 Add rule to push down table constraints
[x] Rebecca Schlussel (committed by Andrzej Fiedukowicz) 76c39c521847fbb2e9a9591102b8fc1bb58d9acf Change StatsCalculator API to use Lookup for computing child costs
[x] Rebecca Schlussel (committed by Anton Petrov) 636a5ee4105fd62a63cd4d98ebdebf2f909dbc5f Add a test for the TPC-DS connector
[x] Rebecca Schlussel (committed by Anton Petrov) fdba46048911528f12c2e2712c0214500f0eca47 Add the data generation portion of the TPC-DS connector
[x] Rebecca Schlussel (committed by Rebecca Schlussel) 00c9133b5a1dbb0cc5affc3b1260d151da47fcc7 Revert "Quarantine TestReorderJoins tests depending on cost calculation details"
[x] Rebecca Schlussel (committed by Rebecca Schlussel) 1a8d656aef23816037b9c2b3a921708691bbce26 Fixup! Introduce CostComparator
[x] Rebecca Schlussel (committed by Rebecca Schlussel) 2209bbb6edc7379e84f372972b6449132b5af723 Special case NOT(IS NULL) predicate stats
[x] Rebecca Schlussel (committed by Rebecca Schlussel) 23021c18d0920c4189279d102468bb8cab0bff0e Add docs for query performance analysis
[x] Rebecca Schlussel (committed by Rebecca Schlussel) 232bd27f375b4be003747c6f3dcd4f4a1f10cf77 Fixup! Add stats calculation for filter range comparisons
[x] Rebecca Schlussel (committed by Rebecca Schlussel) 239b6b413cf4d3e3bf45b4847c9ac6eb729c266d Add tests for s3 connector
[x] Rebecca Schlussel (committed by Rebecca Schlussel) 296931920cfa5a6d66592ce6fc91ba5478c62f13 Replace reorder_joins with join_reordering_strategy
[x] Rebecca Schlussel (committed by Rebecca Schlussel) 2b36a8ba4bad971a0590720c782ea14c25540ded Support using a fake node count for unit tests
[x] Rebecca Schlussel (committed by Rebecca Schlussel) 3b4e2b30eaa82ecb05547630ca9723c83493b981 Add ReorderJoins rule to pick the best join order
[x] Rebecca Schlussel (committed by Rebecca Schlussel) 41e5fccbafa2087b71e1ca0a50907f67951d5625 Add benchmark for ReorderJoins rule
[x] Rebecca Schlussel (committed by Rebecca Schlussel) 480161475e1c78bf5af6446fbad7779627265cfb Replace distributed_joins with join_distribution_type session property
[x] Rebecca Schlussel (committed by Rebecca Schlussel) 4f1f05da9ebab86ce917ab1f7ef6e4c1358c0fd2 Add unit testing infra for TableWriter and Union
[x] Rebecca Schlussel (committed by Rebecca Schlussel) 539178be2772fb94d3a21d329a30b013afda9adf Revert "Test that CostCalculator successfully returns unknown costs for no stats"
[x] Rebecca Schlussel (committed by Rebecca Schlussel) 671afb21a1d565dd160c78c58b4c4afb51aac984 Add back improvements to fragment PlanPrinter
[x] Rebecca Schlussel (committed by Rebecca Schlussel) 67e24c2685772ff06818d6f4a43cf5f179747a51 Support matching join distribution type in tests
[x] Rebecca Schlussel (committed by Rebecca Schlussel) 682fed53ef196382e427dce64382919592395cb1 Document the push_aggregation_through_join property
[x] Rebecca Schlussel (committed by Rebecca Schlussel) 6c1515dfa6150b654bcc9b406428807289f7dcd5 Revert "fixup! Introduce CostCalculator interface"
[x] Rebecca Schlussel (committed by Rebecca Schlussel) 783c67e6918c4aa5921255306ee20e2d98e417aa Revert "Make unknown costs the default in PlanNodeCostEstimate.Builder"
[x] Rebecca Schlussel (committed by Rebecca Schlussel) 797c72f67d6da8528a7946fb8dc8c1047fab48b3 Revert "Add TestCostCalculator.CostAssertionBuilder#cpu/network/memoryUnknown()"
[x] Rebecca Schlussel (committed by Rebecca Schlussel) 84d7d471a51695cd27f19250e4b764422d46eb7f Support inserting stats for plan unit tests
[x] Rebecca Schlussel (committed by Rebecca Schlussel) 89ccda3daec9c4b922cc3f49b069de827bccaf34 Don't sum distinct values counts in UnionStatsRule
[x] Rebecca Schlussel (committed by Rebecca Schlussel) 8a871d05d7b1db7e4b164d2d0f29c1cca8846dfd Revert "fixup! Introduce CostCalculator interface"
[x] Rebecca Schlussel (committed by Rebecca Schlussel) 93f09519ee333e2f0a0009eaefb2136c83e70a0e Revert "fixup! Add ReorderJoins rule to pick the best join order"
[x] Rebecca Schlussel (committed by Rebecca Schlussel) 9a75c163accb22dee95e8524a08ce9d595b6549e Migrate PushTableWriteThroughUnion
[x] Rebecca Schlussel (committed by Rebecca Schlussel) b834efb4cd4e294e12d043df8e3dcaafc19f3103 Revert "fixup! Remove explicit data_size from PlanNodeStatsEstimate"
[x] Rebecca Schlussel (committed by Rebecca Schlussel) bce3573144d9026f423a76f021171a5a4ab1ba24 Make binaryExpression() handle empty list
[x] Rebecca Schlussel (committed by Rebecca Schlussel) bd2e5e28d57d3d143afa248645d515e79791a49e Revert "fixup! Introduce CostComparator"
[x] Rebecca Schlussel (committed by Rebecca Schlussel) c9b6e763692c0dec473a63983cec0906b53ce21e Add documentation for prepared statements
[x] Rebecca Schlussel (committed by Rebecca Schlussel) cc770a1fddcaf8bee14b15d1cde91f00e41b8a3d Cap aggregation row count at input row count
[x] Rebecca Schlussel (committed by Rebecca Schlussel) d1b701ace04a7cce28e7d422a4b1e1a94c630483 Support passing statsCalculator to RuleAssert
[x] Rebecca Schlussel (committed by Rebecca Schlussel) dd980edd583c3cda02f7c6ecc31a311fd8c292f5 Revert "fixup! Introduce CostCalculator interface"
[x] Rebecca Schlussel (committed by Rebecca Schlussel) e0fb51402c57e89ce129b9bc60da29d8dcef827f Rewrite join filters in SimplifyExpressions
[x] Rebecca Schlussel (committed by Rebecca Schlussel) fdb77eeee572568fdb7d038f2cee70eb1d05cf3b Add methods to flip join and set distribution type

Sanjay Sharma

[x] Sanjay Sharma (committed by Sanjay Sharma) 0676c09fe13b455cf72a23dd4fc2392d17141369 Update docker images version to 20
[x] Sanjay Sharma (committed by Sanjay Sharma) 842e314a6dddfe4ba3af4f296682f7a82e0a4bff Update the version of hadoop-apache2
[x] Sanjay Sharma (committed by Sanjay Sharma) 8d9bd250a27f5863f827d12455e9cf1fe88cb14b Fix failing test for SQL Server
[x] Sanjay Sharma (committed by Sanjay Sharma) 993095a623b6f771cb56f7dbad70ef0dbe372414 Fix error message with invalid catalog and schema
[x] Sanjay Sharma (committed by Sanjay Sharma) b06e0368b6797b08915466acb2ceaea37f7ee06a Add configuration variables for authenticating to Azure Blob

Szymon Matejczyk

[x] Szymon Matejczyk (committed by Łukasz Osipiuk) 50f1f4d7ff6e35e6dde3e5dcb5d0d1977fb57c1b Extend TestReorderJoins with all TPC-H queries

Wojciech Biela

[x] Wojciech Biela (committed by Wojciech Biela) 4ae6be6402945d3ef89e39a00ed92a3b46ebdde9 Add spilled data size to EXPLAIN ANALYZE
[x] Wojciech Biela (committed by Wojciech Biela) 6b176a961cbeffe0f654660fc546de3c981f0c09 Add spilled data size to query summary debug
[x] Wojciech Biela (committed by Wojciech Biela) aa29fe1d8f37b06f3a9b8cadcf2db75abebd8f87 Add spilled data size to Web UI
[x] Wojciech Biela (committed by Wojciech Biela) d0bcf4b46f4ac2784217ee8d2e8589fc039dd1d4 Add spilled data size to QueryStats

Aug 21 '17 18:08 cawallin

Security
--------
* File based system access control plugin that allows you to specify Kerberos principal matching rules.
* Secure internal cluster communication over HTTPS.
* ``ROLE`` support for the Hive connector, including ``CREATE ROLE``,
  ``DROP ROLE``, ``GRANT ROLE``, ``REVOKE ROLE``, ``SET ROLE``, ``SHOW CURRENT ROLES``,
  ``SHOW ROLES`` and ``SHOW ROLE GRANTS`` commands.

Miscellaneous
-------------
* Support prepared statements that are longer than 4K bytes.

Bug Fixes
————
* Fix query failure for ``CHAR`` functions :func:`trim`, :func:`rtrim`, and :func:`substr` when the return value would have trailing spaces under ``VARCHAR`` semantics.

Aug 21 '17 20:08 cawallin

General Changes
-------------
* SHOW STATS shows low and high value for table column

Not sure if we want to list that. I am not convinced that SHOW STATS semantics should stay as we have it now. And I would not make users used to it too much. cc:@findepi

Aug 22 '17 14:08 losipiuk

General Changes
-----------------
* Improve the performance of joins with only non-equality conditions by using
  a nested loops join instead of a hash join.

Hive Changes
----------
* Allow partitions without files for bucketed tables (via hive.empty-bucketed-partitions.enabled)
* Allow multiple files per bucket for bucketed tables (via hive.multi-file-bucketing.enabled). Same number of files per each bucket is required. File names must match Hive naming convention.

Bug Fixes
--------------
* Fix incorrect results when performing comparisons between values of approximate
  data types (``REAL``, ``DOUBLE``) and columns of certain exact numeric types
  (``INTEGER``, ``BIGINT``, ``DECIMAL``).

Aug 22 '17 14:08 losipiuk

Bug Fixes
————
* Fix explain plan for tables partitioned on timestamp column
* Fix execution of several window functions on array and map types
Some window functions taking array or map types (e.g. approx_percentile) were not executing before that patch.

Instrumentation
————
* Add EXPLAIN ANALYZE VERBOSE mode in order to display low-level information about window functions execution
* Add information about rows distribution to EXPLAIN ANALYZE

Aug 22 '17 14:08 maciejgrzybek

General Changes
-----------------
* Enable more join predicates to be pushed down to the source tables

Cost-Based Optimizer
----------------------
* V1 of cost-based join reordering. See :doc:`../optimizer/reorder-joins`
* Replace the distributed_joins property with the join_distribution_type session property or join-distribution-type config property.  Options are AUTOMATIC, REPARTITIONED, and REPLICATED.
* Replace the reorder_joins property with the join_reordering_strategy session property or optimizer.join-reordering-strategy config property.  Options are NONE, ELIMINATE_CROSS_JOINS, and COST_BASED.

Connectors
------------
* Add a TPC-DS connector for generating TPC-DS data on the fly

Aug 22 '17 21:08 rschlussel-zz

Cost-Based Optimizer
----------------------
* Determine join distribution type based on statistics

Documentation
--------------------
Query Optimizer
CLI options

Aug 22 '17 21:08 akshatnair

Hive Changes
--------------
* Fix potential native memory leak when writing tables using RCFile.

Aug 23 '17 19:08 petroav

General Changes
-----------------
* Improve spill support in aggregations
* Support spill in join

Aug 24 '17 11:08 findepi

Bug Fixes
---------
* Fix incorrect empty results for tables filtered on char(x), decimal, date, or timestamp partition columns.

Aug 24 '17 17:08 rschlussel-zz

Hive Changes
------------
* Add a configuration option ``hive.create-non-managed-table-enabled`` using which one can disable creating external Hive tables (default value is ``true``)

General Changes
---------------
* Avoid potentially expensive computation on coordinator by offloading certain plan fragments to worker nodes

Aug 24 '17 21:08 amrutagokhale

Bug Fixes
---------
* Fix query failure when computing statistics on an unpartitioned table in CDH 5.11

Aug 28 '17 21:08 alandpost

@arhimondr @sopel39 @kokosing @anusudarsan @ilfrin Please add release notes by tomorrow. There are a couple of things un-checked from both Artur and Piotr N, make sure the user-visible changes (including config name changes) are documented.

Aug 28 '17 21:08 cawallin

Security
---------
* Support for Kerberos secured internal communication

Bug Fixes
-----------
* Fix incorrect results when `optimizer.optimize-metadata-queries` is enabled for queries involving aggregation over `TopN` and `Filter`.

Aug 28 '17 21:08 anusudarsan

General
----------
 * make sure that spilled data is not corrupted after unspill 

Tpch connector
--------------
 * expose data column statistics

Tpcds connector
-------------
 * expose data (row and column) statistics

Aug 29 '17 06:08 kokosing

@kokosing in what circumstances was spilled data corrupted? @findepi are there any particular bug fixes or performance differences or anything a user would see between the 167-t version of aggregation spill and 179-t version, or is it mostly refactoring to use revokable memory? @rschlussel and @akshatnair -- please give the actual config parameters and options

Aug 29 '17 14:08 cawallin

Security
-----------
* Support LDAP authentication for internal communication
* Support Kerberos authentication for internal communication
* Introduce role management syntax

General
-----------
* Implement distributed sort
* Threat fixed point literals as DECIMAL type by default

Hive Connector
---------------------
* Support role management for Hive connector

Aug 29 '17 17:08 arhimondr

@kokosing in what circumstances was spilled data corrupted?

This is just in case. For example when spilled data was modified by some external process (outside of Presto).

Aug 30 '17 04:08 kokosing

Cost-Based Optimizer
----------------------
 * Statistics calculated by Presto for stages of query plans can be seen in `EXPLAIN` queries results.

Aug 30 '17 13:08 fiedukow

General
--------
* Remove the `experimental.operator-memory-limit-before-spill` config
property and the `operator_memory_limit_before_spill` session property.
* Allow configuring the amount of memory that can be used for merging
spilled aggregation data from disk using the `experimental.aggregation-operator-unspill-memory-limit` config property
or the `aggregation_operator_unspill_memory_limit` session property.

Aug 30 '17 14:08 szymonm

@findepi are there any particular bug fixes or performance differences or anything a user would see between the 167-t version of aggregation spill and 179-t version, or is it mostly refactoring to use revokable memory?

@cawallin, bugfixes - no. Improvements? I guess it can now perform better, but I don't thing we have any numbers to back that.

Aug 31 '17 07:08 findepi

Bug fixes
---------
* Skip unknown costs in EXPLAIN output.
* Fix query failure when ORDER BY expressions reference columns that are used in the GROUP BY clause by their fully-qualified name.

CLI changes
------------
* Fix an issue that would sometimes prevent queries from being cancelled when exiting from the pager.

SPI changes
------------
* Fix regression that broke serialization of SchemaTableName.

Aug 31 '17 14:08 petroav

Bug fixes
-----------
* Handle GROUPING when aggregation expressions require implicit coercions.

Hive changes
-----------------
* Ignore partition bucketing if table is not bucketed. This allows dropping the bucketing from table metadata but leaving it for old partitions.

Sep 11 '17 15:09 petroav

Hi, As for the commit "9d83483 : Consider local exchange in cost calculators". Could you tell me why you think so?

Jan 05 '18 08:01 qin7972

presto presto copied to clipboard

Release notes for 0.179-t

presto
presto copied to clipboard