presto icon indicating copy to clipboard operation
presto copied to clipboard

Enable ctas with unmanaged hive table

Open rguillome opened this issue 3 years ago • 24 comments

Test plan - TU to create an table as a select with an external location with presto-hive plugin and a manual TI to test the creation under EMR, using a Glue catalog and seeing the results in S3 and Athena

This PR allow the creation of an unmanaged table (with external location specified) as a select result (CTAS) with Hive Plugin

Co-authored-by: alexjo2144 [email protected]

Fix: #15946

Based on trino PR #2669 trino PR #3755

== RELEASE NOTES ==

Hive Changes
* Add ability to create table with an external location when the catalog configuration 
  ``hive.non-managed-table-creates-enabled`` and ``hive.non-managed-table-writes-enabled`` set to ``true``

rguillome avatar Apr 23 '21 08:04 rguillome

@rguillome This is cherry pick of https://github.com/trinodb/trino/pull/3755 and https://github.com/trinodb/trino/pull/2669. Please add co-author. Thanks

v-jizhang avatar Apr 23 '21 16:04 v-jizhang

Hi @v-jizhang

This PR is still waiting approval and I just saw another PR with the same purpose (#16147). Is this one won't be merged anymore ?

rguillome avatar May 31 '21 10:05 rguillome

Hi @v-jizhang

This PR is still waiting approval and I just saw another PR with the same purpose (#16147). Is this one won't be merged anymore ?

Hi @rguillome, we happened to address this recently in our distro so I raised a PR not knowing there's already some WIP on this. I will close the other PR.

ashishtadose avatar Jun 07 '21 04:06 ashishtadose

Thanks @ashishtadose ! I hoped one of them would be approved in few days no matter what the contributor is. I have a tool release waiting for this since some weeks.

rguillome avatar Jun 09 '21 17:06 rguillome

@rguillome Please squash the 6 commits in the PR (some of them are merge commits) Also refer to Release Notes wiki : https://github.com/prestodb/presto/wiki/Release-Notes-Guidelines The current PR release notes does not match what we need.

ajaygeorge avatar Jun 09 '21 21:06 ajaygeorge

Hi @ajaygeorge I made all the changes: Hope this is ok now :smirk:

rguillome avatar Jun 10 '21 16:06 rguillome

Hi @ajaygeorge,

Please let me know what's why Facebook integration is failing (I thought I have seen succeed a day before...) and what's missing/wrong about this PR.

rguillome avatar Jun 16 '21 12:06 rguillome

@rguillome can you try triggering the build again by doing an git amend and push with no changes. I think there were some permission issues which was causing errors.

ajaygeorge avatar Jun 16 '21 17:06 ajaygeorge

Hi @ajaygeorge ,

I made the push force 5 days ago with no more luck.

Regards,

rguillome avatar Jun 21 '21 13:06 rguillome

@cocozianu can you please take a look at why the facebook integration build is not working. Looks like a new build is not getting fired for this PR.

ajaygeorge avatar Jun 21 '21 17:06 ajaygeorge

Hi @ajaygeorge and @cocozianu

There is still a facebook integration error on this PR. Please let me know if I can change something to help going through this step.

Regards,

rguillome avatar Jul 06 '21 11:07 rguillome

Hi @rguillome it's cleared now, sorry for the inconvenience.

cocozianu avatar Jul 06 '21 22:07 cocozianu

Hi @cocozianu : what's the next step for this PR, how can it be handled to be merged ?

Regards,

rguillome avatar Jul 16 '21 14:07 rguillome

Hi @cocozianu : what's the next step for this PR, how can it be handled to be merged ?

Regards,

Please up !

rguillome avatar Aug 02 '21 21:08 rguillome

Hi @ajaygeorge and @cocozianu

Is there any chance this PR would be integrated soon ?

rguillome avatar Aug 19 '21 11:08 rguillome

@aweisberg Do you think we can merge for the next release if it looks good to you as well?

rohanpednekar avatar Oct 04 '21 18:10 rohanpednekar

Hi there,

Happy new year to Presto's team 🎉

Is there a chance that PR would be merge ? Time is passing and I would like to avoid maintaining a fork with work to integrate incoming changes in my current production version of PrestoSQL

Please let me know what do you plan for it

Regards

rguillome avatar Jan 07 '22 08:01 rguillome

This doesn't bring in all of the tests from Trino so maybe we should go with #16147?

aweisberg avatar Jan 07 '22 16:01 aweisberg

This doesn't bring in all of the tests from Trino so maybe we should go with #16147?

As mentionned in the PR first comment, it was deliberate since a CTAS is a table creation from query results and not writing to an existing table but perhaps it's better to stick to trino's view.

I will close this one and go to the #16147

rguillome avatar Jan 10 '22 10:01 rguillome

This doesn't bring in all of the tests from Trino so maybe we should go with #16147?

As mentionned in the PR first comment, it was deliberate since a CTAS is a table creation from query results and not writing to an existing table but perhaps it's better to stick to trino's view.

I will close this one and go to the #16147

Hi @aweisberg,

As the other PR #16147 introducing CTAS has not changed since your last comment, I managed to make this one compliant with the missings tests (there is one test more than the #16147 in the product-test module).

Rebase to the current master has been made too. Please let me know if there is anything missing yet.

rguillome avatar Feb 15 '22 13:02 rguillome

Hey @yingsu00, could you please help with the final revive and get this merged? Thanks!

rohanpednekar avatar Feb 17 '22 17:02 rohanpednekar

Hi, any news from this one please ?

rguillome avatar Mar 22 '22 14:03 rguillome

@yingsu00 Friendly ping. Please review this PR. Thank you!

prestoprobot avatar Feb 20 '23 17:02 prestoprobot

Hi, it's been a long time now. Let me know if there is a chance that it would be merged...

rguillome avatar May 11 '23 08:05 rguillome