vertx-sql-client icon indicating copy to clipboard operation
vertx-sql-client copied to clipboard

COPY command

Open yonigibbs opened this issue 6 years ago • 20 comments

Hi @vietj. Is it possible to run a COPY command through reactive-pg-client? Specifically, to load a CSV of data in what I believe is the most efficient way to load a large number of records into the system. I believe the CSV has to either be on the DB server itself (which we'd like to avoid if possible), so can we in some way use the STDIN argument of the COPY command to provide the CSV file over the wire to it?

Thanks!

yonigibbs avatar Aug 22 '18 16:08 yonigibbs

@yonigibbs no it has not been implemented as far as I know, this is a part of the postgresl protocol I'm not familiar (yet) with - but it is planned to be implemented

vietj avatar Aug 22 '18 16:08 vietj

copy seems indeed to be a stream oriented operation (in both ways), I believe it can be implemented fairly easily.

vietj avatar Aug 22 '18 16:08 vietj

Great, thanks. We'll keep an eye out for it being implemented in future.

yonigibbs avatar Aug 22 '18 16:08 yonigibbs

@vietj did anyone volunteer for this? Otherwise, I think we'd like to take it on

davidzzzzz avatar Oct 30 '18 00:10 davidzzzzz

@davidzzzzz it's all yours if you take it

vietj avatar Oct 30 '18 07:10 vietj

Great, on it

davidzzzzz avatar Oct 30 '18 19:10 davidzzzzz

@vietj Here's the direction I've taken with supporting COPY FROM operations. Please provide feedback before I add more documentation and polish. Thanks!

https://github.com/reactiverse/reactive-pg-client/pull/205

davidzzzzz avatar Nov 14 '18 02:11 davidzzzzz

Hi @vietj and @davidzzzzz, I'm really interested in experimenting with COPY FROM. As #205 is closed what's the current status?

bchapuis avatar Jun 06 '19 20:06 bchapuis

Yeah same here @vietj - what exactly happened with the PR that added the COPY command? IT seems it got swallowed by the 3.8 release. Any plans to bring it back?

Globegitter avatar Sep 07 '19 19:09 Globegitter

@Globegitter I think it simply got lost, it should be rebased on latest 3.8 indeed

vietj avatar Sep 08 '19 09:09 vietj

If there's interest @vietj, I'm happy to revive this

davidzzzzz avatar Sep 09 '19 02:09 davidzzzzz

yes there is, sorry for letting this dormant

On 9 Sep 2019, at 04:35, David Zuckerman [email protected] wrote:

If there's interest @vietj https://github.com/vietj, I'm happy to revive this

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/eclipse-vertx/vertx-sql-client/issues/153?email_source=notifications&email_token=AABXDCXZKPKTWJZ6XDEU23TQIWY6PA5CNFSM4FQ73ASKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD6GCMRA#issuecomment-529278532, or mute the thread https://github.com/notifications/unsubscribe-auth/AABXDCQP6PHU7F7KMFHHE7LQIWY6PANCNFSM4FQ73ASA.

vietj avatar Sep 09 '19 06:09 vietj

@davidzzzzz any chance this can be revived again?

Globegitter avatar Oct 17 '19 11:10 Globegitter

@Globegitter sorry about that, my day job got in the way :) Hoping to get to this shortly

davidzzzzz avatar Oct 18 '19 17:10 davidzzzzz

@davidzzzzz No worries, I know the feeling :)

Globegitter avatar Oct 21 '19 09:10 Globegitter

I know it is annoying to bump this just to ask, but you guys got the time to revive this?

Ryaryu avatar Mar 10 '20 20:03 Ryaryu

Hello everyone, I would also love this feature to be included. Any chance we get this?

jlnme avatar Apr 23 '21 04:04 jlnme

I set help-wanted on this issue as we need a contributor to step up and implement it.

vietj avatar Apr 23 '21 04:04 vietj

Hello @vietj

Are you aware if anyone is working on this at the moment? If no, I would like to assign myself to this.

psolomin avatar Apr 15 '23 22:04 psolomin

nobody is currently contributing this, so you can definitely take it.

you should come on our discord to discuss the feature

On Sun, Apr 16, 2023 at 12:23 AM psolomin @.***> wrote:

Hello @vietj https://github.com/vietj

Are you aware if anyone is working on this at the moment? If no, I would like to assign myself to this.

— Reply to this email directly, view it on GitHub https://github.com/eclipse-vertx/vertx-sql-client/issues/153#issuecomment-1509989627, or unsubscribe https://github.com/notifications/unsubscribe-auth/AABXDCVEMX64763YLOIQ33LXBMNXFANCNFSM4FQ73ASA . You are receiving this because you were mentioned.Message ID: @.***>

vietj avatar Apr 16 '23 07:04 vietj