embulk-output-jdbc icon indicating copy to clipboard operation
embulk-output-jdbc copied to clipboard

support cratedb

Open cmdares opened this issue 7 years ago • 3 comments

Crate is a new big data solution for the Internet of things, which has been used in many industries. it is hoped that the embulk-output-jdbc can support the efficient ETL solution for cratedb, including insert and update. db ref: https://crate.io/ bulk insert(update) ref: https://crate.io/docs/crate/reference/en/latest/sql/statements/insert.html#id4

Similar to postgre sql feature https://github.com/embulk/embulk-output-jdbc/issues/131 thanks.

cmdares avatar Aug 22 '18 05:08 cmdares

Hello, @cmdares

Could you try embulk-output-jdbc + JDBC Driver for Crate ?

General database may possible to use JDBC plugin. Otherwise, someone needs to develop a new plugin.

hiroyuki-sato avatar Aug 22 '18 05:08 hiroyuki-sato

https://crate.io/docs/crate/reference/en/latest/general/dml.html#upserts-on-duplicate-key-update upsert feature like mysql and postgresql. So it's still useful.

cmdares avatar Oct 01 '18 15:10 cmdares

Hello, @cmdares

Does this mean you need cratedb plugin? Have you ever tried embulk-output-jdbc + JDBC Driver for Crate ? If the plugin doesn't work, it's a good chance for you to create a new plugin by yourself.

hiroyuki-sato avatar Oct 03 '18 00:10 hiroyuki-sato