ibis icon indicating copy to clipboard operation
ibis copied to clipboard

feat: add **options to pyspark backend create_table

Open mark-druffel opened this issue 8 months ago • 2 comments

Is your feature request related to a problem?

The pyspark saveAsTable method has **options, but I don't think I can use them in create_table.

What is the motivation behind your request?

I want to be able to use the mergeSchema option when writing delta tables.

Describe the solution you'd like

I think **options could just be added to create_table and passed here (may require subsequent places as well to accommodate different modes, not sure). I'm happy to take a stab at a PR, but wanted to log the issue in case there's a good reason.

What version of ibis are you running?

10.0.0

What backend(s) are you using, if any?

pyspark

Code of Conduct

  • [x] I agree to follow this project's Code of Conduct

mark-druffel avatar Mar 12 '25 16:03 mark-druffel

Hello, is anyone working on this issue?

RohanTemgire avatar Apr 01 '25 05:04 RohanTemgire

@mark-druffel @RohanTemgire please comment on that linked PR, neither me nor Phillip know much about pyspark

NickCrews avatar Apr 03 '25 13:04 NickCrews