ibis
ibis copied to clipboard
feat: add **options to pyspark backend create_table
Is your feature request related to a problem?
The pyspark saveAsTable method has **options, but I don't think I can use them in create_table.
What is the motivation behind your request?
I want to be able to use the mergeSchema option when writing delta tables.
Describe the solution you'd like
I think **options could just be added to create_table and passed here (may require subsequent places as well to accommodate different modes, not sure). I'm happy to take a stab at a PR, but wanted to log the issue in case there's a good reason.
What version of ibis are you running?
10.0.0
What backend(s) are you using, if any?
pyspark
Code of Conduct
- [x] I agree to follow this project's Code of Conduct
Hello, is anyone working on this issue?
@mark-druffel @RohanTemgire please comment on that linked PR, neither me nor Phillip know much about pyspark