intake-esm
intake-esm copied to clipboard
Add write support for parquet
Change Summary
- In #728, I added support for reading
.parquetfiles, but completely forgot to add support for serialising catalogs back to them. This PR fixes that. - Cleans up an issue with available compression associated with that PR.
- Tests we can deserialise and reserialise (from {.csv,.parquet} => {.csv, .parquet}).
- Adds
write_kwargs, a laread_kwargsin #728, plus soft deprecation of theto_csv_kwargskeywods argument when serialising.
N.B: Deserialisation & reserialisation tests round trip twice, it looks like the defaults for how empty catalog field options (in catalog.json) have changed since that catalog was created.
Checklist
- [x] Unit tests for the changes exist
- [x] Tests pass on CI
- [ ] Documentation reflects the changes where applicable
- [ ] Will need to update
ecgtoolsfirst to allow for quickstart guide update. - [x] Relevant API reference bits updated.
- [ ] Will need to update
I will no longer make pull requests when jetlagged.