Corwin Joy
Corwin Joy
Hello. I am working on a project where we are building Pytorch Gaussian Process Models and converting them into ONNX format. ([https://gpytorch.ai/](https://gpytorch.ai/)). At runtime, some of these models need to...
Fix performance degradation when restoring optimizer from checkpoint. This fix is to address the issue discussed in https://github.com/Lightning-AI/pytorch-lightning/issues/19955 Fixes #19955 This fix is also due to the related isssue in...
## What does this PR do? Pursuant to https://github.com/Lightning-AI/pytorch-lightning/issues/19955 add an extended test for _optimizer_to_device that explicitly tests moving the optimizer across devices. Fixes #19955 Before submitting - Was this...
Intent: Add a function to create a new array column from a set of input columns (similar to concat_list) as discussed in https://github.com/pola-rs/polars/issues/18090 and https://github.com/pola-rs/polars/issues/8510. This is a draft PR...
[Google Doc Link for Comments](https://docs.google.com/document/d/1MUg1J7u5VdLkgejJ4ybzfZt1OmwhQkq2iGPxsn4gqLI/edit?usp=sharing) # Description Support Parquet Modular Encryption in delta-rs. ([https://parquet.apache.org/docs/file-format/data-pages/encryption/](https://parquet.apache.org/docs/file-format/data-pages/encryption/)) # Use Cases: 1. Client side encryption for enhanced security. 2. Encryption of selected columns to...
## Which issue does this PR close? - Closes #15216. ## What changes are included in this PR? This PR adds support for encryption in DataFusion’s Parquet implementation. The changes...
# Description Add support for creation/management of shallow clones (feature since 2.3) via delta-rs with python bindings. # Related Issue(s) Closes issue #2456 # Documentation **Delta Lake Clone** https://delta.io/blog/delta-lake-clone/ **Use...
# Description This PR adds encryption support and other advanced file options to `delta-rs` by implementing a comprehensive framework for file format settings. The changes enable users to configure encryption...
# Description 1. Set a flag to turn off the deprecation warnings. They clutter the error messages and we can turn this back on when we are ready to remove...
### Is your feature request related to a problem? In working with the project to add enhancements, I've been struggling with the large number of warnings returned by ``` make...