David Wood comments

Results 57 comments of


                                            David Wood

[Bug] pdf2parquet is now failing ci/cd builds

i'm still getting this SSL issue, on mac M1. Anyone else with an M1 want to try?

[Bug] pdf2parquet is now failing ci/cd builds

This seems to be a local mac/ssl/python configuration issue as I'm seeing this on unrelated efforts with python on mac.

[Bug] pip install data-prep-toolkit-transforms[all]==0.2.2 gets error

Sadly `pip install wheel` is only a fix on mac. This did not work on redhat, for example.

[Feature] Allow selected metadata fields to be ignored during tests.

This will need to be done for both the pure transform test and the launcher-based tests.

pipeline transform

> > Can we run a pipeline outside of the runtime/launcher? If so, I'd like to see a test or other example of how this is done? If not, we...

[Feature] Publish data-prep-kit core and transforms NIGHTLY into pypi

In general, pypi does not seem to allow overwriting of artifacts. Correct me if someone knows otherwise. This would mean a data-based versions such data-prep-kit:08-01-2024. Doable, but then we would...

[Feature] Provide an operator that loads files content to parquet

So perhaps we need a set of extensions specified to zip2parquet to configure which files from the zip are imported - 1 file per row with a column indicating the...