Shahrokh Daijavad

@shivdeep-singh-ibm Thanks for making the file a lot better by adding new lines. Sorry for nitpicking, but there is still a problem with the indention of bullets and sub-bullets, as...

@Bytes-Explorer and @shivdeep-singh-ibm . This is mostly done. The problem is still with the indentation of sub-bullets in this page: https://ibm.github.io/data-prep-kit/data-processing-lib/doc/architecture/) (compare with this page: https://github.com/IBM/data-prep-kit/blob/dev/data-processing-lib/doc/architecture.md in which sub-bullets in...

@agoyal26 This is still an issue. For instance, see this: https://quay.io/repository/dataprep1/data-prep-kit/noop-ray/manifest/sha256:8d48e2d7616a33108b5ba4c83a88ab80d86e9a18e8102dd9b196dfe08e360307?tab=vulnerabilities We did have a meeting with the Quay team (Red Hat guys) about this, and although this issue was...

@blublinsky Is this new version completely backward compatible with the old version of code2parquet?

Thanks, @blublinsky. Perfect! From a technical point of view, David needs to approve, but a note to myself that if this is approved, the example Jupyter notebook for code that...

Thanks for the clarifications, @nirmdesai. Since we now want to ingest more than just text files, doing Any2Parquet as a separate module is the best path forward. In defense of...

@touma-I The code that Boris developed under this PR is valuable because it is a "generalization" of what we have with the current code2parquet. However, in order not to run...

Thank you, @sungeunan-ibm for doing this so quickly! Please resolve the conflicts.

Thanks, @sungeunan-ibm @daw3rd Do we care about the timestamps not matching? Do other transforms behave the same way?

@sungeunan-ibm As you can see, @touma-I has now added issue #559 as a priority. This would take precedence over the Ray-scalable version of this transform. If you can resolve the...