Hima Patel

Lets follow what we have here https://github.com/IBM/data-prep-kit/tree/dev/examples for order. All the existing test datasets we have can be used. Let me know if you need me to point you to...

@revit13 It can be placed right after code quality.

@revit13 @roytman It would be nice if a user can change the order as per their wish. They can provide input in a JSON. Is that kind of automation possible?...

Thanks Alexey, lets make a new issue for the automation pipeline generation, so that we dont miss it.

We need to enhance the transform such that every instruction pair becomes one row in the parquet files.

Sure, I have assigned the issue to you. When you are ready, pls raise a PR and assign @daw3rd as a reviewer. Thanks!

@shahrokhDaijavad @daw3rd I would close this issue and open a new one for the Ray version. I agree with David that this should be moved to language folder

@shivdeep-singh-ibm Has this been done?

Needed for release 1

These are two separate functionalities and we need to think from a view of how an end user will use it. There can be many transforms that will use filtering...