David Wood

The new PII PR #471 is pushing our disk space requirements over a threshold causing failures unrelated to PII. We need to find a way to reduce disk space usage...

[Feature] Develop ability to run ci/cd testing only on the portion of repo that has changed and its dependencies

1

### Search before asking - [X] I searched the [issues](https://github.com/IBM/data-prep-lab/issues) and found no similar issues. ### Component Other ### Feature WOuld be nice to only run tests on those components...

### Search before asking - [X] I searched the [issues](https://github.com/IBM/data-prep-lab/issues) and found no similar issues. ### Component Library/core ### Feature We have recently added a --num_processors option to the python...

### Search before asking - [X] I searched the [issues](https://github.com/IBM/data-prep-lab/issues) and found no similar issues. ### Component Transforms/Other ### Feature The PR #461 is being approved with the caveat that...

[Bug] text_encoder tests are not verifying the resulting embeddings to avoid floating point rounding errors

3

### Search before asking - [X] I searched the [issues](https://github.com/IBM/data-prep-lab/issues) and found no similar issues. ### Component Transforms/Other ### What happened + What you expected to happen The current tests...

### Search before asking - [X] I searched the [issues](https://github.com/IBM/data-prep-lab/issues) and found no similar issues. ### Component Transforms/Other ### Feature The readme for doc_quality does not describe/list all the columns...

### Search before asking - [X] I searched the [issues](https://github.com/IBM/data-prep-lab/issues) and found no similar issues. ### Component Transforms/Other ### What happened + What you expected to happen Building the venv...

initial pass at a pipelining transform

4

## Why are these changes needed? We would like to define a sequence of transforms using python and run the sequence as any other transform would be run. ## Related...

[Feature] Enable transform() to terminate all processing of documents across all instances

1

### Search before asking - [X] I searched the [issues](https://github.com/IBM/data-prep-lab/issues) and found no similar issues. ### Component Library/core ### Feature Today we allow/expect exceptions to be thrown in a tranforms...

### Search before asking - [X] I searched the [issues](https://github.com/IBM/data-prep-lab/issues) and found no similar issues. ### Component CI/CD, Transforms/Other ### What happened + What you expected to happen Python launcher...