data-prep-kit icon indicating copy to clipboard operation
data-prep-kit copied to clipboard

[Feature] New transform to do PII detection on code files

Open Bytes-Explorer opened this issue 1 year ago • 6 comments
trafficstars

Search before asking

  • [X] I searched the issues and found no similar issues.

Component

Other

Feature

PII detection and redaction is important step while preparation of data for LLMs. The request is to build a new transform that can perform PII detection on code entities.

Are you willing to submit a PR?

  • [ ] Yes I am willing to submit a PR!

Bytes-Explorer avatar May 03 '24 15:05 Bytes-Explorer

I am willing to work on this card. Is there any deadline to work on for this card? @Bytes-Explorer

SowmyaLR avatar Jul 07 '24 11:07 SowmyaLR

Thanks @SowmyaLR for your interest. Couple of weeks should be a good time frame.

Bytes-Explorer avatar Jul 08 '24 04:07 Bytes-Explorer

@SowmyaLR We are doing a demo in two weeks where this module can be showcased, if ready. Do you think you can raise a PR in the next couple of days? Please feel free to ask for help.

Bytes-Explorer avatar Jul 24 '24 15:07 Bytes-Explorer

@Bytes-Explorer I can raise PR by next week. Yeah had some issues and figured it out. I hope this can also go along for the demo 🤞

SowmyaLR avatar Jul 26 '24 05:07 SowmyaLR

Awesome @SowmyaLR ! cc @shivdeep-singh-ibm As and when this PR is raised, lets fast track the review process on it.

Bytes-Explorer avatar Jul 26 '24 06:07 Bytes-Explorer

@Bytes-Explorer @shivdeep-singh-ibm Raised PR for this. I have added few comments in PR description. Need suggestions from people to know how to resolve that.

SowmyaLR avatar Jul 31 '24 14:07 SowmyaLR