data-prep-kit icon indicating copy to clipboard operation
data-prep-kit copied to clipboard

[Feature] Create new transform to ingest markdown (.md) files and convert to parquet format.

Open Bytes-Explorer opened this issue 1 year ago • 2 comments

Search before asking

  • [X] I searched the issues and found no similar issues.

Component

Transforms/Other

Feature

Convert .md files to parquet files so that they can be processed by data prep pipeline This is the preferred input for InstructLab

Are you willing to submit a PR?

  • [ ] Yes I am willing to submit a PR!

Bytes-Explorer avatar May 23 '24 10:05 Bytes-Explorer

Hi, I would like to work on this. Can I be assigned to this issue?

bogdanscode avatar Jun 26 '24 02:06 bogdanscode

Sure, I have assigned the issue to you. When you are ready, pls raise a PR and assign @daw3rd as a reviewer. Thanks!

Bytes-Explorer avatar Jun 26 '24 04:06 Bytes-Explorer