flex-dm icon indicating copy to clipboard operation
flex-dm copied to clipboard

How to Crello dataset revision 4.0.0 or 5.0.0 to flex-dm project

Open shin-wn opened this issue 1 year ago • 0 comments

I'm interested in using the recent Crello dataset with the flex-dm project. Specifically, I'm looking at revisions 4.0.0 or 5.0.0 of the Crello dataset available on Hugging Face.

My question is: Is there a way to adapt these newer versions of the Crello dataset to work with the training and evaluation implementation in the flex-dm project?

If possible, could you provide some guidance on:

  1. Any necessary data preprocessing steps?
  2. Changes required in the data loading pipeline?
  3. Any modifications needed in the model architecture or training process?

Any information or pointers would be greatly appreciated. Thank you for your time and assistance!

shin-wn avatar Sep 26 '24 04:09 shin-wn