ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard

[WIP]Orca: Add ncf_orca.py with spark dataframe

Open Chaselzxy opened this issue 1 year ago • 2 comments

Description

Read the data set in ncf_orca.py into spark dataframe, process it, generate negative samples, and change the model to a binary model.

1. Why the change?

Support the operation of data in spark dataframe.

2. User API changes

3. Summary of the change

  1. Read the data in the data set(.csv) into spark dataframe.
  2. Perform data processing and statistics on the data in spark dataframe.
  3. Generate several negative samples.
  4. Change the model to a binary model.

4. How to test?

  • [ ] Document test

5. New dependencies

Chaselzxy avatar Sep 08 '22 20:09 Chaselzxy

Do we need a README.md for each tutorial scripts?

lalalapotter avatar Sep 19 '22 02:09 lalalapotter

Do we need a README.md for each tutorial scripts?

Not at this moment. Probably add a guide after all tutorials are finished :)

hkvision avatar Sep 19 '22 02:09 hkvision