ipex-llm
ipex-llm copied to clipboard
[WIP]Orca: Add ncf_orca.py with spark dataframe
Description
Read the data set in ncf_orca.py
into spark dataframe, process it, generate negative samples, and change the model to a binary model.
1. Why the change?
Support the operation of data in spark dataframe.
2. User API changes
3. Summary of the change
- Read the data in the data set(.csv) into spark dataframe.
- Perform data processing and statistics on the data in spark dataframe.
- Generate several negative samples.
- Change the model to a binary model.
4. How to test?
- [ ] Document test
5. New dependencies
Do we need a README.md for each tutorial scripts?
Do we need a README.md for each tutorial scripts?
Not at this moment. Probably add a guide after all tutorials are finished :)