data-juicer
data-juicer copied to clipboard
Add sentence_augmentation_mapper
Augment sentences using LLMs. Hyperparameters:
- system_prompt: system prompt;
- task_sentence: the instruction for the current task;
- max_new_tokens: the maximum number of new tokens generated by the model;
- sampling_params: sampling parameters for text generation.
This PR is marked as stale because there has been no activity for 21 days. Remove stale label or add new comments or this PR will be closed in 3 day.
Close this stale PR.
Close due to this PR was included in PR #550