Irene Dea
Irene Dea
Depends on https://github.com/JetBrains/kotlin/pull/4618
### Feature request Is there a way to disable execution of dataset loading script using `load_dataset`? This is a security vulnerability that could lead to arbitrary code execution. Any suggested...
Previously, large files are read entirely at once via `file.read()`. This reads the file and tokenizes in chunks.
### System Info peft 0.12.0 transformers 4.43.1 ### Who can help? _No response_ ### Information - [ ] The official example scripts - [ ] My own modified scripts ###...
# What does this PR do? # What issue(s) does this change relate to? # Before submitting - [ ] Have you read the [contributor guidelines](https://github.com/mosaicml/composer/blob/main/CONTRIBUTING.md)? - [ ] Is...