Kevin Tse
Kevin Tse
Stack from [ghstack](https://github.com/ezyang/ghstack): * #728 * __->__ #746 By creating a deep copy of the input `ReadingService` during the initialization of `DataLoader2`, we allow the instance of `ReadingService` to store...
### 🚀 The feature Add a progress bar to remote DataPipes that will be shown in the terminal to display the status of the operation. We can potentially use [`tqdm`](https://github.com/tqdm/tqdm)...
### 🚀 The feature 1. Store usage statistics in `Prefetcher` - By tracking statistics within `Prefetcher`, we can reasonably determine whether upstream processes or downstream processes are faster. For example,...
### 🚀 The feature Mitigate false positive test failures related to Google Drive. Some possible solutions are: 1. Move the files to a location that is still on GDrive but...
### 📚 The doc issue Similar to #1104, `DataLoader2` has built-in functionality to set random seed for DataPipes when they have `set_seed` method implemented. https://github.com/pytorch/data/blob/main/torchdata/dataloader2/graph/settings.py#L22 We should provide official guidance...
### 🚀 The feature Given that we will not support for Python 3.7 in future releases, we can utilize [`multiprocessing.shared_memory`](https://docs.python.org/3/library/multiprocessing.shared_memory.html#module-multiprocessing.shared_memory) that was introduced in Python 3.8. It can potentially replaces...
### 🚀 The feature Provide a mechanism to catch exception raised by a previous DataPipe and retry. These can be related but separate DataPipes. Non-DataPipes implementation should also be considered....
## 🚀 Feature We have many tests for existing DataPipes (both in PyTorch Core and TorchData). However, over time, they have become less organized. Moreover, as the [testing requirements](https://github.com/pytorch/pytorch/wiki/DataPipes-testing-requirements) expand,...
### 🚀 The feature Add an `Adapter` for `pin_memory` feature, similar to enable/disable `shuffle`. ### Motivation, pitch This allows users to enable/disable/change device of `PinMemoryIterDataPipe` without making changes to the...
## 🕋 Website ## To Reproduce Steps to reproduce the behavior (if applicable): 1. Go to the main page, you can see 'Docs' expand to show all the ecosystem libraries:...