Butch Landingin

icon indicating an email [email protected]

icon location Philippines icon location My current interests are in applying data science, machine learning and geospatial applications for sustainability solutions

Results 6 comments of Butch Landingin

batch transforms for vision are slow

Focusing on affine transforms (zoom, warp, rotate) + random resize crop GPU - they seem to cause much of the slowdown. Normalize and lighting (contrast and brightness) transforms dont seem...

batch transforms for vision are slow

Will monitoring [this issue filed with the pytorch-xla team](https://github.com/pytorch/xla/issues/2405) as resolving it requires an update to pytorch-xla itself.

batch transforms for vision are slow

Update: as of 2020/12/14, using updated Pytorch 1.7 XLA and latest fastai (2.1.8) and fastai_xla_extensions (0.0.4) packages, training with batch transforms is still slower than training without batch transforms. *...

batch transforms for vision are slow

Partially mitigated by this enhancement: https://github.com/butchland/fastai_xla_extensions/issues/11 Leaving it open awaiting final action for additional lowerings in Pytorch XLA to support batch transforms

Language model trainer is very slow or not finishing fit_one_cycle for 1 epoch

The text_classifier_learner using AWD_LSTM as the model actually completes, but is very slow Training an AWD_LSTM is even slower for TPU compared to a CPU (and GPU of course) Notebooks...

Language model trainer is very slow or not finishing fit_one_cycle for 1 epoch

Referencing [issue submitted to pytorch xla team for help in resolution](https://github.com/pytorch/xla/issues/2422). Also including `debug_run` logs submitted for the issue: * single_profile_forward - [log file](https://github.com/pytorch/xla/files/5070392/single_profile_forward.tar.gz) : [script](https://gist.github.com/butchland/d32578f8fca278a498db0ae231476765) * single_profile - [log...