pytorch-styleguide

pytorch-styleguide copied to clipboard

```python def multi_gpu(model): device = torch.device('cuda' if torch.cuda.is_available() else 'cpu') if device != torch.device('cpu') and torch.cuda.device_count() > 1: model = nn.DataParallel(model) print(f'Using {torch.cuda.device_count()} GPUs!') elif device == torch.device('cuda'): print(f'Using 1...

cenjinglun

The style guide started as a small side project for personal use. We then started using it within our company. Now, I heard from friends that some of the largest...

IgorSusmelj

Should we use BackgroundGenerator when we've had DataLoader?

6

I really enjoy this guide! However, I am not sure what the advantage of `prefetch_generator` is. It seems that DataLoader in pytorch has already supported prefetching. Thank you!

yzhang1918

Review examples in README

3

Hi Igor, First of all, thank you for the repo, super cool and very usefull. Hovewer, I am sorry but I have to say it, all the **examples in the...

FrancescoSaverioZuppichini

Can you provide a complete engineering code according to this specification?

2

I really appreciate your tutorial, it would be nice to have a complete example.

chuxiang93

Don't use plain forward in python

3

In opposite to what you say in the section > A nn.module can be used on input data in two ways whereas the latter one is commonly used for better...

justusschock

Some ideas for improvement + Do you need a collaborator?

1

Hi Team, I've been thinking about doing something like this and you guys already have a great head start. I'd love to be a collaborator or at least a regular...

dorukhansergin

After using the prefetch generator, the dataloader is not automatically released after each epoch under multi-gpu-DDP, resulting in a memory leak, has this been encountered by anyone?

LiquidTaeJa