pytorch-model-parallel icon indicating copy to clipboard operation
pytorch-model-parallel copied to clipboard

Published 20 hours ago • verified publisher icon bindog
→

Metadata

A memory balanced and communication efficient FullyConnected layer with CrossEntropyLoss model parallel implementation in PyTorch

Results 2 pytorch-model-parallel issues
Sort by recently updated
recently updated
newest added

请问@amp.float_function可以去掉吗，我使用发现有inf问题

请问@amp.float_function可以去掉吗，我使用发现有inf问题

shufangxun avatar shufangxun

RuntimeError: Could not run 'aten::nonzero' with arguments from the 'SparseCUDA' backend. 'aten::nonzero' is only available for these backends: [CPU, CUDA, Autograd, Profiler, Tracer].

pytorch1.6: cuda10.2 titan rtx * 4 output = self.am_branches[i](x.cuda(i), labels[i]) File "/home/derron/anaconda3/lib/python3.8/site-packages/torch/nn/modules/module.py", line 722, in _call_impl result = self.forward(*input, **kwargs) File "/home/derron/arcface-pytorch/head/metrics_parallel.py", line 102, in forward output[index] = phi[index] RuntimeError:...

derronqi avatar derronqi

← Metadata

76
Stars
19
Forks
Watchers

Owner

verified publisher icon bindog

Metadata

A memory balanced and communication efficient FullyConnected layer with CrossEntropyLoss model parallel implementation in PyTorch

Back