RuntimeError: CUDA error: initialization error

[lognat0704]

I type python train_64.py --no_tensorboard and run it... I see the 'Initialized models...' print out and then I got a RuntimeError: CUDA error: initialization error. I am pretty sure my pyTorch version is '1.1.0'. Welcome to any solution. Thank you.

Following is the wrong feedback I got:

Traceback (most recent call last): File "train_64.py", line 402, in <module> main() File "train_64.py", line 341, in main real, y = sample_from_data(args, device, train_loader) File "train_64.py", line 199, in sample_from_data real, y = next(data_loader) File "/vm/data/rdata/shared/conda_envs/fastaiv1/lib/python3.6/site-packages/torch/utils/data/dataloader.py", line 582, in __next__ return self._process_next_batch(batch) File "/vm/data/rdata/shared/conda_envs/fastaiv1/lib/python3.6/site-packages/torch/utils/data/dataloader.py", line 608, in _process_next_batch raise batch.exc_type(batch.exc_msg) RuntimeError: Traceback (most recent call last): File "/vm/data/rdata/shared/conda_envs/fastaiv1/lib/python3.6/site-packages/torch/utils/data/_utils/worker.py", line 99, in _worker_loop samples = collate_fn([dataset[i] for i in batch_indices]) File "/vm/data/rdata/shared/conda_envs/fastaiv1/lib/python3.6/site-packages/torch/utils/data/_utils/collate.py", line 68, in default_collate return [default_collate(samples) for samples in transposed] File "/vm/data/rdata/shared/conda_envs/fastaiv1/lib/python3.6/site-packages/torch/utils/data/_utils/collate.py", line 68, in <listcomp> return [default_collate(samples) for samples in transposed] File "/vm/data/rdata/shared/conda_envs/fastaiv1/lib/python3.6/site-packages/torch/utils/data/_utils/collate.py", line 59, in default_collate return torch.tensor(batch)