Hi, I'm encountering the below error while running the code for few-shot training:
***** Running training *****
Num Iters: 4
Batch size: 8
Num steps: 80
Epoch: 0%| | 0/20 [00:12<?, ?it/s]
Traceback (most recent call last):
File "train_task.py", line 381, in
main()
File "train_task.py", line 315, in main
loss, score = ForwardModelsTrain(config, task_cfg, device, task, batch, model, criterion)
File "/home/dasheth/multimodal/iglue/volta/volta/task_utils.py", line 248, in ForwardModelsTrain
segment_ids, input_mask, image_mask)
File "/home/dasheth/miniconda3/envs/multimodal_iglue/lib/python3.7/site-packages/torch/nn/modules/module.py", line 1194, in _call_impl
return forward_call(*input, **kwargs)
File "/home/dasheth/miniconda3/envs/multimodal_iglue/lib/python3.7/site-packages/torch/nn/parallel/data_parallel.py", line 171, in forward
outputs = self.parallel_apply(replicas, inputs, kwargs)
File "/home/dasheth/miniconda3/envs/multimodal_iglue/lib/python3.7/site-packages/torch/nn/parallel/data_parallel.py", line 181, in parallel_apply
return parallel_apply(replicas, inputs, kwargs, self.device_ids[:len(replicas)])
File "/home/dasheth/miniconda3/envs/multimodal_iglue/lib/python3.7/site-packages/torch/nn/parallel/parallel_apply.py", line 89, in parallel_apply
output.reraise()
File "/home/dasheth/miniconda3/envs/multimodal_iglue/lib/python3.7/site-packages/torch/_utils.py", line 543, in reraise
raise exception
StopIteration: Caught StopIteration in replica 0 on device 0.
Original Traceback (most recent call last):
File "/home/dasheth/miniconda3/envs/multimodal_iglue/lib/python3.7/site-packages/torch/nn/parallel/parallel_apply.py", line 64, in _worker
output = module(*input, **kwargs)
File "/home/dasheth/miniconda3/envs/multimodal_iglue/lib/python3.7/site-packages/torch/nn/modules/module.py", line 1194, in _call_impl
return forward_call(*input, **kwargs)
File "/home/dasheth/multimodal/iglue/volta/volta/encoders.py", line 1223, in forward
output_all_attention_masks=output_all_attention_masks,
File "/home/dasheth/miniconda3/envs/multimodal_iglue/lib/python3.7/site-packages/torch/nn/modules/module.py", line 1194, in _call_impl
return forward_call(*input, **kwargs)
File "/home/dasheth/multimodal/iglue/volta/volta/encoders.py", line 988, in forward
dtype=next(self.parameters()).dtype
StopIteration
What could be the issue? I appreciate your help, thank you!