t2vec icon indicating copy to clipboard operation
t2vec copied to clipboard

Problems for training

Open xiran2018 opened this issue 3 years ago • 5 comments

The environment is: Python 3.6 and PyTorch 1.5.

when i run the code,it occurs the following problem. I don't know why?

XXX$CUDA_VISIBLE_DEVICES=1 python t2vec.py -vocab_size 18864 -criterion_name "KLDIV" -knearestvocabs "porto-vocab-dist-cell100.h5"

Namespace(batch=128, bidirectional=True, bucketsize=[(20, 30), (30, 30), (30, 50), (50, 50), (50, 70), (70, 70), (70, 100), (100, 100)], checkpoint='/home/ucas/jingquanliang/SimSub/data/checkpoint.pt', criterion_name='KLDIV', cuda=True, data='/home/ucas/jingquanliang/SimSub/data', discriminative_w=0.1, dist_decay_speed=0.8, dropout=0.2, embedding_size=256, epochs=15, generator_batch=32, hidden_size=256, knearestvocabs='porto-vocab-dist-cell100.h5', learning_rate=0.001, max_grad_norm=5.0, max_length=200, max_num_line=20000000, mode=0, num_layers=3, prefix='exp', pretrained_embedding=None, print_freq=50, save_freq=1000, start_iteration=0, t2vec_batch=256, use_discriminative=False, vocab_size=18864) Reading training data... Read line 500000 Read line 1000000 Read line 1500000 Read line 2000000 Read line 2500000 Read line 3000000 Read line 3500000 Read line 4000000 Read line 4500000 Read line 5000000 Read line 5500000 Read line 6000000 Read line 6500000 Read line 7000000 Read line 7500000 Read line 8000000 Read line 8500000 Read line 9000000 Read line 9500000 Read line 10000000 Read line 10500000 Read line 11000000 Read line 11500000 Read line 12000000 Read line 12500000 Read line 13000000 Read line 13500000 Read line 14000000 Read line 14500000 Read line 15000000 Read line 15500000 Read line 16000000 Read line 16500000 /home/ucas/jingquanliang/SimSub/ori-t2vec/data_utils.py:155: VisibleDeprecationWarning: Creating an ndarray from ragged nested sequences (which is a list-or-tuple of lists-or-tuples-or ndarrays with different lengths or shapes) is deprecated. If you meant to do this, you must specify 'dtype=object' when creating the ndarray self.srcdata = list(map(np.array, self.srcdata)) /home/ucas/jingquanliang/SimSub/ori-t2vec/data_utils.py:156: VisibleDeprecationWarning: Creating an ndarray from ragged nested sequences (which is a list-or-tuple of lists-or-tuples-or ndarrays with different lengths or shapes) is deprecated. If you meant to do this, you must specify 'dtype=object' when creating the ndarray self.trgdata = list(map(np.array, self.trgdata)) Allocation: [5452031, 1661741, 4455989, 2563116, 1595830, 647973, 247370, 87910] Percent: [0.32623528 0.09943424 0.26663473 0.15337016 0.0954903 0.03877301 0.01480197 0.0052603 ] Reading validation data... /home/ucas/jingquanliang/SimSub/ori-t2vec/data_utils.py:148: VisibleDeprecationWarning: Creating an ndarray from ragged nested sequences (which is a list-or-tuple of lists-or-tuples-or ndarrays with different lengths or shapes) is deprecated. If you meant to do this, you must specify 'dtype=object' when creating the ndarray self.srcdata = np.array(merge(*self.srcdata)) /home/ucas/jingquanliang/SimSub/ori-t2vec/data_utils.py:149: VisibleDeprecationWarning: Creating an ndarray from ragged nested sequences (which is a list-or-tuple of lists-or-tuples-or ndarrays with different lengths or shapes) is deprecated. If you meant to do this, you must specify 'dtype=object' when creating the ndarray self.trgdata = np.array(merge(*self.trgdata)) Loaded validation data size 167520 Loading vocab distance file /home/ucas/jingquanliang/SimSub/data/porto-vocab-dist-cell100.h5... => training with GPU => no checkpoint found at '/home/ucas/jingquanliang/SimSub/data/checkpoint.pt' Iteration starts at 0 and will end at 66999 /home/ucas/jingquanliang/SimSub/ori-t2vec/data_utils.py:46: VisibleDeprecationWarning: Creating an ndarray from ragged nested sequences (which is a list-or-tuple of lists-or-tuples-or ndarrays with different lengths or shapes) is deprecated. If you meant to do this, you must specify 'dtype=object' when creating the ndarray src = list(np.array(src)[idx]) /home/ucas/jingquanliang/SimSub/ori-t2vec/data_utils.py:47: VisibleDeprecationWarning: Creating an ndarray from ragged nested sequences (which is a list-or-tuple of lists-or-tuples-or ndarrays with different lengths or shapes) is deprecated. If you meant to do this, you must specify 'dtype=object' when creating the ndarray trg = list(np.array(trg)[idx]) Iteration: 0 Generative Loss: 5.399 Discriminative Cross Loss: 0.000 Discriminative Inner Loss: 0.000 /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [0,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [1,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [2,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [3,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [4,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [5,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [6,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [7,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [8,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [9,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [10,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [11,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [12,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [13,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [14,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [15,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [16,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [17,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [18,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [19,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [20,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [21,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [22,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [23,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [24,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [25,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [26,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [27,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [28,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [29,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [30,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [31,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [32,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [33,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [34,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [35,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [36,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [37,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [38,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [39,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [40,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [41,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [42,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [43,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [44,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [45,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [46,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [47,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [48,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [49,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [50,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [51,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [52,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [53,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [54,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [55,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [56,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [57,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [58,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [59,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [60,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [61,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [62,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [63,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [64,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [65,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [66,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [67,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [68,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [69,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [70,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [71,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [72,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [73,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [74,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [75,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [76,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [77,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [78,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [79,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [80,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [81,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [82,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [83,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [84,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [85,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [86,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [87,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [88,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [89,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [90,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [91,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [92,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [93,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [94,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [95,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [96,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [97,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [98,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [99,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [100,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [101,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [102,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [103,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [104,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [105,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [106,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [107,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [108,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [109,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [110,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [111,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [112,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [113,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [114,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [115,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [116,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [117,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [118,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [119,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [120,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [121,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [122,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [123,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [124,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [125,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [126,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [535,0,0], thread: [127,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [0,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [1,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [2,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [3,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [4,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [5,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [6,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [7,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [8,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [9,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [10,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [11,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [12,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [13,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [14,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [15,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [16,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [17,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [18,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [19,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [20,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [21,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [22,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [23,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [24,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [25,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [26,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [27,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [28,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [29,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [30,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [31,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [32,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [33,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [34,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [35,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [36,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [37,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [38,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [39,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [40,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [41,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [42,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [43,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [44,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [45,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [46,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [47,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [48,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [49,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [50,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [51,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [52,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [53,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [54,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [55,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [56,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [57,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [58,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [59,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [60,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [61,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [62,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [63,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [64,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [65,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [66,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [67,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [68,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [69,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [70,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [71,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [72,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [73,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [74,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [75,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [76,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [77,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [78,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [79,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [80,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [81,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [82,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [83,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [84,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [85,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [86,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [87,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [88,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [89,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [90,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [91,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [92,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [93,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [94,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [95,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [96,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [97,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [98,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [99,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [100,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [101,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [102,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [103,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [104,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [105,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [106,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [107,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [108,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [109,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [110,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [111,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [112,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [113,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [114,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [115,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [116,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [117,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [118,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [119,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [120,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [121,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [122,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [123,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [124,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [125,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [126,0,0] Assertion srcIndex < srcSelectDimSize failed. /opt/conda/conda-bld/pytorch_1591914838379/work/aten/src/THC/THCTensorIndex.cu:272: indexSelectLargeIndex: block: [534,0,0], thread: [127,0,0] Assertion srcIndex < srcSelectDimSize failed. Traceback (most recent call last): File "t2vec.py", line 121, in train(args) File "/home/ucas/jingquanliang/SimSub/ori-t2vec/train.py", line 262, in train genloss = genLoss(gendata, m0, m1, lossF, args) File "/home/ucas/jingquanliang/SimSub/ori-t2vec/train.py", line 90, in genLoss output = m0(input, lengths, target) File "/home/ucas/anaconda3/envs/jqlsim/lib/python3.6/site-packages/torch/nn/modules/module.py", line 550, in call result = self.forward(*input, **kwargs) File "/home/ucas/jingquanliang/SimSub/ori-t2vec/models.py", line 207, in forward encoder_hn, H = self.encoder(src, lengths) File "/home/ucas/anaconda3/envs/jqlsim/lib/python3.6/site-packages/torch/nn/modules/module.py", line 550, in call result = self.forward(*input, **kwargs) File "/home/ucas/jingquanliang/SimSub/ori-t2vec/models.py", line 111, in forward lengths = lengths.data.view(-1).tolist() RuntimeError: CUDA error: device-side assert triggered

xiran2018 avatar Jun 17 '21 08:06 xiran2018

Hi xiran, I met the same problem as you, I would like to know if you have solved this. Thank you so much!

LannDiane avatar May 29 '22 08:05 LannDiane

Hi xiran, I met the same problem as you, I would like to know if you have solved this. Thank you so much!

Gshaoo avatar Mar 24 '23 09:03 Gshaoo

Hi xiran, I met the same problem as you, I would like to know if you have solved this. Thank you so much!

Gshaoo avatar Apr 19 '23 12:04 Gshaoo

Hi xiran, I met the same problem as you, I would like to know if you have solved this. Thank you so much!

FanC27 avatar May 25 '23 01:05 FanC27

I change -vocab_size to 20000, it is OK now

liuwj2000 avatar Nov 02 '23 13:11 liuwj2000