RAGE icon indicating copy to clipboard operation
RAGE copied to clipboard

[Help Wanted] Error when feeding my own data

Open mokeeqian opened this issue 3 years ago • 0 comments

I got the following error when feeding my own data, and why?

Traceback (most recent call last):
  File "D:/ProjectCodes/AI_Projects/RAGE/MyRunner.py", line 237, in <module>
    pos2id, id2pos, word2pos, wordid2posid, wordid2posid_vec = load_word2pos(word2id, "./data/jd/wdj_word_pos.txt")
  File "D:\ProjectCodes\AI_Projects\RAGE\DataProcess.py", line 138, in load_word2pos
    wordid2posid_vec[index] = value
TypeError: int() argument must be a string, a bytes-like object or a number, not 'NoneType'

It seems that I got the wrong data config?

Load stop word 
Load vocabulary as size 150003..
Vocabulary size:150001
Load Word Embedding
10000 word have been loaded....
20000 word have been loaded....
30000 word have been loaded....
40000 word have been loaded....
50000 word have been loaded....
60000 word have been loaded....
70000 word have been loaded....
80000 word have been loaded....
90000 word have been loaded....
100000 word have been loaded....
110000 word have been loaded....
120000 word have been loaded....
Embedding Dictionary has been created as size:119092
Traceback (most recent call last):
  File "D:/ProjectCodes/AI_Projects/RAGE/DataProcess.py", line 441, in <module>
    emd_dict,word_emd=load_word_embedding(word2id, "./data/jd/wdj_word_emd.txt", 200)
  File "D:/ProjectCodes/AI_Projects/RAGE/DataProcess.py", line 83, in load_word_embedding
    emd_mtx[index][w] = vec[w]
IndexError: index 145400 is out of bounds for axis 0 with size 119092

Process finished with exit code 1

mokeeqian avatar Nov 12 '22 10:11 mokeeqian