cdec icon indicating copy to clipboard operation
cdec copied to clipboard

Illegal key type <type 'long'> for IntList

Open xoicy opened this issue 12 years ago • 1 comments

When i try do this: python -m cdec.sa.extract -c extract.ini -g dev.grammars -j 1 < dev.lc-tok.ru-en > dev.lc-tok.ru-en.sgm

I've got this error: File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main "main", fname, loader, pkg_name) File "/usr/lib/python2.7/runpy.py", line 72, in _run_code exec code in run_globals File "/home/xoicy/cdec/python/build/lib.linux-i686-2.7/cdec/sa/extract.py", line 80, in main() File "/home/xoicy/cdec/python/build/lib.linux-i686-2.7/cdec/sa/extract.py", line 76, in main for output in map(extract, enumerate(sys.stdin)): File "/home/xoicy/cdec/python/build/lib.linux-i686-2.7/cdec/sa/extract.py", line 38, in extract for rule in extractor.grammar(sentence): File "rulefactory.pxi", line 1084, in input (src/sa/_sa.c:47791) File "rulefactory.pxi", line 1604, in _sa.HieroCachingRuleFactory.extract (src/sa/_sa.c:53452) File "rulefactory.pxi", line 1391, in _sa.HieroCachingRuleFactory.create_alignments (src/sa/_sa.c:51386) File "int_list.pxi", line 109, in _sa.IntList.getitem (src/sa/_sa.c:5884) TypeError: Illegal key type <type 'long'> for IntList

xoicy avatar Dec 19 '12 06:12 xoicy

I seem to be getting a similar error (my HEAD is at 951e7daa9539, which comes after the possible fix of 5871cbe).

$ python -m cdec.sa.extract -c data/extract.ini -g data/dev.grammars -j 2 -z < data/dev.lc-tok.es-en > data/dev.lc-tok.es-en.sgm
INFO:root:Starting 2 workers; chunk size: 10
INFO:cdec.sa:Sampling strategy: uniform, max sample size = 300
INFO:cdec.sa:Sampling strategy: uniform, max sample size = 300
INFO:cdec.sa:Reading precomputed data from file /home/orii/cdec/data/training.sa/precomp.5.2.15.1.100.10.bin... 
INFO:cdec.sa:Reading precomputed data from file /home/orii/cdec/data/training.sa/precomp.5.2.15.1.100.10.bin... 
INFO:cdec.sa:Converting 100 hash keys on precomputed inverted index... 
INFO:cdec.sa:Converting 23000 hash keys on precomputed collocations... 
INFO:cdec.sa:Converting 100 hash keys on precomputed inverted index... 
INFO:cdec.sa:Converting 23000 hash keys on precomputed collocations... 
INFO:cdec.sa:Processing precomputations took 0.664041 seconds
Traceback (most recent call last):
  File "/home/orii/Canopy/appdata/canopy-1.0.3.1262.rh5-x86/lib/python2.7/runpy.py", line 162, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "/home/orii/Canopy/appdata/canopy-1.0.3.1262.rh5-x86/lib/python2.7/runpy.py", line 72, in _run_code
    exec code in run_globals
  File "/home/orii/cdec/python/build/lib.linux-i686-2.7/cdec/sa/extract.py", line 113, in <module>
    main()
  File "/home/orii/cdec/python/build/lib.linux-i686-2.7/cdec/sa/extract.py", line 100, in main
    for output in pool.imap(extract, enumerate(sys.stdin), args.chunksize):
  File "/home/orii/Canopy/appdata/canopy-1.0.3.1262.rh5-x86/lib/python2.7/multiprocessing/pool.py", line 245, in <genexpr>
    return (item for chunk in result for item in chunk)
  File "/home/orii/Canopy/appdata/canopy-1.0.3.1262.rh5-x86/lib/python2.7/multiprocessing/pool.py", line 626, in next
    raise value
TypeError: Illegal key type <type 'long'> for IntList
INFO:cdec.sa:Processing precomputations took 0.664041 seconds

Any ideas?

mrorii avatar Aug 19 '13 05:08 mrorii