cdec
cdec copied to clipboard
Illegal key type <type 'long'> for IntList
When i try do this: python -m cdec.sa.extract -c extract.ini -g dev.grammars -j 1 < dev.lc-tok.ru-en > dev.lc-tok.ru-en.sgm
I've got this error:
File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main
"main", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "/home/xoicy/cdec/python/build/lib.linux-i686-2.7/cdec/sa/extract.py", line 80, in
I seem to be getting a similar error (my HEAD is at 951e7daa9539, which comes after the possible fix of 5871cbe).
$ python -m cdec.sa.extract -c data/extract.ini -g data/dev.grammars -j 2 -z < data/dev.lc-tok.es-en > data/dev.lc-tok.es-en.sgm
INFO:root:Starting 2 workers; chunk size: 10
INFO:cdec.sa:Sampling strategy: uniform, max sample size = 300
INFO:cdec.sa:Sampling strategy: uniform, max sample size = 300
INFO:cdec.sa:Reading precomputed data from file /home/orii/cdec/data/training.sa/precomp.5.2.15.1.100.10.bin...
INFO:cdec.sa:Reading precomputed data from file /home/orii/cdec/data/training.sa/precomp.5.2.15.1.100.10.bin...
INFO:cdec.sa:Converting 100 hash keys on precomputed inverted index...
INFO:cdec.sa:Converting 23000 hash keys on precomputed collocations...
INFO:cdec.sa:Converting 100 hash keys on precomputed inverted index...
INFO:cdec.sa:Converting 23000 hash keys on precomputed collocations...
INFO:cdec.sa:Processing precomputations took 0.664041 seconds
Traceback (most recent call last):
File "/home/orii/Canopy/appdata/canopy-1.0.3.1262.rh5-x86/lib/python2.7/runpy.py", line 162, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "/home/orii/Canopy/appdata/canopy-1.0.3.1262.rh5-x86/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "/home/orii/cdec/python/build/lib.linux-i686-2.7/cdec/sa/extract.py", line 113, in <module>
main()
File "/home/orii/cdec/python/build/lib.linux-i686-2.7/cdec/sa/extract.py", line 100, in main
for output in pool.imap(extract, enumerate(sys.stdin), args.chunksize):
File "/home/orii/Canopy/appdata/canopy-1.0.3.1262.rh5-x86/lib/python2.7/multiprocessing/pool.py", line 245, in <genexpr>
return (item for chunk in result for item in chunk)
File "/home/orii/Canopy/appdata/canopy-1.0.3.1262.rh5-x86/lib/python2.7/multiprocessing/pool.py", line 626, in next
raise value
TypeError: Illegal key type <type 'long'> for IntList
INFO:cdec.sa:Processing precomputations took 0.664041 seconds
Any ideas?