termite-data-server icon indicating copy to clipboard operation
termite-data-server copied to clipboard

Is this source support Chinese??

Open DongShanHu opened this issue 6 years ago • 0 comments

I have some problem on making the model with my data. While I finish the Preparations I use my data and the subname is .txt, but my data is chinese word and can not make the output of corpus.db

could u give me some tips ? thanks this is my error

ImportFromFile........... Traceback (most recent call last): File "bin/import_corpus.py", line 30, in main() File "bin/import_corpus.py", line 27, in main ImportCorpus(args.corpus, args.database) File "bin/import_corpus.py", line 17, in ImportCorpus corpus_db.ImportFromFile(corpus_filename_or_folder) File "/home/kyle/下載/termite_data_server/bin/db/Corpus_DB.py", line 175, in ImportFromFile self.db.corpus.bulk_insert(ReadFile()) File "web2py/gluon/dal.py", line 9222, in bulk_insert ret = self._db._adapter.bulk_insert(self,items) File "web2py/gluon/dal.py", line 1375, in bulk_insert return [self.insert(table,item) for item in items] File "web2py/gluon/dal.py", line 1360, in insert raise e ValueError: the query contains a null character

DongShanHu avatar Aug 13 '18 16:08 DongShanHu