MITIE Training fails to generate entity_extrator.dat for more examples

[vicky88377]

We are using Windows 10 PRO 64 Bit, with RASA .13.0 and Mitie .5.0 version. My RAM is 16GB and Processor : CPU 2.30Ghz, PageFile says: 25677MB used, 938 available.

I'm running MITIE with 180 examples with 24 threads ,It took 4.5 hours and throw exception. [ I have uploaded the exception message what i get.]

mitie.py,line 271, in save_disk if(_f.mitie_save_named_entity_extractor_pure_model(filename, self._obj)!=0): OSError: exception: access viloation reading 0x00000000000..0000030

Also my model_20180918-150254 contains only training_data.json, other files like entity_extractor.dat,intent_classifier.dat, metadata.json,regex_feaurizer.json are not generated.

But when i test the same with only 2-3 examples, it's all good.

[davisking]

If you are hitting the page file then you need more ram. Also make sure you compiled with compiler optimizations enabled and against the intel mkl. That makes it faster.

I don’t know why you get that file error, but it doesn’t have anything to do with MITIE. You need to ask in a rasa nlu form. I don’t know anything about rasa nlu except that it’s apparently hard to use since it’s users frequently post questions about it in MITIE forms.

[bofengshuimen77]

Do you solve this problem now? I met it too

[chongtwo]

I met it too and don't know how to solve it.