TextFooler icon indicating copy to clipboard operation
TextFooler copied to clipboard

Published 20 hours ago • verified publisher icon jind11

Segmentation fault (core dumped) when running USE

Open kiaia opened this issue 5 years ago • 4 comments

Thank you for your code I follow the instructions to try to reproduce the results. After Cos sim import finished! Segmentation fault (core dumped) happened, the previous steps are no problem, I use tensorflow 1.14.0, pytorch 0.41, gpu memory is 12gb. Can you please analyze what is the possible cause of the error?

kiaia avatar Oct 27 '19 08:10 kiaia

importing the cos sim matrix takes more than 12 GB RAM, which caused your issue here.

jind11 avatar Oct 27 '19 14:10 jind11

Thx for your suggestion!I'm sorry that I may not have made it clear what problems I have.Let me add the information： The server's free memory is more than 50GB, and the video card's memory is 12GB.comp_cos_sim_mat.py has been executed in advance, and cos_sim_counte_fitting.npyhas been imported successfully. I found there is a problem when calling self.embed = hub.module (module_URL) in USEand I found the issue of universal sense encoder, which seems to be a problom associated with tensorflow version along with tf-sentencepiece version . So far, I have not been able to solve the problem by trying to follow the above scheme. If there is any progress, I will give feedback.Could you give me some advice if possible?Thx a lot.

kiaia avatar Oct 27 '19 16:10 kiaia

Thx for your suggestion!I'm sorry that I may not have made it clear what problems I have.Let me add the information： The server's free memory is more than 50GB, and the video card's memory is 12GB.comp_cos_sim_mat.py has been executed in advance, and cos_sim_counte_fitting.npyhas been imported successfully. I found there is a problem when calling self.embed = hub.module (module_URL) in USEand I found the issue of universal sense encoder, which seems to be a problom associated with tensorflow version along with tf-sentencepiece version . So far, I have not been able to solve the problem by trying to follow the above scheme. If there is any progress, I will give feedback.Could you give me some advice if possible?Thx a lot.

Hi! I also found the problem about tensorflow_hub when loading USE. Have you had any progress on this issue? I tried the example code on website of USE but the same error occurred.

sharon-gao avatar Jul 03 '20 01:07 sharon-gao

could you first make sure your environment strictly follows the requirements.txt file? I think that could probably solve this problem.

jind11 avatar Jul 03 '20 01:07 jind11