IGSQL icon indicating copy to clipboard operation
IGSQL copied to clipboard

nan error

Open wickcode opened this issue 3 years ago • 2 comments

Hi,

Thanks for the code.

I am getting nan error, but it seems like you have a message "keep running". Did you face this issue? I am running this without Bert. Apart from removing bert from config, does it need any other changes?

What effect this has: https://github.com/headacheboy/IGSQL/blob/main/model/schema_interaction_model.py#L578?

Thanks

wickcode avatar Mar 09 '21 21:03 wickcode

Hi,

I didn't try my model without Bert. I used to face this issue, but it seems fixed when I add 1e-8 before the torch.log() funtion.

Codes are in compute_loss() in https://github.com/headacheboy/IGSQL/blob/5cdbdbf5e530be14ff6441d2a4a514f3546d76ba/model/torch_utils.py

Maybe you can try the model with Bert embedding?

headacheboy avatar Mar 10 '21 07:03 headacheboy

Ok thank you. I am not sure how this is related to embeddings I will try other parameter maybe. I am unable to use bert as it goes out of memory.

wickcode avatar Mar 10 '21 14:03 wickcode