nmt-chatbot icon indicating copy to clipboard operation
nmt-chatbot copied to clipboard

Chatbot replies http webpage link?

Open Kinwong1103 opened this issue 6 years ago • 5 comments

I have trained my model using reddit comments following sentdex's youtube tutorial. However, my chatbot usually replies with answer like "https://reddit/xxx/xxxx" when i ask him simple question like "how are you today?" May I ask that how've i done wrong or how to prevent this issue?

Kinwong1103 avatar Oct 28 '18 13:10 Kinwong1103

i have this save ishue, it alewase responds with "i dont know what your talking about" or a reddit/giphy or some other link I am useing tensorflow 1.9 and 2015-1 database

aakashrkumar avatar Oct 28 '18 15:10 aakashrkumar

That means that you have too few data in your training dataset or you have to train it longer. Chatbot is bound somehow to links. You could also remove from training data all pairs containing links.

daniel-kukiela avatar Nov 03 '18 21:11 daniel-kukiela

I have around 4 million pairs and I have done a little over 1 epoch, home much more should I train to get a better bot?

aakashrkumar avatar Nov 04 '18 15:11 aakashrkumar

My test bot is trained on 1 or 2 million pairs iirc for 5 epochs. Give it a try for 1 or 2 more epochs.

daniel-kukiela avatar Nov 11 '18 03:11 daniel-kukiela

Had the same problem. Was training a bot with 1M pairs and all that It would respond is "I dont know" or an incomplete web link. So I choose a different dataset and got like 2.5M pairs and wrote a script to clear all the http/s links in the data. My bot now is doing much better. No links and luckily no "I Dont Know" answers. I did 4 epochs with about 75k steps in total and the bot is decent enough.

tarunkolla avatar Jan 04 '19 13:01 tarunkolla