gpt2bot icon indicating copy to clipboard operation
gpt2bot copied to clipboard

Learning mode

Open ghost opened this issue 5 years ago • 5 comments

Hi,

Hope you are all well !

I was wondering if it is possible to add a learning mode to gpt2bot too ?

I found this example but the code is not really as neat as yours ^^.

  • https://github.com/Existencce/GPT2-Telegram-Chatbot#for-quick-command-reference

Thanks for any inputs or insights on that that question.

Cheers, X

ghost avatar Oct 15 '20 05:10 ghost

I can't fully understand what learning mode is, the code is a little bit of a mess. The model in this example doesn't learn anything new, it simply adds some context prior to the dialogue.

polakowo avatar Oct 15 '20 15:10 polakowo

That's what I though while testing it... Thanks for the confirmation :-)

I guess that a learning mode could be added with a separate skill by using something like https://deeppavlov-agent.readthedocs.io/ with https://github.com/deepset-ai/haystack for the QA system.

Have you ever tested those stacks ?

I would be curious to see what kind of results it gives, as I tested haystack with fairly good results so far, with gpt2bot+deeppavlov agent+haystack

Another (sorry if a dumb one!!! ^^) question, is it possible to apply reinforcement learning to a chatbot ?

ghost avatar Oct 16 '20 05:10 ghost

Can't comment on these tools as I haven't used them in this setting.

You may find papers training an RL agent for conversation. You would need to establish a reward function such as human likeness, answer coherence, etc. Can't tell whether it's effective though.

polakowo avatar Oct 17 '20 10:10 polakowo

https://machinelearning.veravandeseyp.com/

breadbrowser avatar Jun 12 '22 22:06 breadbrowser

https://parl.ai/

breadbrowser avatar Jun 12 '22 22:06 breadbrowser