llama icon indicating copy to clipboard operation
llama copied to clipboard

How to create a General AI 🤖

Open elephantpanda opened this issue 1 year ago • 7 comments

Hi,

just thought I'd post this little essay I wrote about how to create a general AI. with a modified language model. What's your opinion?

elephantpanda avatar Mar 11 '23 15:03 elephantpanda

It's an intriguing idea. We could close the loop by distilling a training dataset and making it dynamic, and then continuously refining the model with new observed data.

miolini avatar Mar 13 '23 06:03 miolini

i host my own llms into my linux server and every conversations with friends are collected and trained every 24 hours. it is quite cool for me. that changed how i communicate with friends (not for most of people, because i am not good at communicating with people that is why i made that ecosystem)

jumang4423 avatar Mar 13 '23 11:03 jumang4423

i host my own llms into my linux server and every conversations with friends are collected and trained every 24 hours. it is quite cool for me. that changed how i communicate with friends (not for most of people, because i am not good at communicating with people that is why i made that ecosystem)

Does the llm begin to sound like your friends?

elephantpanda avatar Mar 13 '23 12:03 elephantpanda

It would be great if we can visualize update waves inside models day to day. And maybe, incorporate how waves propogates into mdoel itself.

miolini avatar Mar 13 '23 13:03 miolini

@pauldog Could you please talk a little bit more about your fine tuning pipeline and foundation model? What hardware are you using for it?

miolini avatar Mar 13 '23 14:03 miolini

@pauldog Could you please talk a little bit more about your fine tuning pipeline and foundation model? What hardware are you using for it?

I haven't tried fine tuning this model yet. I've done reinforcement learning on other models not this one yet. My hardware probably isn't good enough. I can only just get the 7B model working!

elephantpanda avatar Mar 13 '23 15:03 elephantpanda

What other models have you used?

miolini avatar Mar 13 '23 15:03 miolini

Closing this one - we will have some forums for this type of discussion soon. thanks!

jspisak avatar Sep 06 '23 19:09 jspisak