dotnet
Is it possible to make a CHATGPT Clone with ML.NET ?
Hi team,
is it possible to create a ChatGPT clone trained on own data using ML.NET ?
I'm really in need for feedback before deciding to get into ML.NET for my company.
Thanks for the good work
You should use Azure OpanAI to implement
https://learn.microsoft.com/en-us/semantic-kernel/overview/
@Amine-Smahi OpenAI models (ChatGPT, GPT-4 etc.) are not public and can not be ran by anyone else except OpenAI and Microsoft at the moment. Only alternative to use one of the publicly available models. The leaderboard fo them can be found from https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard These are just the models, and we need to either implement our own API to run them or use a premade project such as Ollama
I suggest to start with the small models, 7B or less, first. It is best to have 16 Gb or more GPU memory, but there are ways to run on smaller models. As I understand Mac's are able to also utilize RAM but not on other PC's.
I think the most common production machine has Nvidia A100 40Gb or 80Gb or multiple. Depending on the use case it can be a cost concern. I think it starts from a 2000 usd per month.
Even when running the highest ranked models it is best not to expect ChatGPT level performance in other language than English unless you will finetune the models.
I just remembered Microsoft released Llama 2 ONNX-version. Maybe it is possible to run with Microsoft.ML. Although I think it might not be the quickest route. https://github.com/microsoft/Llama-2-Onnx
They also provide a sample app with Python.
phi-3 and Microsoft.ML.OnnxRuntimeGenAI https://onnxruntime.ai/docs/genai/tutorials/phi2-python.html
