LLM-VM icon indicating copy to clipboard operation
LLM-VM copied to clipboard

Support fine-tuning for chatgpt 3.5

Open rozeappletree opened this issue 2 years ago • 6 comments

We can fine-tune gpt 3.5 i.e chat_gpt according to official blog and docs

So, isn't it a good idea to remove the below line and make sure fine-tuning happens? https://github.com/anarchy-ai/LLM-VM/blob/3b4ade5a40c5160b71642373ae19ba8391066f84/src/llm_vm/onsite_llm.py#L444

Note: gpt-3.5-turbo-0301 is used in generate method but gpt-3.5-turbo-0613 supports fine-tuning. Suffix is a different number.

rozeappletree avatar Aug 23 '23 20:08 rozeappletree

Can send a PR for this if required. Please let me know.

rozeappletree avatar Aug 23 '23 20:08 rozeappletree

It's probably quite a bit more than just removing that line, but this is a good first issue! I think 3.5 has different formats than 3 so the PR should have tests in it :-) But thanks for submitting the issue!

mmirman avatar Aug 23 '23 21:08 mmirman

Makes sense. Will make required changes and send PR with tests. I have a small doubt - do you use pytest for writing tests or some other testing tool? Asking because I don't see pytest being used in tests/ directory.

rozeappletree avatar Aug 23 '23 21:08 rozeappletree

No pytest yet - best to make a ticket for it!

mmirman avatar Aug 23 '23 21:08 mmirman

No pytest yet - best to make a ticket for it!

Opened #133

rozeappletree avatar Aug 23 '23 21:08 rozeappletree

Will attempt to close this

bilal-aamer avatar Nov 28 '23 18:11 bilal-aamer