Daniel Han
Daniel Han
@gotzmann We're actively working with the Llama Factory team - for now it's in experimental mode - there will be intermittent seg faults randomnly for now and I haven't confirmed...
@MUZAMMILPERVAIZ It's under active development. So currently no.
Working on it!!! (for Phi-3) Multimodal not yet supported - its on our roadmap
@sumukshashidhar Ill try adding it today!
Supported! https://colab.research.google.com/drive/1NvkBmkHfucGO3Ve9s1NKZvMNlw5p83ym?usp=sharing https://huggingface.co/unsloth/Phi-3-mini-4k-instruct
Had to mistral-fy it since Phi has sliding window attention and fixed the 2047/2048 SWA bug and unfused everything
@CrispStrobe Thanks for the quick notice!!
Oh no not really - it's just mistral-fied - also I fixed a few bugs
@JohnnyRacer Oh wait you need to change `train` to `text` I think! It's only the train or test split, but rather the column which you want! `['instruction', 'input', 'output', 'text']`...
@JohnnyRacer I'll check it out! :)