openhathi_instruct icon indicating copy to clipboard operation
openhathi_instruct copied to clipboard

verified publisher icon pacman100
→

Metadata

This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resulting model is meant to follow instructions and chat in Hindi and H...

Results 3 openhathi_instruct issues
Sort by recently updated
recently updated
newest added

how to translate with multiple instances of the model using multiple GPUs

1 comment

hey @pacman100 the translation code could take days given there are multiple SFT datasets and multiple languages to translate on. is there a way to accelerate the code by launching...

StephennFernandes avatar StephennFernandes

Incorrect response while using Hindi prompts

Whenever there is use of Hindi prompts, the model gives incorrect, unreliable and sometimes irrelevant information

Vishesh20155 avatar Vishesh20155

Tokenizer issue in Hathi Model

AutoTokenizer and LlamaTokenizer (which Sarvam used) both behave differently with this model. AutoTokenizer sometimes splits words that are in vocab and LlamaTokenizer works fine. https://huggingface.co/sarvamai/OpenHathi-7B-Hi-v0.1-Base/discussions/5

ONE-THING-9 avatar ONE-THING-9

← Metadata

16
Stars
4
Forks
Watchers

Owner

verified publisher icon pacman100

Metadata

This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resulting model is meant to follow instructions and chat in Hindi and H...

Back