Mohamed Naji Aboo comments

Repositories
Issues
Comments

Results 2 comments of


                                            Mohamed Naji Aboo

streaming support for LLM, from huggingface

> langchain+gradio chatbot, streaming output > > ``` > streamer = TextIteratorStreamer(tokenizer, timeout=10., skip_prompt=True, skip_special_tokens=True) > pipe = pipeline( > "text-generation", > model=base_model, > tokenizer=tokenizer, > max_length=2048, > temperature=0.6, >...

Finetuning

Hi Team, I am also looking to fine-tune the model with my custom dataset. Please share the details