Logan Olson

icon location Los Angeles, CA

Results 5 comments of Logan Olson

Allow sizes in pixels

+1

Why uniform bias initializer?

Does either option work with nn.MLP or would I need to do more surgery? It's unclear to me how I would use tree_at to access each linear layer but maybe...

streaming support for LLM, from huggingface

It seems to just work out of the box if you put a streamer in your pipeline: ``` streamer = TextStreamer(tokenizer) pipe = pipeline(model=model, tokenizer=tokenizer, streamer=streamer} llm = HuggingFacePipeline(pipeline=pipe) ```

Raw text streaming with hugging face transformers?

+1

Add Grammars

What needs to happen to get this grammar pull request approved and merged? I'd love to start using grammars with vLLM.