Tony Alapatt

icon indicating a website link https://blog.tonyalapatt.in/

icon company BillionLives icon location Bangalore icon location An entrepreneur with a decade of experience working with various startups in techno-business roles. But a true techie at heart. @Billion-Lives

Results 2 comments of Tony Alapatt

Self hosted LLMs Support

Hey, would really like an update on this feature for LLM [HuggingFaceTextGenInference](https://python.langchain.com/en/latest/modules/models/llms/integrations/huggingface_textgen_inference.html) Also, is the custom component a good workaround ?

Self hosted LLMs Support

HuggingFaceTextGenInference is different from Hugging Face Inference API right ?