Manoranjan Rajguru comments

Results 19 comments of


                                            Manoranjan Rajguru

new user looking for examples of multilabel classification

I am also looking at the same . I want to predict various page segments like Tables , Header , Paragraph , Charts etc . Can you please share some...

Unable to deploy lmsys/vicuna-13b-v1.5-16k

Now if i decrease the max-batch-prefill-tokens it says MAX_INPUT_LENGTH cant be more than max-batch-prefill-tokens

Unable to deploy lmsys/vicuna-13b-v1.5-16k

Hi @Narsil , Wanted to understand more about the concept here. Its a 13b model which takes around 25GB of memory. I have g5.48xlarge with 192 GB of memory. How...

Unable to deploy lmsys/vicuna-13b-v1.5-16k

what is your TGI version , i am using 0.9.3

Storm notebook issue: BadRequestError: Error code: 400 - {'error': {'message': "'Subject Matter Expert' does not match '^[a-zA-Z0-9_-]{1,64}$' - 'messages.1.name'", 'type': 'invalid_request_error'

I am facing the same issue. When are we planning to merge this to master ?

Storm notebook issue: BadRequestError: Error code: 400 - {'error': {'message': "'Subject Matter Expert' does not match '^[a-zA-Z0-9_-]{1,64}$' - 'messages.1.name'", 'type': 'invalid_request_error'

@csellis could you please share the working notebook if possible or the line I need to change .

Add support for mosaicml/mpt-30b and mosaicml/mpt-30b-instruct

anyplan on supporting mosaicml/mpt-30b-instruct ?

MPT support

any plan on supporting mosaicml/mpt-30b-instruct support

How to use Splitwise(from microsoft) in vllm?

same here

How to use Splitwise(from microsoft) in vllm?

Let me get the info :)