pranavbhat12

Context Extension with Ctranslate2

1

Hey, I am currently stuck if I want to enable rope scaling for Llama-2 models.Is it supported? I went through the documentation but there is not enough guidance on how...

Issue with partition_pdf

4

While trying to read pdf file with partition_pdf function I am getting this error: RuntimeError Traceback (most recent call last) Cell In[11], line 7 4 from unstructured.partition.pdf import partition_pdf 6...

Error:Maximum decoding length >0 while transcribing

1

For certain audios, I am getting this issue of Maximum decoding length >0 while generating the segments. Parameters that were used: segments,info = whisper_model.transcribe( audio="sample.wav", task="translate", repetition_penalty=1.2, initial_prompt="Hello Yes Sir.Ignore...

@amogkam I was trying to implement ray serve to enhance the inference speed.But during implementation got the error about loading the model saying load_in_8_bit requires accelerate and bitsandbytes which I...