Sanketh Gadadinni

How to get providerURL, client ID and client token to create azure openid login?????

bug: Error While loading Mistral and Llama on T4 GPU

6

### Describe the bug When loading the mistral and Llama model on T4 GPU, I'm getting this error raise openllm.exceptions.OpenLLMException(f'Failed to initialise vLLMEngine due to the following error:\n{err}') from err...

Use Additional Tools

1

async with CodeInterpreterSession(llm=llm, tools = [SimulatorTool()]) as session: print("Code Interpreter Session started.") prompt = ''' Simulate the sales, if unemployment_rate is 5.5, and fed_rate is 0.8? ''' user_request = prompt...

Chat History Backend example isn't working

2

The example isn't working as expected

Training getting struck

4

I'm trying to train on A100 GPU but the training is struck at. I can't see any logs other than this UserWarning: MatMul8bitLt: inputs will be cast from torch.bfloat16 to...

Stop token during Inference

3

Why are the responses cut down in the middle?

I'm facing this issue while installing ERROR: Could not build wheels for python-geohash, which is required to install pyproject.toml-based projects