dprokhorov17

[Outlines Support] Enhance With Structured Text Generation when VLLM is used

7

Would love to see an integration of the outlines library (https://github.com/outlines-dev/outlines)

https://www.jetbrains.com/de-de/mps/whatsnew/

I'd like to deploy my custom model on managed Azure machine learning real-time endpoint. So, I've registered my model, but it's not clear to me how to write a proper...

Langfuse traces are not captured within the self-hosted instances

1

### Bug Description I created the following docker compose file: ```yaml # docker-compose.yml # stack: Langfuse + Langflow sharing one Postgres instance # Run with: docker compose up -d services:...

.Net: Bug: Custom PromptExecutionSettings with "guided_regex" property for vLLM OpenAI Api Server is not working

1

**Describe the bug** It seems that a custom property is not being serialized into the final http request for the vllm openai api server Here is my code (snippet) so...

Finetune on downstream tasks

1

Hello, how can this model be further finetuned to downstream tasks such as object localization?