distilabel

distilabel copied to clipboard

Add Tasks to replicate `APIGen`

2

## Description This PR adds `Tasks` to replicate [APIGen: Automated Pipeline for Generating Verifiable and Diverse Function-Calling Datasets](https://arxiv.org/abs/2406.18518), which yielded the following dataset: [Salesforce/xlam-function-calling-60k](https://huggingface.co/datasets/Salesforce/xlam-function-calling-60k). The following is a draft pipeline...

plaguss

[EXAMPLE] Add `CRAFT Your Dataset: Task-Specific Synthetic Dataset Generation Through Corpus Retrieval and Augmentation` example

6

**Is your feature request related to a problem? Please describe.** We could create an example replicating this paper, we have most of the pieces and seems quite interesting: [CRAFT Your...

plaguss

[DRAFT] feat: Add the argilla listener generator step

1

This PR adds a generator step to listen to Argilla events.

frascuchon

closes https://github.com/argilla-io/distilabel/issues/663 ### Issue 01ai changed the base url of their managed service , but it's available and faster than ever ! ### Solution Adds OneAI client to distilabel with...

Josephrp

**Is your feature request related to a problem? Please describe.** Google AI models can be used with their [genai](https://pypi.org/project/google-generativeai/) library. I think it would be nice to have support for...

boapps

**Is your feature request related to a problem? Please describe.** Model-based evaluation is at the heart of successful model development -- as a reward model for training, and as a...

Josephrp

[FEATURE] `mlx-lm` integration

1

## Description As suggested by @alvarobartt, it would be nice to integrate [`mlx-lm`](https://pypi.org/project/mlx-lm/)

gabrielmbmb

docs: textcat tutorial

3

sdiazlor

[FEATURE] `sglang` integration

1

## Description Integrate [`sglang`](https://github.com/sgl-project/sglang)

gabrielmbmb

## Description [llm-swarm](https://github.com/huggingface/llm-swarm)

gabrielmbmb