distilabel

distilabel copied to clipboard

[FEATURE] Add a way to predict or estimate expected tokens or expected costs

1

**Is your feature request related to a problem? Please describe.** Generation with reliance on external APIs might be expensive. **Describe the solution you'd like** Something like a pipeline method `expected_costs`...

davidberenstein1957

How to use local data sets?

5

Is there a way to use a local dataset? Convert the data loaded in dataset.load_from_disk to a list, and Passing it to LoadDataFromDicts freezes the pipeline. code: ``` from datasets...

kouyakamada

## Description Add a `GenstructTask` that allows to parse the output from https://huggingface.co/NousResearch/Genstruct-7B

gabrielmbmb

select num_examples from HF dataset

2

In some cases, e.g. testing your pipeline before running it, one would like to select only a couple of examples from the HF dataset loaded in `src.distilabel.steps.generators.huggingface.LoadHubDataset`. Therefore I offer...

rasdani

[BUG] opaque Pipeline error messages due to Python `multiprocessing.pool` error callback

3

**Describe the bug** I had trouble figuring out why my pipeline was failing and the error messages were not informative. I managed to obtain a way more useful error message...

rasdani

[FEATURE] Thinking of adding a GroqLLM integration to distilabel

5

[Groq](https://wow.groq.com/why-groq/) is a startup developing LPU engines which provide 18x faster inference than GPUs. They currently provide Llama2-70B via API, and Mixtral 8x7B access on request. It would be great...

kcentric

[FEATURE] OpenAI Batch API Support

1

See [here](https://platform.openai.com/docs/api-reference/batch/create) for the API and [here](https://twitter.com/jeffintime/status/1779924149755924707?t=Tmo3Aoo62N5zA5PWLNiqUw) for the (Twitter) announcement. 50% discount would be huge as most large jobs running on distilabel are not time-critical for us. However there...

jphme

[FEATURE] Show expected number of batches in logging

1

**Is your feature request related to a problem? Please describe.** Currently, I get the message `Processing batch x` but this does not indicate how far we are. **Describe the solution...

davidberenstein1957

[FEATURE] create a pipeline playground UI

1

**Is your feature request related to a problem? Please describe.** I was speaking to Oras Al-Kubaisi, he proposed it might be nice to have a pipeline UI playground. I think...

davidberenstein1957

Improve passing large `_Batch` to steps

1

The `mp.Queue` that we're using to pass the data between the steps is very slow when it's used to send a lot of data (for example when accumulating `embeddings` from...

gabrielmbmb