distilabel icon indicating copy to clipboard operation
distilabel copied to clipboard

[FEATURE] create a pipeline playground UI

Open davidberenstein1957 opened this issue 11 months ago • 1 comments

Is your feature request related to a problem? Please describe. I was speaking to Oras Al-Kubaisi, he proposed it might be nice to have a pipeline UI playground. I think it would be interesting to build something like this on external API framework to test what the pipeline looks like.

Describe the solution you'd like perhaps something in streamlit or gradio could be an option but I'm not sure how extensive they are w.r.t. being able to define components.

Describe alternatives you've considered Re-unning python code and looking at pandas/datasets reprs

Additional context N.A.

davidberenstein1957 avatar Feb 29 '24 20:02 davidberenstein1957

Hi @davidberenstein1957! This is an idea I had myself too :) I was thinking to build a small UI using Svelte that allows you to drag and drop steps from a catalog and connect them together, like no-code tools. It will generate the YAML, so you can run the pipeline from the CLI. I was thinking on hosting this on a hugging face space of course, and the pipeline could be executed from there too if desired :)

gabrielmbmb avatar Apr 09 '24 10:04 gabrielmbmb