distilabel icon indicating copy to clipboard operation
distilabel copied to clipboard

[FEATURE] Align API of standalone usage of `Step.process()` with `Pipeline.run()` `parameters` arguments

Open davidberenstein1957 opened this issue 8 months ago • 3 comments

Is your feature request related to a problem? Please describe. Within the docs, we do advertise that people can use Steps as Standalone components, which prove useful for quick demos, prompt engineering etc, but the API usage doesn't align with passable parameters like within Pipeline.run(). This would help with iteration and building demos.

Describe the solution you'd like I would expect the Step. process() to potentially take a parameters argument or define a separate method for standalone usage, like Step.run() which does (assuming Step. process() is used within the Pipeline.run() and changes might be difficult.

Describe alternatives you've considered Looking into the source code and define/overwrite parameters through attribute assignment before calling Step. process().

Additional context N.A.

davidberenstein1957 avatar Jun 19 '24 10:06 davidberenstein1957