distilabel
distilabel copied to clipboard
[FEATURE] Align API of standalone usage of `Step.process()` with `Pipeline.run()` `parameters` arguments
Is your feature request related to a problem? Please describe.
Within the docs, we do advertise that people can use Steps
as Standalone components, which prove useful for quick demos, prompt engineering etc, but the API usage doesn't align with passable parameters
like within Pipeline.run()
. This would help with iteration and building demos.
Describe the solution you'd like
I would expect the Step. process()
to potentially take a parameters
argument or define a separate method for standalone usage, like Step.run()
which does (assuming Step. process()
is used within the Pipeline.run()
and changes might be difficult.
Describe alternatives you've considered
Looking into the source code and define/overwrite parameters through attribute assignment before calling Step. process()
.
Additional context N.A.