distilabel icon indicating copy to clipboard operation
distilabel copied to clipboard

[FEATURE] Add `exclude_from_signature` attribute

Open gabrielmbmb opened this issue 6 months ago • 0 comments

Is your feature request related to a problem? Please describe. As all the attributes of an Step are used to compute the signature of the pipeline, changing one attribute that shouldn't affect on the results, such as the input_batch_size, gpu_memory_utilization, resources, etc change the signature of the pipeline not allowing to reuse the cache of previous executions with the same generation parameters.

Describe the solution you'd like Add an attribute called exclude_from_signature (via mixin?) that allows specifying the names of attributes of the class that shouldn't be used to compute the signature.

gabrielmbmb avatar Aug 12 '24 06:08 gabrielmbmb