clearml icon indicating copy to clipboard operation
clearml copied to clipboard

It is impossible to make hyper parameters section in pipeline

Open IlyaMescheryakov1402 opened this issue 2 years ago • 3 comments

How can I add hyper parameter section like "custom_field" on pic below? image

but for the pipeline on decorators?

I have too much hyper params in pipeline and all of them placed in "Hyperparameters -> Args" section. Task sections (which have been added using task.connect(..., name=)) are not displayed in pipeline ones.

There is no information on my question in docs

Thank you in advance

IlyaMescheryakov1402 avatar Mar 31 '22 15:03 IlyaMescheryakov1402

Hi @IlyaMescheryakov1402,

Great idea! Actually, at the moment we don't have such capability...How many arguments do you have per pipeline?

I think we can add to the pipeline decorator something like: @PipelineDecorator.pipeline(name='custom pipeline logic', project='examples', argsmap={'sectionA':['paramA'], 'sectionB:['paramB','paramC']}) and if no section is specified we'll put it into args?

Would that work?

Erez

erezalg avatar Apr 03 '22 08:04 erezalg

Hi @erezalg

About 30-40 arguments per pipeline.

Yeah, sure, I think it will work)

Thank you!

Waiting for the new version with this feature :)

ilya

IlyaMescheryakov1402 avatar Apr 03 '22 09:04 IlyaMescheryakov1402

Hi @IlyaMescheryakov1402 , Good news! ClearML V1.5.0 is out! (pip install clearml==1.5.0) with support to specifying HP sections :D You can do so by calling: @PipelineDecorator.pipeline(args_map={'SectionA':['paramA'], 'SectionB':['paramB]})

This will map all the values in the list (paramA for instance) to the key (SectionA) which is the Section's name.

Let me know if you have any questions and enjoy :)

erezalg avatar Jun 19 '22 11:06 erezalg

Hi @IlyaMescheryakov1402, closing this. Please re-open if required.

jkhenning avatar Sep 12 '22 06:09 jkhenning