`question` Replicate behavior with seed

[vmanriq]

Description

I am trying to replicate the run with the same seed, but SMAC gives me a different result with the same seeds

Steps/Code to Reproduce

Run muliples time smac with the command python3 scripts/smac --scenario scenario.txt --seed 3

Expected Results

The same output in multiples runs

Actual Results

Diferent parameters values using the same initial seed

Versions

1.0.1

[dengdifan]

hi, how is the function that you want to optimize looks like? If the function cannot output fixed value with fixed seed, then it is very likely that SMAC will generate different incumbent values

[vmanriq]

The function i want to optimize can recibe a seed to get same value every time ! The parameters of the alghoritm is the seed, one parameter to optimize and the instance

[dengdifan]

Sorry for the late reply, this is truely a bug when working with multi-instances problems, intensifier will not suggest the same configuration when doing intensification, we will figure this out and hopefully fix that in the next release

[stale[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[timruhkopf]

Hi, I have been looking into your problem -- in the new release, there won't be a cmd interface anymore. But multiple instances with seeds are deterministic now.

Should you unexpectedly face the issue after the release please let us know.