Ax icon indicating copy to clipboard operation
Ax copied to clipboard

Multi-objective experiments generate duplicated data

Open HuizhiXu opened this issue 2 months ago • 5 comments

Hello,

I have been utilizing the multi-objective optimization approach for my specific use case. Here is a brief overview of the code I have implemented:

model = Models.MOO(
    experiment=self.experiment,
    data=self.experiment.fetch_data(),
    acqf_constructor=get_NEHVI,
)

generator_run = model.gen(1)

The code has been functioning effectively up until now. However, I have recently encountered an error. It appears that the generator may be producing duplicate data points during its operation.

截屏2024-04-23 17 11 03

Trial 23 and Trial 24 have same parameters.

Upon investigating potential causes, I found a similar issue here: Completed Multi-objective NAS experiments without metrics and repeated parameter selections The user in that issue also faced a problem with duplicate data generation.

The resolution suggested for their situation involved utilizing the Ax service API and setting the should_deduplicate parameter to True in the call to choose_generation_strategy.

Given this information, I am inquiring whether there is an equivalent parameter available within the Ax developer API that I could use to address the issue of duplicate data generation in my case. If such a parameter exists, I would greatly appreciate guidance on how to implement it in my current code setup.

HuizhiXu avatar Apr 23 '24 09:04 HuizhiXu