ParameterImportance
ParameterImportance copied to clipboard
automl
Parameter Importance Analysis Tool
Guys, I have successfully installed parameter importance using cat requirements.txt | xargs -n 1 -L 1 pip install when I import fanova it does successfully but when I import pimp...
Hi, If I want to create the fanova plots, the single variable plots work, but pairs fail: ``` >>> python3.5 /home/schirrmr/programs/ParameterImportance/scripts/evaluate.py --scenario_file scenario.txt --history 'runhistories-shared/runhistory*.json' --modus fanova INFO:Importance:Reading Scenario file...
Use the EPM to determine which of all possible incumbents should be best. This avoids the necessity for a user to specify the trajectory file from which an incumbent should...
Originally opened by aaronkl in the fANOVA repo automl/fanova#17 Add function that automatically creates a pdf file with all plots and marginals
to imitate the original implementation we probably would need to discretize the pcs first, apply a one-hot encoding afterwards and then we can learn the linear model.
Running on the spear-qcp example (from SMAC3) ``` $ python ~/git/ParameterImportance/scripts/evaluate.py --scenario_file smac3-output_2017-05-12_12\:53\:31_\(750603\)_run1/scenario.txt --history smac3-output_2017-05-12_12\:53\:31_\(750603\)_run1/runhistory.json --trajectory smac3-output_2017-05-12_12\:53\:31_\(750603\)_run1/traj_aclib2.json --num_params 10 --modus all [...] INFO:fANOVA:PREPROCESSING PREPROCESSING PREPROCESSING PREPROCESSING PREPROCESSING PREPROCESSING INFO:fANOVA:Finished Preprocessing...
Running influence-model on the spear_qcp example, no combinations of parameters are considered. Are there no dependencies between the parameters or is not yet supported?