nni icon indicating copy to clipboard operation
nni copied to clipboard

[feature_request] `nnictl` with batch operation

Open busFred opened this issue 1 year ago • 0 comments

I have conducted multiple experiments with nnictl create and below is a list of all the experiments that I have conducted.

(ace) fred@fred-ThinkPad-T480s:~$ nnictl experiment list --all
----------------------------------------------------------------------------------------
                Experiment information
Id: xfjd2uhs    Name: p_1.0_niter_5000    Status: STOPPED    Port: 8080    Platform: local    StartTime: 2023-07-19 21:55:13    EndTime: N/A
Id: p4jsgcdm    Name: p_0.8_niter_5000    Status: STOPPED    Port: 8080    Platform: local    StartTime: 2023-07-19 17:24:00    EndTime: N/A
Id: kzlxhp9b    Name: p_0.5_niter_5000    Status: STOPPED    Port: 8080    Platform: local    StartTime: 2023-07-19 17:25:58    EndTime: N/A
Id: n7duobet    Name: p_0.3_niter_5000    Status: STOPPED    Port: 8080    Platform: local    StartTime: 2023-07-19 17:27:00    EndTime: N/A

----------------------------------------------------------------------------------------

I need to do some post processing with the experiment result in python, so I need to export experiment results into csv files. However, I currently have to manually run nnictl view <exp_id> && nnictl export <exp_id> --type csv --filename <exp_name>_<exp_id>.csv && nnictl close --all for each experiment on the list, which is extremely tedious.

Is it possible to have a command that do these operation in batch? I also don't quite understand why I have to "view" the experiment before exporting. Can't nnictl export view and close the experiment on its own if the service isn't running yet?

busFred avatar Jul 20 '23 14:07 busFred