nni
nni copied to clipboard
it only ran 8 combinations each time, and then no code was running. But nni didn’t stop
Describe the issue: I ran it with the settings below, but it only ran 8 combinations each time, and then no code was running. But nni didn’t stop
Environment:
- NNI version: 3.0
- Training service (local|remote|pai|aml|etc): remote
- Client OS: mac
- Server OS (for remote mode only): linux
- Python version: 3.8
- PyTorch/TensorFlow version: 1.13
- Is conda/virtualenv/venv used?: conda
Configuration:
-
Experiment config (remember to remove secrets!): experimentName: sgd searchSpaceFile: search_space.json trialGpuNumber: 1 trialConcurrency: 8 max_trial_number: 10000 tuner: name: TPE classArgs: optimize_mode: maximize trainingService: platform: local useActiveGpu: True
-
Search space: { "lr": {"_type": "uniform", "_value": [0.0001, 1.0]}, "batch_size":{"_type":"choice","_value": [8, 16, 32, 64, 128]} }
How to reproduce it?:Why and How to deal with it?