ML-KWS-for-MCU
ML-KWS-for-MCU copied to clipboard
Optimal parameters for DS-CNN
I have trained a DS-CNN model with the same hyperparameters available in the guide. I have also done the fusion of batch normalization layers and after this I have tried to quantize weights and biases with the following command
python3 quant_test.py --model_architecture ds_cnn
--model_size_info 5 64 10 4 2 2 64 3 3 1 1 64 3 3 1 1 64 3 3 1 1 64 3 3 1 1
--dct_coefficient_count 10 --window_size_ms 40 --window_stride_ms 20
--checkpoint ../tmp/speech_commands_train/best/ds_cnn_9349.ckpt-22000_bnfused
--act_max 32 0 0 0 0 0 0 0 0 0 0 0
I read in the guide that the value of act_max that I used, quantizes only the first layer (input layer) and not other layers. Has anyone experienced a good hyperparameters configuration to get a net suitable for Small class? I need a model that runs on a microcontroller with 128 KB of RAM, with an high accuracy.