ViPNAS icon indicating copy to clipboard operation
ViPNAS copied to clipboard

About search algorithm

Open helloyuning opened this issue 1 year ago • 3 comments

Thanks for your grate work

I am new to this profession, so I have some basic questions about VIPNAS:

As stated in the paper, VIPNAS searches five dimensions to find the optimal structure. But there is no mention of what kind of policy to adjust the model. For example, the author said that the current frame and the next frame will use different structures, so what policies or conditions are the structure adjustments based on? In short, the model is adjusted based on what changes

Sorry for my basic question

Best

helloyuning avatar Mar 03 '23 00:03 helloyuning

"what policies or conditions are the structure adjustments based on? " ---Are you asking about what aspects of the model can be changed? ---> The five dimension search space includes network depth, width, kernel size, group number, and attentions.

The goal of network search is to find the best model with lowest flops.

jin-s13 avatar Mar 03 '23 05:03 jin-s13

Tanks for your reply!

helloyuning avatar Mar 17 '23 06:03 helloyuning

Have you ever trained vipnas_res34? Do you have pre-trained nas_res34 network weights?

helloyuning avatar Mar 17 '23 06:03 helloyuning