ScalphaGoZero icon indicating copy to clipboard operation
ScalphaGoZero copied to clipboard

Can weights from leela-zero training be used to bootstrap the ScalphaGoZero network?

Open barrybecker4 opened this issue 5 years ago • 3 comments

Question

I assume that ScalphaGoZero will not play very well without a whole lot of training first. Leela-zero has been training its network for over a year now. Both of these projects claim to use the same residual convolutional neural net architecture as the original apha-go-zero paper. Would it be possible to just use the weights already learned from the many months of leela-zero crowd-sourcing as a starting point for ScalphaGoZero learning? If so, what are the steps to do it?

barrybecker4 avatar Apr 03 '19 15:04 barrybecker4

@barrybecker4 we "just" need to understand how the weights are stored. If you manage to read them from Python and store them, for instance, in npy format, we can definitely load them as Nd4j arrays and eventually set them as weights for a corresponding ScalphaGoZero network.

maxpumperla avatar Apr 10 '19 09:04 maxpumperla

Let me know if you want to tackle this. I can point you to the right places, but don't currently have time to get my hands dirty, I'm afraid. :/

maxpumperla avatar Apr 10 '19 09:04 maxpumperla

Thanks. I'm not quite ready to look at it at the moment but hope to get to it eventually.

barrybecker4 avatar Apr 10 '19 15:04 barrybecker4