Mikołaj Piórczyński

[WinError 193] %1 is not a valid Win32 application

3

D:\Python>jupyter kernelspec list Available kernels: octave D:\anaconda3\share\jupyter\kernels\octave python3 D:\anaconda3\share\jupyter\kernels\python3 D:\Python>python -m octave_kernel.check Octave kernel v0.32.0 Metakernel v0.27.5 Python v3.8.3 (default, Jul 2 2020, 17:30:36) [MSC v.1916 64 bit (AMD64)] Python...

Why prepruning distillation?

1

Hi, I have a question about the intuition behind the prepruning distillation step. Why are you not initializing the student model from the teacher weights, instead of initializing it from...