Adam Gibson
Adam Gibson
@DarkWingMcQuack yes you can use the samediff-import-onnx. It's not fully baked yet though. If you want to give it a shot, I'd be happy to take a look at your...
@pza94 I would first do a warmup and use something like JMH for benchmarking to avoid the warmup problem. I would also advise trying onednn and seeing if that's relevant....
@pza94 can you try including onednn-avx and see if that helps? The issue might be with openblas pre picking avx in any of the binaries despite what libnd4j's been compiled...
@daviddbal @pza94 we'll be doing a follow up release in the next week or so to address some of this. We need to chase down the root cause of this...
@daviddbal openblas comes with nd4j-native as well as a transitive dependency. You can see the comprehensive list of dependencies here: https://github.com/eclipse/deeplearning4j/blob/master/nd4j/nd4j-backends/nd4j-backend-impls/nd4j-native-platform/pom.xml If you have issues with using openblas or mkl,...
Adding link to other thread for posterity just in case this comes up in future search results: https://community.konduit.ai/t/amd-ryzen-5000-cpu-poor-performance/1554/13
Just noting also for folks who aren't familiar with this problem, see an example fix by matlab: https://www.extremetech.com/computing/308501-crippled-no-longer-matlab-2020a-runs-amd-cpus-at-full-speed https://www.reddit.com/r/matlab/comments/dxn38s/howto_force_matlab_to_use_a_fast_codepath_on_amd/ In essence, the solution could be just adding: ``` export MKL_DEBUG_CPU_TYPE=5...
@pza94 @daviddbal @quickwritereader and I dove in to this and found that onednn was not being invoked properly. We did find some minor speedups on AMD software but didn't do...
@pza94 @daviddbal we'll be doing a release soon and have just merged a pull request that addresses the visibility of the helpers to ensure they are being used. We will...
@robert-E sorry prepping for the next release and just getting to some issues. If you don't hear from me, please reping me in the future. Ideally, we could either guide...