malloyca comments

Repositories
Issues
Comments

Results 1 comments of


                                            malloyca

float16 quantization runs out of memory for LSTM model

I have also encountered this problem using TensorFlow version 12.2.1 on my system. Non-optimized conversion works fine with LSTM, but float16 optimization is causing my kernel to crash repeatedly.