deep-learning-with-python-notebooks icon indicating copy to clipboard operation
deep-learning-with-python-notebooks copied to clipboard

6.1-using-word-embeddings - There seems to be a bug

Open AI-Guru opened this issue 5 years ago • 1 comments

Hello,

I love this collection of notebooks! The book is great!

One thing. When using the GloVe embeddings, there seems to be a flaw in the implementation: When creating the embedding matrix, the indices should be shifted by 3. Doing so results in a 20% accuracy increase on validation data.

Best, Tristan

AI-Guru avatar Jul 23 '20 08:07 AI-Guru

Hi, I am a beginner. I don't know what does 'the indices should be shifted by 3' mean? Could you tell me how to do this and why? Thank you!

fangxuehouwuming avatar Aug 21 '22 13:08 fangxuehouwuming