monolith
monolith copied to clipboard
Question about embedding table lookup
I'm new to this repository and trying to figure out the demos. The embedding table lookup confused me a lot. It's said "Note that we do not use features directly to obtain the sparse ids here, as it is handled internally through self.lookup_embedding_slice", but how can the model's lookup_embedding_slice get the information of the sparse ids? Thanks