Conformer
Conformer copied to clipboard
Rishit-dagli
An implementation of Conformer: Convolution-augmented Transformer for Speech Recognition, a Transformer Variant in TensorFlow/Keras
**Describe the bug** ``` File "/home/modelparser/Conformer/conformer_tf/conformer_tf.py", line 168, in call inputs = self.conv(inputs) + inputs File "/home/modelparser/Conformer/conformer_tf/conformer_tf.py", line 128, in call return self.net(inputs) File "/home/modelparser/Conformer/conformer_tf/conformer_tf.py", line 89, in call return...
When running the provided example for ConformerBlock, it is not possible to change the encoder dimension. Setting dim=256 yields: > tensorflow.python.framework.errors_impl.InvalidArgumentError: Exception encountered when calling layer "conformer_block" (type ConformerBlock). Incompatible...
Hello, Thank you for translating the PyTorch script to TensorFlow :) I have a question about the input shape that we can feed to the ConformerBlock. The block, currently, can...
## :page_facing_up: Context This PR resolves the limitation where Conformer blocks could only handle fixed-length sequences. The original implementation: - Used static shape checking (`inputs.shape[-2]`) in Attention layer - Created...
Metadata
Owner
Metadata
An implementation of Conformer: Convolution-augmented Transformer for Speech Recognition, a Transformer Variant in TensorFlow/Keras