TransformerX
TransformerX copied to clipboard
tensorops
Flexible Python library providing building blocks (layers) for reproducible Transformers research (Tensorflow ✅, Pytorch 🔜, and Jax 🔜)
Add the capability to support distributed computation
A list of new embedding layers to be added To contribute, please: 1. Create a new issue, copy an available (not closed and not opened by someone else) subtask name...
Use yaml format for the issue templates for feature-rich forms
Description: We need to implement several new attention masking layers in our model to improve its performance on specific tasks. The following masking layers need to be implemented: - [...
Update the documentation for the transformer decoder block
A list of new **embedding** layers to be added To contribute, please: 1. Create a new issue, copy an available (not closed and not opened by someone else) subtask name...
Handle the inputs and raise issues in case inappropriate was data provided. For contributing, please: 1. Create a new issue, copy an available (not closed and not opened by someone...
A list of new embedding layers to be added To contribute, please: 1. Create a new issue, copy an available (not closed and not opened by someone else) subtask name...
A list of new **attention** layers to be added You can pick any of the following frameworks and implement your layers: To contribute, please: 1. Create a new issue, copy...