addons
addons copied to clipboard
Useful extra functionality for TensorFlow 2.x maintained by SIG-addons
I found that when I used a very large model like robert-large,the implementation of gradients accumulation like this https://gist.github.com/innat/ba6740293e7b7b227829790686f2119c may be very expensive for the gpu memory because I need...
This cherry-picks #2582 onto the 0.14 release branch. /cc @bhack
The current implementation does: ```python def _resource_apply_dense(self, grad, var, apply_state=None): with tf.control_dependencies( [self._decay_weights_op(var, apply_state=apply_state)] ): return super()._resource_apply_dense(grad, var, apply_state=apply_state) ``` This means that the optimizer (Adam) update using the gradient...
**System information** - OS Platform and Distribution (e.g., Linux Ubuntu 16.04): CentOS Linux release 7.4.1708 (Core) - TensorFlow version and how it was installed (source or binary): 2.1.0 - TensorFlow-Addons...
**System information** - OS Platform and Distribution :colab Linux - TensorFlow version:2.4.1 - TensorFlow-Addons version:0.12.1 - Python version:3.7.10 - Is GPU used? (yes/no): yes I have used the specific versions...
# Issue The `tfa.image.gaussian_filter2d` function doesn't seem to support tensors for its `filter_shape` and `sigma` arguments. Instead it only accepts `int`s and `float`s respectively, severely limiting the use case. https://github.com/tensorflow/addons/blob/8cec33fcaaf1cf90aec7bdd55a0fcdbb251ce5c2/tensorflow_addons/image/filters.py#L221-L222...
**Describe the feature and the current behavior/state.** Can `RectifiedAdam` have same parameter `exclude_from_weight_decay` as `AdamW`? We must exclude some parameters of the model from weight decay. **Relevant information** - Are...
# Description Brief Description of the PR: Fixes # (issue) ## Type of change - [x] New Metric and the changes conform to the [metric contribution guidelines](https://github.com/tensorflow/addons/blob/master/tensorflow_addons/metrics/README.md#contribution-guidelines) # Checklist: -...
**System information** - OS Platform and Distribution (e.g., Linux Ubuntu 16.04): **test on macOS 12.2 and Ubuntu 18.04.6 LTS** - TensorFlow version and how it was installed (source or binary):...
**System information** - OS Platform and Distribution (e.g., win11): - TensorFlow version and how it was installed (tf==2.8): - TensorFlow-Addons version and how it was installed (tfa==0.16.1): - Python version:(3.9.7)...