Brad Larson

Add logging callbacks for training statistics

1

The training loop abstraction has a visual progress bar for tracking statistics during training. In many cases, it's desirable to log or store training statistics for later analysis, or to...

Transformer model requires more parameters than supported on TPU

2

It [has been pointed out by Wojtek Czarnowski](https://groups.google.com/a/tensorflow.org/d/msg/swift/NyAg6MV5PT0/0KjPYSGdBQAJ) that in specific cases the Transformer model (or components used within it) can trigger a compilation error in X10 on TPU: ```...

The DQN implementation within the Gym examples additionally needs Matplotlib and Numpy to work correctly, and we should create a section in the Readme there that describes this model and...

Convert image classification and generative examples to use X10 by default

5

With the release of the 0.9 toolchain containing X10, we now have a higher-performance alternative to the default eager execution mode. In the interest of having swift-models demonstrate best practices,...

All of our model inference unit tests use the default eager mode for execution. With X10 now available as an additional backend, we might want to add a parallel set...

After importing the initial BERT model into the repository, there are a few remaining to-do items to expand upon this work (extracted from [Dan's comment](https://github.com/tensorflow/swift-models/pull/231#issuecomment-586036174)): - [ ] Rewrite utilities...

PR #418 replaced the core usage of TensorFlow.Dataset with the new Batcher mechanism. This is a step forward, but there was one small piece of old functionality missing in the...

[SR-15985] [AutoDiff] Specific custom VJP triggers assertion "internal/private function cannot be serialized"

3

| | | |------------------|-----------------| |Previous ID | SR-15985 | |Radar | None | |Original Reporter | @BradLarson | |Type | Bug | Additional Detail from JIRA | | | |------------------|-----------------|...

[SR-15667] [AutoDiff] Providing exact type for generic parameter in @differentiable can lead to an assertion failure

2

| | | |------------------|-----------------| |Previous ID | SR-15667 | |Radar | None | |Original Reporter | @BradLarson | |Type | Bug | Additional Detail from JIRA | | | |------------------|-----------------|...

[SR-15666] [AutoDiff] Assertion failure when differentiating through a map function involving keypaths

2

| | | |------------------|-----------------| |Previous ID | SR-15666 | |Radar | None | |Original Reporter | @BradLarson | |Type | Bug | Additional Detail from JIRA | | | |------------------|-----------------|...