Albert Zeyer

So, we basically have outlined a possible solution for this in the discussion in #447. Basically, what we want (`self` being the layer): * Let's assume you have `param =...

(The assignment is just such that you keep track of this, as this might be relevant for you. Of course feel free to participate more actively as well! E.g. by...

Some update: Some initial implementation is there now. However this mostly just covers the cluster setup, and starting the TF servers. This is mostly also intended for between-graph replication. But...

`VerifyOutShapeException` is also expected. When the template construction runs into a dependency loop, so there is some layer which can not be constructed, it assumes some simple dummy shape for...

Maybe, if all layers which are used via `prev:...` specify `out_shape`, and we use that shape always, then in fact no other exceptions should occur.

> #649 is currently pending because we don't want to extend ChoiceLayer with even more special cases. > > Quote from [#649 (comment)](https://github.com/rwth-i6/returnn/pull/649#issuecomment-919278027) > > > In general, we always...

> An important difference to #391 is that here we manipulate the beam, and we want to hide that from the user/network definition as much as possible. No, it doesn't...

Btw, on having the beam part of the batch dim: This was a very simple way to make sure all other layers can just operate as normal without any modification....

As usual, we should not break old configs. So `ChoiceLayer` would stay there in any case. This would be an alternative to `ChoiceLayer`. Some user code might make use of...

> But selection of `src_beams` of layer inputs should still be done automatically, right? This would be part of the pruning. So for `SearchPruneLayer` (and `ChoiceLayer`). Pruning is basically the...