gflownet
gflownet copied to clipboard
state2proxy
-
state2proxy
can be eitherstate2oracle
orstate2obs
. Input arg ofstate2oracle
is a list of states, and that forstate2obs
is a single state. To use both of them interchangeably asstate2proxy,
the input form should be the same. - Need to add support for transformer-friendly data transformation. This would be as simple as changing the data type of state to
int
orNone
transformation. (In the latter case, transformation toint
can be done within the forward call of the transformer itself.)state2oracle
cannot be used as the transformer-friendly transformation because: a. for e.g., for the grid if we usestate2proxy = state2oracle
, input states to the transformer would be [-1, -1] (oracle-friendly) instead of [0, 0]) and the embedding for negative indices is not defined, b. it is not necessary that the oracle takes indices as input (necessary for the embedding layer)