mlr3torch
mlr3torch copied to clipboard
Create `LearnerTorchFTTransformer`
Before implementing the learner. Just build it as a Graph. The graph consists of:
- Two input nodes (one for tokenization of categoricals, one for numerics). Need to maybe handle what happens when only numerics or only categoricals exist, but ignore for now.
- Apply the Categorical encoder to categorical inputs, numeric encoder to numerical inputs.
- A Merge PipeOp that combines the categoricals and numerics
- A
PipeOpTorchBlockthat takes in thePipeOpTorchthat represents a single transformer block (thePipeOpTorchBlockis responsible for repeating it multiple times - Build the output head using existing
PipeOpTorch.