AFT

Results 18 issues of AFT

- move preprocess word embeddings to dataset class - make word embeddings attribute of dataset class - decouple from datamodule logic - Should be identical to sentence embeddings logic -...

- Adapt Readme to new package structure - To do just before first release after development is finished

documentation

- Check current preprocessing implementation - Include further preprocessing steps if necessary

help wanted

- make preprocessing possible for other languages -> see langdetect

enhancement

Include Positional Invariance Layer. -> independent of model class. Optionally have submode invariance layers in between sub-layers.

enhancement

Include pre-encoded column name embeddings and use as e.g. hadamard product between encodings and embeddings.

enhancement

Include Jamba arch. -> Default to Attention Layer at beginning. @nwuestefeld

enhancement

Include own mamba/mamba2 Triton version. @nwuestefeld

enhancement