saint icon indicating copy to clipboard operation
saint copied to clipboard

verified publisher icon ogunlao
→

Metadata

Unofficial Pytorch implementation of SAINT: Improved Neural Networks for Tabular Data via Row Attention and Contrastive Pretraining https://arxiv.org/abs/2106.01342

Results 3 saint issues
Sort by recently updated
recently updated
newest added

Update saint_i.py

Inter sample attention now inherits from nn.MultiheadAttention which includes optimizations such as flash attention

jackwilkie avatar jackwilkie

[def intersample() question]

When reshaping queries, keys, and values in the intersample() function, shouldn’t they be changed to (1, h, b, n*d)? The code has a structure in which 8 heads per batch...

rch1025 avatar rch1025

does not work for pytorch 2.0

also, task is not specified in the `Metric` class

annimukherjee avatar annimukherjee

← Metadata

20
Stars
7
Forks
Watchers

Owner

verified publisher icon ogunlao

Metadata

Unofficial Pytorch implementation of SAINT: Improved Neural Networks for Tabular Data via Row Attention and Contrastive Pretraining https://arxiv.org/abs/2106.01342

Back