SAT icon indicating copy to clipboard operation
SAT copied to clipboard

Official Pytorch code for Structure-Aware Transformer.

Results 3 SAT issues
Sort by recently updated
recently updated
newest added

Question: Why use dot product for Q and K in Eq. (4)? Describe: I read the paper "GraphiT: Encoding Graph Structure in Transformers", and the Eq. (5) in this paper,...

I'm interested in reproducing your experiments as related to larger k-hop GNNs, as depicted in Figure 3a in the paper. However, when training models with k-hops such as 5 or...

My environment are: CUDA 11.8, pytorch: 2.0.0, torch_sparse: 0.6.7, but I found that could not run. Can you tell me your details about the above environment?