VGCN-BERT
VGCN-BERT copied to clipboard
Louis-udm
Hi Louis, I want to combine embeddings extracted from a different source with 1) VGCN-BERT embeddings and 2) with only BERT embeddings. For this I modified the function `forward()` in...
Hello, may I ask, how is the [CLS] token in multi-layer self-attention initialized? What is its vector dimension?
@Louis-udm If we want to have other model rather than the one listed in modeling.py, e.g., longformer or robertA from the huggingface, what changed I need to make. I tried...
can you please tell the format of data, e.g, the coLa one, is it ID, label, text? I believe it is source of sentence | acceptability judgment label| acceptability judgment...
Hi, I want to ask about how to load the trained model and make evaluation predictions? Thanks a lot for your help
For a regression task like STS_B, the model is rounding the values to whole integers. What is the best way to make the model consider float outputs between 0-5? On...
Hi, Thank you for your great paper and implementation code. I have a document which consist of multiple paragraph, currently we have logic to extract the paragraph and had to...
Is the gcn embedding passed to a bert model and classified. i mean is the bert model used only as a classifier?
