MMGL
MMGL copied to clipboard
minjiyoon
Multimodal Graph Learning: how to encode multiple multimodal neighbors with their relations into LLMs
I found that the model you used in the script is opt-350m, while the one mentioned in the article is opt-125m, indicating different versions. Would this affect the final results?...
When i read your code in `preprocess_data.py`, i am confused about the following code: https://github.com/minjiyoon/MMGL/blob/21f97f713472c9e9e31c83f3627b15212f35fe48/wikiweb2m/preprocess_data.py#L191 I think you want to sample 600k pages, so it should be `break` in line...
Could you please provide the preprocessed data? It's quite hard to finish the preprocessing, especially when the network connection is unstable.
I ran your code, but found that some functions in the Laplacian and GNN parts were not implemented. May I ask if you did not open source all the code?...
