HVPNeT icon indicating copy to clipboard operation
HVPNeT copied to clipboard

question

Open lv-9527 opened this issue 10 months ago • 5 comments

Hello, I did the training and testing exactly as README did, but it didn't matter what I predicted. The tensor output was also Nan. According to the debugging, it is Bert. In PY, "Prompt = [] for name, layer in self.resnet.named () : if name = = 'FC' or name = = 'avgpool' : continue x = Layer (x) # (BSZ, 256,56,56)" causes X to all be 0. Do not know how to change to normal training and testing, request guidance. Here are the predictions I printed out after my test. The two white lines above are the correct answers, and below are the predictions. You can see that they are all zeros, corresponding to the dictionary“No relationship between entities.”. f3bc339e4986f7d42f19f3a150764a2

lv-9527 avatar Apr 16 '24 12:04 lv-9527

Hello,

Thank you for your interest in our work. We apologize for the issue you've encountered, which we have not come across in our previous experiments. We recommend that you first verify the consistency of your environment configuration version with the README file.

Due to our busy work schedule and the considerable time since we last engaged with this code, we anticipate revisiting the experiment over the weekend to assist you in troubleshooting the problem. We will provide you with a response at that time.

We appreciate your understanding and patience in this matter.

Xiang Chen

njcx-ai avatar Apr 17 '24 04:04 njcx-ai

hello   ,Xiang Chen: Thanks for your reply, I re-checked my environment configuration and it is exactly the same as the README file. I do not know exactly what the problem is, because my graduation thesis and this project related, so more anxious, hope to get your reply as soon as possible. Thank you very much!

------------------ 原始邮件 ------------------ 发件人: "zjunlp/HVPNeT" @.>; 发送时间: 2024年4月17日(星期三) 中午12:14 @.>; @.@.>; 主题: Re: [zjunlp/HVPNeT] question (Issue #18)

Hello,

Thank you for your interest in our work. We apologize for the issue you've encountered, which we have not come across in our previous experiments. We recommend that you first verify the consistency of your environment configuration version with the README file.

Due to our busy work schedule and the considerable time since we last engaged with this code, we anticipate revisiting the experiment over the weekend to assist you in troubleshooting the problem. We will provide you with a response at that time.

We appreciate your understanding and patience in this matter.

Xiang Chen

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

lv-9527 avatar Apr 18 '24 03:04 lv-9527

Hi,

Did you predict using the model you trained yourself? How did the model perform during training? In the RE task, 0 means that the two entities are not related, and predicting 0 is normal because there are many unrelated instances in the dataset.

flow3rdown avatar Apr 21 '24 07:04 flow3rdown

Hello, thank you for your reply, I have solved the problem that predicted 0 before. The reason: I have the CPU version of CUDA as required by the requirements, but the GPU version is fine. But I still have a problem: I now want to replace the image and text data sets with my own images and text. What I need is the relation extraction aspect, there is MRE in the TXT folder in Re. PTH, MRE. PTH, MRE. PTH, based on my observations, these should be similar to a dictionary that will slice images and text maps, but I do not know how this is generated. I now have my own text, dictionary DICT, and pictures. The PTH file is missing, and the model won't work without it. I looked at the instructions on github and figured that you'd need a Data pre-processing, an NLTK parser to extract noun phrases from text, a toolkit to detect objects, and a dictionary to record relationships between objects. Can you be more specific, how is the PTH file generated? 微信图片_20240425142437

你好

你用你自己训练的模型预测了吗?模型在训练期间的表现如何?在 RE 任务中,0 表示两个实体不相关,预测 0 是正常的,因为数据集中有许多不相关的实例。

lv-9527 avatar Apr 25 '24 06:04 lv-9527

You need first to extract the noun phrases from the text using the NLTK parser, Spacy, or TextBlob. Then you can utilize the visual grounding toolkit to detect objects. More details can be seen in its repository. In addition, you need to record the correspondence between images and objects for subsequent reading.

flow3rdown avatar Apr 26 '24 12:04 flow3rdown

Do you have any further questions?

zxlzr avatar Jul 18 '24 14:07 zxlzr