meshed-memory-transformer

meshed-memory-transformer copied to clipboard

RuntimeError: gather(): Expected dtype int64 for index, in beam_search/beam_search.py, line 26, in fn

1

Meshed-Memory Transformer Evaluation Evaluation: 0%| Evaluation: 0%| | 0/500 [00:00

linhuixiao

FileNotFoundError: [Errno 2] No such file or directory: 'java'

1

Meshed-Memory Transformer Evaluation Evaluation: 0%| | 0/500 [00:00

linhuixiao

variance dtype issue

7

Traceback (most recent call last): File "test.py", line 77, in scores = predict_captions(model, dict_dataloader_test, text_field) File "test.py", line 26, in predict_captions out, _ = model.beam_search(images, 20, text_field.vocab.stoi[''], 5) File "/home/mingjie/meshed-memory-transformer/models/captioning_model.py",...

Bueno1887

the caption is incomplete

22

I use https://github.com/peteanderson80/bottom-up-attention/ for feature extraction on my own images, and then run the image caption model, but the result caption is incomplete. e.g.  caption: "a view of a...

whqwill

Memory issue during RL optimization

3

Hello, Many thanks for releasing the repo. I am trying to train a model on a custom variation of MSCOCO though I keep the train/test/valid sizes equal to the Karpathy...

gpantaz

Problems while running test.py

8

I tried to test the model, but I got this problem. Does anybody know how to solve it? I used the environment provided here. python test.py --features_path data/coco_detections.hdf5 --annotation_folder annotations...

jieun1128

Hi,dear author: Thanks your great job,I am rencently working on RL training in another task. I take your scst training code to reference, and I got a terrible result. My...

superhero-7

Performance without reinforce optimization stage

1

Hi, Thanks for providing the implementation. I checked the paper and observe that only performance with reinforce optimization is reported. I wonder if you can report the performance of your...

wdyin

The evaluation when runnin test.py

3

Hi. When I run the test.py to evaluate, the model just generates without any other tokens.

Timon0327

Reproduce the Visualization of Attention States

2

Hello! Thanks for this great code! I find there is the visualization of attention states for captions, [like this](https://github.com/aimagelab/meshed-memory-transformer/blob/master/images/results.png). I want to reproduce the visualization results, but I cannot find...

peterfind