arctic-captions
arctic-captions copied to clipboard
kelvinxu
I would like to have 'coco_align.train.pkl' and other pkl files. I tried https://github.com/intuinno/arctic-captions https://github.com/rowanz/arctic-captions https://github.com/Lorne0/arctic-captions but failed. Please help me..
From line 84,85 and 97,98 of the optimizer.py , we can see the b1 and b2 here are correspond to '1-b1' and '1-b2' respectively of the original adam paper, i.e.,...
any tutorial for the codes? I can hardly understand all these files. I run the ipynb cells and can't find model_name.npz. It seems dev_list and image_path also need be specified....
It seems like when computing the [doubly stochastic attention](https://github.com/kelvinxu/arctic-captions/blob/master/capgen.py#L1177), the code is doing: `alpha_reg = alpha_c * ((1.-alphas.sum(0))**2).sum(0).mean()` As per my understanding alphas is of dimensions [sequence_length, batch_size, feature_map_spatial_extent] which...
I found the split of test/val is different from what is given in karpathy/neuraltalk2. According to their script https://github.com/karpathy/neuraltalk2/blob/master/coco/coco_preprocess.ipynb They tried to get first 5000 as val, 5000-10000 as test...
What input should be given to model? Is there any model file for this argument or I have to create?
Is there a step-by-step instruction on how to train the model on COCO dataset? I cloned the repo and tried running capon.py but that didn't work.
The init value of decay_c is 0,how to set this value when use the L2 regularization
Hi Kelvin, After I trained model 2000 epochs, I tried to use generate_caps.py to get the captions. However, the result was meaningless. Is there anything I need to take care...
