FLMR

FLMR copied to clipboard

@LinWeizheDragon sorry to bother you. https://huggingface.co/datasets/BByrneLab/multi_task_multi_modal_knowledge_retrieval_benchmark_M2KR In this repo. What does pos item and relavant item mean?

mxw20010804

load model步骤缺少模型

10

# load models checkpoint_path = "LinWeizheDragon/PreFLMR_ViT-G" image_processor_name = "laion/CLIP-ViT-bigG-14-laion2B-39B-b160k" 大模型刚入门，根据您的方法复现，并未提到这两个从哪里来

zuichu35

用第一个方法加载也不行

4

import os import torch import pandas as pd import numpy as np from torchvision.transforms import ToPILImage from transformers import AutoImageProcessor from flmr import index_custom_collection from flmr import FLMRQueryEncoderTokenizer, FLMRContextEncoderTokenizer, FLMRModelForRetrieval...

lxlx2084

我把模型都下载到本地了，为什么加载时还要连接到HF？你知道的国内不能直连HF

2

from transformers import AutoConfig, AutoModel, AutoImageProcessor, AutoTokenizer import torch #%% checkpoint_path = "/data/liuxiang/58/20_项目/0_模型/PreFLMR_ViT-G" image_processor_name = "/data/liuxiang/58/20_项目/0_模型/clip-vit-large-patch14" query_tokenizer = AutoTokenizer.from_pretrained(checkpoint_path, subfolder="query_tokenizer", trust_remote_code=True) context_tokenizer = AutoTokenizer.from_pretrained(checkpoint_path, subfolder="context_tokenizer", trust_remote_code=True) #%% model = AutoModel.from_pretrained(checkpoint_path,...

lxlx2084

Related issues consultation

1

Dear Dr. Lin, I hope this message finds you well. I have a few questions I’d like to discuss with you. If convenient, could you please share your WeChat contact...

qiankunlee

No such file or directory

4

FileNotFoundError: [Errno 2] **No such file or directory: 'F:/PreFLMR/FLMR/examples\\test_experiment\\indexes/test_index.nbits=8\\_metadata.json_'** During handling of the above exception, another exception occurred: Traceback (most recent call last): File "F:\PreFLMR\FLMR\examples\example_use_flmr.py", line 382, in main(args) File...

XNDIC

Something about pretraining

11

Hi, I have some questions about pretraining. It seems that there is not any code about stage1 pretraing. I want to know more details about this stage. Thanks!

Baeksweety