evo

evo copied to clipboard

Extracting EVO representations rather than logits

5

Hi, thanks for your amazing work! How can I extract representations rather than logits from the model? I am using the huggingface version, and I see the model returns `logits'...

amoskalev

Inquiry Regarding Local Model Usage and Importing Model Files

2

Due to connectivity issues with my server, I am unable to directly access the HuggingFace. As a result, I encountered difficulties when attempting to import models using the standard methods,...

yyly6

Thanks a lot for your exceptional work and model. In the TogetherAPI call, you can generate log probability per token for downstream sequence analysis, as you demonstrated in your notebook...

AhmedKazlak

Max Seq length for inference

1

May I ask the proper range for input sequence length to do the inference using the evo-1-131k-base model? I tried to use a single A100 and got CUDA Out of...

JunboShen

Hello Evo team, thanks for an exciting release. Is there any chance we will ever see dataset creation and training code released? I believe this would be great for open...

chaitjo

AssertionError: rotary_emb is not installed

3

i try the fllow code： `from transformers import AutoConfig, AutoModelForCausalLM model_name = 'togethercomputer/evo-1-8k-base' model_config = AutoConfig.from_pretrained(model_name, trust_remote_code=True) model_config.use_cache = True model = AutoModelForCausalLM.from_pretrained( model_name, config=model_config, trust_remote_code=True, )` raise error ：AssertionError:...

bioone

Hi everyone, I was trying to run the example scripts/score.py file and encountered this error of "torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 96.00 MiB. GPU" I'm using a...

bio-rat

# Next is the script I will use import os GPU_NUMBER = [1,2,6,8,9] os.environ["CUDA_VISIBLE_DEVICES"] = ",".join([str(s) for s in GPU_NUMBER]) import torch from torch.utils.data import DataLoader from transformers import AutoConfig,...

qijishinidie

Hello, Is it possible to alter the model's attention radius, such that the model only applies attention within a certain window in the input? A second question: Can you instruct...

george-henderson

ModuleNotFoundError: No module named 'transformers_modules.togethercomputer.evo-1-131k-base.9562f3fdc38f09b92594864c5e98264f1bfbca33.tokenizer'

8

Hi all and thanks for open sourcing this interesting model! I managed to install flash-attention and all other packages so I am able to import Evo package. But I am...

adrienchaton