Millie

icon company university of southampton icon location Snow flakes in January

Results 5 comments of Millie

Hard or Soft template when using SoftTemplate

Have you ever solved this problem? (I guess they use a hybird way through soft_template)

The tokenizer add_special_tokens parameter for t5 model lambada task

I meet some problems when using metric 'exact match' on t5-XXL or t5-Xl as well (BBH evaluation, got low-quality generation but have no idea so far)

'PromptForGeneration' object has no attribute 'can_generate'

> Faced the same error. tried with transformers 4.19.0 and it worked. But 4.19.0 doesnt have LlamaConfig, LlamaForCausalLM or LlamaTokenizer. > > Does anyone know how can i use llama2...

RuntimeError: CUDA error: device-side assert triggered

> I got the same error. Before, I encountered OOM error, so I reduced the batch size by half. > > When I ran my code again, I got: RuntimeError:...

RuntimeError: CUDA error: device-side assert triggered

These errors occur randomly. Sometimes they happen, and at other times, the same settings work without issue, only to fail again later. I suspect there are deeper conflicts that I...