Segmentation fault (core dumped)

[SachinVashisth]

The bug Hi! I am getting the message Segmentation fault (core dumped) while running the following code.

To Reproduce

from guidance import models, gen

llama3 = models.Transformers("meta-llama/Meta-Llama-3-8B-Instruct", device_map = 'auto')
llama3 + f'Do you want a joke or a poem? ' + gen(stop='.')

System info (please complete the following information): guidance version is 0.1.15

GPU info: