Shahrad

icon indicating a website link https://emzedi.github.io/homepage/

icon company McGill University icon location Montreal icon location ML Researcher @ MILA | MSc @ McGill | Prev. Morgan Stanley

Results 2 comments of Shahrad

Gemma 2 returns NaN when using default attn (sdpa) with padding

Same issue here running the code for hooking the activations of the model. Using float16 made it work.

PyTorch 2.6.0: Weights only load failed

Having the same issue. This needs to be fixed, though a workaround for now could be the following: ```python import torch from torch_geometric.data.storage import GlobalStorage from torch_geometric.data.data import DataEdgeAttr, DataTensorAttr...