Shreyas Mocherla

> Very much looking forward to this. I'm using a 3960 Threadripper and a RTX 4090 and getting horrible performance. GPU sits at around 3-5% and most of the CPU...

Adjusting your batch size and reducing the number of prompts will definitely help. It worked for me and I'm on 4x V-100 GPUs. One thing I couldn't wrap my head...

What's interesting is that when I remove most of the examples and keep only the first three prompts, everything works as expected.

> ```python > ```python > from typing import Optional, Tuple > from dataclasses import dataclass > import math > > import torch > from torch import nn > import torch.nn.functional...

Can you also implement setting the split size for the dataset? Some datasets are humongous but I just want 1/10th of it for experimentation. I tried to edit the present...

Make sure you’re only running the Jupyter Notebook and its services to prevent exhausting your memory. I’m not completely sure this will work, but give it a try. On Wed,...