Mauro Sciancalepore
Mauro Sciancalepore
A simple script to pretrain mamba using the Causal Language Modeling (CLM) task, extrapolated from mamba-chat and adapted for CLM: ```python import torch import os import torch import argparse from...
@Eupham snipped fixed, it was just some old import.
Hey, I am having a similar issue (the target storage is a SAMBA mount) when calling `write_deltalake`: ``` OSError: Generic LocalFileSystem error: Unable to copy file from /Volumes/datasets/.../_delta_log/_commit_6851eb42-d982-49a0-9468-b3d92657948c.json.tmp to /Volumes/datasets/.../_delta_log/00000000000000000000.json:...
I've run multiple trainings with the current repo all went smooth. I am using python 3.10.13 btw, created with miniconda. Assure to have CUDA properly setup (run nvidia-smi, I have...