assmdx
将优秀的技术融合进自己的技术体系，不断迭代提升自己的框架，🐂🍺
没有，这是内网的接口
请问怎么做增量预训练呢？
mark
写的真好
finetune.py: ``` import os import sys from typing import List import fire import torch import transformers from datasets import load_dataset """ Unused imports: import torch.nn as nn import bitsandbytes as...
> It means torch_dtype=torch.float32 doesn't work is there any way to solve this?
> > It means torch_dtype=torch.float32 doesn't work > > is there any way to solve this? > > I didn’t find the solution yet, using fp16 now. we must need...
I solved this problem by using RTX 3090(24GB) * 1 + 43GB Memory + 12 vCPU Intel(R) Xeon(R) Platinum 8255C CPU @ 2.50GHz。May be we should use better GPU and...