ReCO

ReCO copied to clipboard

I could not locate a license file that specifies the terms under which the data can be used. Could you specify the license of the data? Thank you.

noe

请问训练albert_xxlarge时超参如何设置

1

您好，我在ReCo上用xx_large训练的时候发现模型的loss一直不下降，请问您的超参数是如何设置的？是否加了warmup，dropout等策略？

bestbzw

warming, help

1

- warming > python3 train.py --model_type=bert-base-chinese --truncation=True  > How to modify

ARDUJS

have you released the data and code?

2

jind11

Bumps [torch](https://github.com/pytorch/pytorch) from 0.4.1 to 2.2.0. Release notes Sourced from torch's releases. PyTorch 2.2: FlashAttention-v2, AOTInductor PyTorch 2.2 Release Notes Highlights Backwards Incompatible Changes Deprecations New Features Improvements Bug fixes...

dependabot[bot]