Results
2
comments of
Kevin Wu
The original authors note that Lion likely doesn't show significant gains over AdamW under the small batch (
Hi Yam - this shouldn't be happening. Can you pleas share the exact command you used (no need to share the files if you aren't comfortable doing that) and the...