2023-02-16

Lion optimizer

• https://arxiv.org/pdf/2302.06675.pdf
• Wrote a small implementation of this in Python with PyTorch.

Leave a Comment