From bb4b5bed12b07e9f1a7626227637224a13514009 Mon Sep 17 00:00:00 2001 From: Less Wright Date: Sun, 25 Apr 2021 14:07:50 -0700 Subject: [PATCH] Update README.md --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 0e38fac..d5e328b 100644 --- a/README.md +++ b/README.md @@ -2,7 +2,7 @@ Ranger deep learning optimizer rewrite to use newest components Ranger, with Radam + Lookahead core, is now approaching two years old.
-(Original publication, Aug 2019: [New deep learning optimizer Ranger](https://lessw.medium.com/new-deep-learning-optimizer-ranger-synergistic-combination-of-radam-lookahead-for-the-best-of-2dc83f79a48d)
+*Original publication, Aug 2019: [New deep learning optimizer Ranger](https://lessw.medium.com/new-deep-learning-optimizer-ranger-synergistic-combination-of-radam-lookahead-for-the-best-of-2dc83f79a48d)
In the interim, a number of new developments have happened including the rise of Transformers for Vision. Thus, Ranger21 (as in 2021) is a rewrite with multiple new additions reflective of some of the most impressive papers this past year. The focus for Ranger21 is that these internals will be parameterized, and where possible, automated, so that you can easily test and leverage some of the newest concepts in AI training, to optimize the optimizer on your respective dataset.