Commit Graph

Select branches

Hide Pull Requests

main

Mono Color

• 3013c47545 link to https://github.com/kozistr/pytorch_optimizer main wassname 2023-05-08 13:35:24 +08:00
• 1a96777278 Merge pull request #44 from JackKelly/patch-1 Less Wright 2022-05-06 10:24:24 -07:00
• b507df6a4e Use collections.abc.Callable Jack Kelly 2022-05-06 17:16:44 +01:00
• 0a906ef9df Merge pull request #26 from nestordemeure/patch-2 Less Wright 2021-08-09 17:24:44 -07:00
• a53096e434 Update README.md Nestor Demeure 2021-08-07 00:57:47 +02:00
• 57add4c944 Merge pull request #23 from TheZothen/main Less Wright 2021-07-19 17:06:58 -07:00
• f5422d1af0 Activate/deactivate softplus + beta softplus Zohten 2021-07-19 21:26:54 +02:00
• 60c0725d01 add @TheZothen as contributor in header comments Less Wright 2021-07-18 14:52:27 -07:00
• e8e136f0a2 Merge pull request #22 from TheZothen/main Less Wright 2021-07-18 14:48:57 -07:00
• 72825ba6ca Softplus for madgrad denominator Zohten 2021-07-18 18:02:09 +02:00
• cd022ff593 fix stable weight decay for madgrad Zohten 2021-07-18 18:00:21 +02:00
• d670dbaab5 replace len(list(x.size())) by x.dim() Zohten 2021-07-18 17:58:06 +02:00
• b575cc4cf3 Update README.md Less Wright 2021-07-10 16:03:32 -07:00
• 5dc411c119 Update README.md Less Wright 2021-07-10 16:01:50 -07:00
• 455d369240 adds softplus, gradient normalization, updated unit norm for 3D+ dims Less Wright 2021-07-10 15:48:36 -07:00
• aab030163c extend agc to any dimension Less Wright 2021-07-02 17:05:25 -07:00
• ac9bc7af39 Merge pull request #13 from nestordemeure/patch-1 Less Wright 2021-06-28 11:02:00 -07:00
• ba89132416 added reference to Ranger21 paper Nestor Demeure 2021-06-28 04:25:28 +02:00
• adf9c77ef0 Update README.md Less Wright 2021-06-25 18:46:24 -07:00
• 4e2dff8e9e display lr in scientific notation for easier viewing Less Wright 2021-05-16 13:36:55 -07:00
• c23a2a0e12 Update README.md Less Wright 2021-05-16 13:23:07 -07:00
• 0e8eabe89b Update README.md Less Wright 2021-05-16 13:20:36 -07:00
• 6073f8cbd0 fix off by 1 iteration on linear warmup, adds show_schedule() to show lr quickly after training Less Wright 2021-05-16 13:07:49 -07:00
• d4c7b7b521 Merge branch 'main' of https://github.com/lessw2020/Ranger21 into main Less Wright 2021-05-10 22:24:29 -07:00
• a7edd418b1 fix context mgr for closure and grad Less Wright 2021-05-10 22:24:18 -07:00
• 2e82f432cb Update README.md Less Wright 2021-05-01 17:03:39 -07:00
• adfdd0e618 Update README.md Less Wright 2021-05-01 17:00:20 -07:00
• 39dd1bb6db Update README.md Less Wright 2021-05-01 16:58:10 -07:00
• de331ad196 Update ranger21.py Less Wright 2021-05-01 16:15:28 -07:00
• 3c1cc095cd Ranger21 now training on ImageNet Less Wright 2021-04-27 22:01:06 -07:00
• 07b3195440 Update README.md Less Wright 2021-04-26 19:22:56 -07:00
• 414f3bc961 Update ranger21.py Less Wright 2021-04-26 19:09:41 -07:00
• 873212cbbf Merge pull request #2 from BrianPugh/package Less Wright 2021-04-26 18:43:52 -07:00
• 33808aa833 package initial commit Brian Pugh 2021-04-26 09:02:41 -07:00
• dd6d8dbc4e python ignores Brian Pugh 2021-04-26 08:50:09 -07:00
• 399004484b Update README.md Less Wright 2021-04-25 20:55:18 -07:00
• a7e9e867b0 Merge branch 'main' of https://github.com/lessw2020/Ranger21 into main Less Wright 2021-04-25 20:39:47 -07:00
• 8767ecc844 fix potential key error for lookahead params Less Wright 2021-04-25 20:39:30 -07:00
• bb4b5bed12 Update README.md Less Wright 2021-04-25 14:07:50 -07:00
• b6bde02a9c Update README.md Less Wright 2021-04-25 14:07:07 -07:00
• 2f4269eef3 Update README.md Less Wright 2021-04-25 13:48:50 -07:00
• 5bb150c0da linear warmdown Less Wright 2021-04-25 13:33:28 -07:00
• 6dad8d4295 adds clear_cache, option to use la params at validation, move la step processing to it's own function Less Wright 2021-04-25 11:36:19 -07:00
• 3e697e17e9 Update README.md Less Wright 2021-04-25 05:06:56 -07:00
• 1ab4d2b834 update Readme - adding lookahead set new high Less Wright 2021-04-24 17:49:20 -07:00
• b70977a626 Update README.md Less Wright 2021-04-24 17:40:52 -07:00
• df35971812 NormLoss, Lookahead, new settings display function Less Wright 2021-04-24 17:30:08 -07:00
• 551f0a3140 Update README.md Less Wright 2021-04-23 20:48:39 -07:00
• fd0be4abe8 Update README.md Less Wright 2021-04-23 20:45:50 -07:00
• 0f85142981 fixes cosine warmdown Less Wright 2021-04-18 21:21:02 -07:00
• 6729390ea9 Merge branch 'main' of https://github.com/lessw2020/Ranger21 into main Less Wright 2021-04-18 13:56:06 -07:00
• 9cb6d0db26 agc, chebyshev, cosine warmdown Less Wright 2021-04-18 13:55:57 -07:00
• d56b006927 Update README.md Less Wright 2021-04-18 13:54:06 -07:00
• 237522ee23 Update README.md Less Wright 2021-04-18 13:53:44 -07:00
• bc78e88fde Update README.md Less Wright 2021-04-18 12:28:56 -07:00
• 59ea0f582f Update README.md Less Wright 2021-04-17 14:59:53 -07:00
• b16922f9f7 Update README.md Less Wright 2021-04-17 14:58:14 -07:00
• b24bb9d06f Update README.md Less Wright 2021-04-12 18:48:15 -07:00
• abf3347a1f Update README.md Less Wright 2021-04-12 18:47:24 -07:00
• c6e38d27cb pos neg momo Less Wright 2021-04-12 18:39:11 -07:00
• 01f0d4c9d7 Update Ranger21.py Less Wright 2021-04-11 12:48:09 -07:00
• ed20b925b4 Update Rangerabel.py Less Wright 2021-04-11 12:47:49 -07:00
• 06b17f5f6d add madgrad core Less Wright 2021-04-11 12:46:26 -07:00
• 22acdfbe10 Update README.md Less Wright 2021-04-10 21:15:45 -07:00
• 8d9834017a Update README.md Less Wright 2021-04-10 21:06:56 -07:00
• cf730dd483 Update README.md Less Wright 2021-04-10 20:36:46 -07:00
• df25910b7f Update README.md Less Wright 2021-04-10 20:27:19 -07:00
• bb166c9d43 Update README.md Less Wright 2021-04-10 20:17:11 -07:00
• 25a8763613 Update README.md Less Wright 2021-04-06 20:48:34 -07:00
• 5036e37e2c Update README.md Less Wright 2021-04-06 20:48:07 -07:00
• b27ec7e9ea Update README.md Less Wright 2021-04-06 20:45:37 -07:00
• 5fd5ad731c Update README.md Less Wright 2021-04-06 20:44:26 -07:00
• 52ed330498 Update README.md Less Wright 2021-04-06 20:41:26 -07:00
• cbbe5d2463 Update README.md Less Wright 2021-04-06 20:40:55 -07:00
• 04274ee7d7 warmup implemented Less Wright 2021-04-06 20:35:33 -07:00
• 22c7afd27d Merge branch 'main' of https://github.com/lessw2020/Ranger21 into main Less Wright 2021-04-05 20:34:03 -07:00
• 75ab25f72c stable weight decay Less Wright 2021-04-05 20:33:46 -07:00
• 5bc90c3501 Update README.md Less Wright 2021-04-05 20:25:50 -07:00
• 66ca8c69ab stable weight decay Less Wright 2021-04-05 20:23:55 -07:00
• 6b3f250dd5 basic framework Less Wright 2021-04-04 22:04:23 -07:00
• 588f548f8e basic framework Less Wright 2021-04-04 22:02:43 -07:00
• d5db2f572f basic framework Less Wright 2021-04-04 21:41:29 -07:00
• 100e07d816 starting imports Less Wright 2021-04-04 21:18:55 -07:00
• d5eedf1857 Create Ranger21.py Less Wright 2021-04-04 21:11:27 -07:00
• 16edab1850 Update README.md Less Wright 2021-04-04 21:08:59 -07:00
• e1e54974f8 Initial commit Less Wright 2021-04-04 20:54:14 -07:00