14 Commits

Include renames

Author	SHA1	Message	Date
Jack Kelly	b507df6a4e	Use collections.abc.Callable ... Fixes #43	2022-05-06 17:16:44 +01:00
Zohten	f5422d1af0	Activate/deactivate softplus + beta softplus	2021-07-19 21:26:54 +02:00
Less Wright	60c0725d01	add @TheZothen as contributor in header comments	2021-07-18 14:52:27 -07:00
Zohten	72825ba6ca	Softplus for madgrad denominator	2021-07-18 18:02:09 +02:00
Zohten	cd022ff593	fix stable weight decay for madgrad	2021-07-18 18:00:21 +02:00
Zohten	d670dbaab5	replace len(list(x.size())) by x.dim()	2021-07-18 17:58:06 +02:00
Less Wright	455d369240	adds softplus, gradient normalization, updated unit norm for 3D+ dims	2021-07-10 15:48:36 -07:00
Less Wright	aab030163c	extend agc to any dimension	2021-07-02 17:05:25 -07:00
Less Wright	4e2dff8e9e	display lr in scientific notation for easier viewing	2021-05-16 13:36:55 -07:00
Less Wright	6073f8cbd0	fix off by 1 iteration on linear warmup, adds show_schedule() to show lr quickly after training	2021-05-16 13:07:49 -07:00
Less Wright	a7edd418b1	fix context mgr for closure and grad	2021-05-10 22:24:18 -07:00
Less Wright	de331ad196	Update ranger21.py	2021-05-01 16:15:28 -07:00
Less Wright	414f3bc961	Update ranger21.py	2021-04-26 19:09:41 -07:00
Brian Pugh	33808aa833	package initial commit	2021-04-26 09:02:41 -07:00