more gifs

2026-08-20 12:50:49 +08:00 · 2017-11-17 12:48:26 +08:00
parent 8efe458f40
commit e42342f34f
4 changed files with 16 additions and 2 deletions
@@ -4,18 +4,32 @@ This project generates animations of pytorch optimizers solving toy problems. Ex

 # Examples

-![](docs/videos/beales.gif)
+Please note that these don't have the same learning rate as simple optimizers perform better on low dimensional problems. So with a constant learning rate SGD gets to the minima too fast to see while Adam crawls along. So I used differen't learning rate per optimizer to show them in the same video.

+## With cyclic annealing:
+
+![](docs/videos/beales_CyclicLR_20171117_04-01-14_2d.gif)
+
+## Constant learning rate
+
+### Beales function
+![](docs/videos/beales_20171117_00-02-20_2d.gif)
+![](docs/videos/beales_20171115_07-18-03_3d.gif)
+
+### Six humped camel function
 ![](docs/videos/six_humped_camel_back_20171115_09-38-57.gif)
 ![](docs/videos/six_humped_camel_back_20171115_09-38-57_3d.gif)
 ![](docs/videos/six_humped_camel_back_20171115_09-38-57_loss.gif)

+### Madsen function
+
 ![](docs/videos/madsen_20171115_10-04-15_3d.gif)
 ![](docs/videos/madsen_20171115_10-04-15_loss.gif)

+### Rosenbrock function
+
 ![](docs/videos/rosenbrock_20171115_09-47-52.gif)

-![](docs/videos/beales_20171115_07-18-03_3d.gif) 


 # Usage: