Somshubra Majumdar bdc64bf2f3 Added Batch Renormalization Layer (#28) ...

* Began work on batch renormalization

* Correct the implementation to use broadcasting properly, so it supports th dim ordering

* Correct the implementation to use broadcasting properly, so it supports th dim ordering

* Corrected normalizing term for d

* Moved location of updates

* Fixed the training problems and now auto adjusts the r_max and d_max values

* Removed unused code comments

* Finished implementation of batch renormalization

* Corrected the get_config method

* Added tests

* Added user changeable parameter t_delta to change the rate at which time steps increase

* Updated tests to state renorm everywhere

* Attempt a fix for mode=1 test fail (giving nans)

* Applied fix for nans to all calculations involving running mean and std

* Corrected time delta default value

* Reverts a mistake in pytest settings

* Corrections to calculations of r and d due to wrong variable naming (running_std perserves running_variance)

* Added t_delta to get_config

* Fix commit change mixup

* Corrected the check for uses_learning_flag

* Made a few corrections, added moments to backend, added test to backend

* Probable fix for test

* Corrected backend test

* Added support for mode 2

2017-02-22 09:07:13 -08:00

..

keras_contrib

Added Batch Renormalization Layer (#28)

2017-02-22 09:07:13 -08:00