Commit Graph
77 Commits
Author SHA1 Message Date
Michael OliverandGitHub 8141f9ee22 Update to test for scale invariance 2017-02-22 15:04:54 -08:00
Michael OliverandGitHub 4dc4821ff7 Cosine Normalized Dense Layer (#36)
* Add cosine normalized dense

* fixes and doc updates

* fix serialization

* fix >2D case

* change atol on allclose
2017-02-22 14:46:23 -08:00
Somshubra MajumdarandMichael Oliver bdc64bf2f3 Added Batch Renormalization Layer (#28)
* Began work on batch renormalization

* Correct the implementation to use broadcasting properly, so it supports th dim ordering

* Correct the implementation to use broadcasting properly, so it supports th dim ordering

* Corrected normalizing term for d

* Moved location of updates

* Fixed the training problems and now auto adjusts the r_max and d_max values

* Removed unused code comments

* Finished implementation of batch renormalization

* Corrected the get_config method

* Added tests

* Added user changeable parameter t_delta to change the rate at which time steps increase

* Updated tests to state renorm everywhere

* Attempt a fix for mode=1 test fail (giving nans)

* Applied fix for nans to all calculations involving running mean and std

* Corrected time delta default value

* Reverts a mistake in pytest settings

* Corrections to calculations of r and d due to wrong variable naming (running_std perserves running_variance)

* Added t_delta to get_config

* Fix commit change mixup

* Corrected the check for uses_learning_flag

* Made a few corrections, added moments to backend, added test to backend

* Probable fix for test

* Corrected backend test

* Added support for mode 2
2017-02-22 09:07:13 -08:00
Junwei PanandGitHub 4ddb91c1b2 Merge pull request #23 from titu1994/ror
Added Residual Of Residual Networks
2017-02-15 13:02:53 -08:00
Somshubra Majumdar 23c5f5afc1 Merge remote-tracking branch 'origin/ror' into ror 2017-02-15 13:56:13 -06:00
Somshubra Majumdar c425cdf3d6 Refactored conv_blocks 2017-02-15 13:56:00 -06:00
Junwei PanandGitHub 85863d4213 Merge pull request #24 from titu1994/wrn
Add Wide Residual Networks
2017-02-15 08:11:41 -08:00
Somshubra Majumdar 721eb913d3 Add Wide Residual Networks 2017-02-15 09:41:10 -06:00
Fariz RahmanandGitHub dc727e8cc7 Fix import in densenet example too for consistency 2017-02-15 16:25:32 +05:30
Fariz RahmanandGitHub ca625e22cb Fix import
User might not know the filename.
2017-02-15 16:24:27 +05:30
Fariz RahmanandGitHub 6f2832c20f import in __init__.py 2017-02-15 16:23:02 +05:30
Somshubra Majumdar fe7c6df487 Corrected the evaluation portion of the script 2017-02-15 01:52:29 -06:00
Somshubra Majumdar 7f28b8709a Clean PR for ROR 2017-02-15 01:48:50 -06:00
Frédéric Branchaud-CharronandMichael Oliver 0801733819 Add extract_patches as a new backend op (#11)
* Add extract_patches as a new backend op

* Add more test

* Merge master

* Fix typo

* stop using K in backend

* stop using K in backend

* Fix bug in extract_patches

* PEP8-ify
2017-02-14 19:46:42 -08:00
Junwei PanandGitHub acf44c3a20 Merge pull request #19 from titu1994/densenet
Added DenseNet
2017-02-14 10:45:25 -08:00
Somshubra Majumdar 5c406022c3 Changed position of comment 2017-02-14 12:33:01 -06:00
Somshubra Majumdar c0bcf2e44f Made changes according to review 2017-02-14 11:35:47 -06:00
Somshubra MajumdarandMichael Oliver 4770f6aced Added SnapshotCallbackBuilder to callbacks (#18) 2017-02-13 20:59:24 -08:00
Gijs van TulderandMichael Oliver 40bdfd77c7 Fix deconv3d in TF backend (correct kernel transpose). (#21) 2017-02-13 20:41:50 -08:00
Somshubra Majumdar 33fedc564e Fixed a small error in the default parameters 2017-02-13 16:21:56 -06:00
Somshubra Majumdar eccd341b2e Fixed model loading path for th dim ordering no top 2017-02-13 16:13:43 -06:00
Somshubra Majumdar ba4d220bee PEP8 fixes 2017-02-13 00:32:01 -06:00
Somshubra Majumdar fe6ec44f95 PEP8 fixes 2017-02-13 00:22:25 -06:00
Somshubra Majumdar 96887b2ee6 Corrected a few mistakes 2017-02-13 00:14:17 -06:00
Somshubra Majumdar a62497d107 Added densenet and densenet_cifar10 example 2017-02-12 17:42:29 -06:00
Michael Oliver bad97abfe7 add line to end of file 2017-02-08 16:48:00 -08:00
Michael Oliver f5e70f03d4 Add Clip constraint and test 2017-02-08 16:42:28 -08:00
Gijs van TulderandMichael Oliver 831d344afc Deconvolution3D. (#14) 2017-02-07 09:39:02 -08:00
Michael OliverandGitHub e23a340b72 Test if Theano bug caused fails (#13) 2017-02-06 19:49:13 -08:00
Michael OliverandGitHub cbd90b8f28 Revert to last correct implementation (#12)
Fixing implementation by changing `K.relu(-x)` to `-K.relu(-x)` caused tests to fail for some reason. Reverting to last correct implementation that doesn't fail tests
2017-02-06 18:19:33 -08:00
Michael OliverandGitHub 52ed953f76 Fix PELU
It should be the negative part of `x` as negative numbers that goes into `K.exp`. `K.relu(-x)` returns the negative part, but as positive numbers, so you need to re-negate them: `-K.relu(-x)`.
2017-01-27 11:20:01 -08:00
farizrahman4u 6ba5bda97e Simplify pelu 2017-01-27 11:52:47 +05:30
Pat YorkandMichael Oliver 50cc7e57ad Readme updates (#5)
* Added more detail on "why contrib"; example scripts too

* Spelling and grammar
2017-01-26 12:50:49 -08:00
Michael OliverandGitHub c5bb568c66 Merge pull request #7 from farizrahman4u/PELU-fix
Fix PELU
2017-01-26 11:07:00 -08:00
Michael OliverandGitHub c0d71985ec Make PEP8
Fix underindent
2017-01-26 10:55:35 -08:00
Michael OliverandGitHub 538446b0d7 Fix PELU
Add missing part to `pos` and bring implementation in line with PReLU in Keras
2017-01-26 10:45:32 -08:00
Fariz RahmanandGitHub 0cf91f1f8a Update advanced_activations.py 2017-01-26 16:15:25 +05:30
Fariz RahmanandGitHub a3b6178947 Merge pull request #3 from farizrahman4u/farizrahman4u-patch-1
Update CONTRIBUTING.md
2017-01-26 09:35:23 +00:00
farizrahman4u 3d01b5bb6b pep8 fixes 2017-01-26 14:57:34 +05:30
farizrahman4u 4f227cfbc9 tf bug fix 2017-01-26 14:55:03 +05:30
Fariz RahmanandGitHub 8798840c1b Merge pull request #1 from joggino/master
Added PELU Activation Function
2017-01-26 09:14:11 +00:00
Fariz RahmanandGitHub 40ace94d89 Bug fix 2017-01-26 14:43:42 +05:30
Fariz RahmanandGitHub 994c3e6d7a Update CONTRIBUTING.md
When 'q' param is given in url, github doesn't add the 'is:open' argument on its own.
2017-01-26 11:46:41 +05:30
Fariz RahmanandGitHub 3d3e02b673 Merge pull request #2 from patyork/MarkdownChanges
Markdown page changes
2017-01-26 06:12:52 +00:00
Fariz RahmanandGitHub 1be552eb6d Import on top of file 2017-01-26 11:37:40 +05:30
Pat York 605d266fa4 spelling 2017-01-25 16:49:08 -08:00
josephyearsley 0163830c92 Reset pytest.ini - my bad 2017-01-25 23:26:55 +00:00
josephyearsley d84a9cc5bd Fixed PEP8 and Theano backend 2017-01-25 22:47:34 +00:00
josephyearsley 63bd82a633 Added Tests and Updated Doc String 2017-01-25 22:28:24 +00:00
Michael OliverandGitHub ce48444f33 Update README.md
Fix link to Keras
2017-01-25 13:38:20 -08:00