 Phil Wang
|
555566c188
|
take a gamble on cosine sim attention
v0.26.0
|
2022-07-18 11:29:20 -07:00 |
|
|
Phil Wang
|
2b742dd2cc
|
move accelerator backward outside of autocast context, also calculate total loss correctly across gradient accumulated steps
v0.25.3
|
2022-07-11 21:02:06 -07:00 |
|
|
Phil Wang
|
1345a8a41d
|
do not noise at the last timestep for ddim
v0.25.2
|
2022-07-09 18:36:45 -07:00 |
|
|
Phil Wang
|
931a5af2c3
|
bring in ddim sampling
v0.25.1
|
2022-07-09 16:10:23 -07:00 |
|
|
Phil Wang
|
a0c3443eaa
|
optimizer should be saved and loaded
v0.24.4
|
2022-07-08 17:43:41 -07:00 |
|
|
Phil Wang
|
662172851b
|
add convert_image_to keyword argument, for forcing images being loaded to be converted to some format, greyscale, rgb, rgba, whatever
v0.24.2
|
2022-07-08 09:22:59 -07:00 |
|
|
Phil Wang
|
0248b5e4d3
|
also make sure grad scaler actually exists in the saved pt file
v0.24.1
|
2022-07-06 11:48:04 -07:00 |
|
|
Phil Wang
|
6b56af08a2
|
support multi-gpu training using huggingface accelerate, addressing https://github.com/lucidrains/denoising-diffusion-pytorch/pull/54
v0.24.0
|
2022-07-06 11:45:56 -07:00 |
|
|
Phil Wang
|
d4420248f1
|
tqdm auto instead
v0.23.4
|
2022-06-29 19:48:49 -07:00 |
|
|
Phil Wang
|
a536e5bee9
|
reorganize elucidating code
|
2022-06-29 08:49:38 -07:00 |
|
|
Phil Wang
|
1b85379d3a
|
add clamping option to elucidated diffusion
v0.23.3
|
2022-06-29 08:32:10 -07:00 |
|
|
Phil Wang
|
8859864f63
|
patch
v0.23.2
|
2022-06-29 07:55:11 -07:00 |
|
|
Phil Wang
|
32657f035f
|
Merge pull request #52 from AryaAftab/patch-1
Solve issue #26
|
2022-06-29 07:54:48 -07:00 |
|
|
Arya Aftab
|
d97bc0278c
|
Solve issue #26
|
2022-06-29 11:42:54 +04:30 |
|
|
Phil Wang
|
8408775cfc
|
fix bug in elucidating sampling
v0.23.1
|
2022-06-28 17:52:02 -07:00 |
|
|
Phil Wang
|
86fcb6785b
|
release elucidating diffusion
v0.23.0
|
2022-06-28 17:39:48 -07:00 |
|
|
Phil Wang
|
c535d31fc5
|
Merge pull request #51 from lucidrains/pw/elucidating-ddpm
elucidating diffusion, first pass
|
2022-06-28 17:29:28 -07:00 |
|
|
Phil Wang
|
5db64fec4b
|
refactor sigmas and gamma generation
|
2022-06-28 17:26:58 -07:00 |
|
|
Phil Wang
|
b87ea27781
|
fix off by one
|
2022-06-28 16:05:21 -07:00 |
|
|
Phil Wang
|
a8403b83fe
|
no clamping when training from sigmas drawn from log normal distribution, clamp final images being sampled
|
2022-06-28 16:00:16 -07:00 |
|
|
Phil Wang
|
f4b1d7a67c
|
complete a first pass of elucidated ddpm
|
2022-06-28 15:15:21 -07:00 |
|
|
Phil Wang
|
618493714f
|
clamp the sigma coming out of the log normal distribution
|
2022-06-28 14:34:39 -07:00 |
|
|
Phil Wang
|
76b79aa847
|
take care of equation 7 in the paper
|
2022-06-28 14:16:05 -07:00 |
|
|
Phil Wang
|
be2bd8d320
|
cleanup again
|
2022-06-28 13:42:41 -07:00 |
|
|
Phil Wang
|
c3d1607019
|
cleanup
|
2022-06-28 13:38:37 -07:00 |
|
|
Phil Wang
|
06b2e52645
|
get training working
|
2022-06-28 13:35:06 -07:00 |
|
|
Phil Wang
|
09b8a1c805
|
some basic scaffold for elucidating diffusion and derived values
|
2022-06-28 13:11:56 -07:00 |
|
|
Phil Wang
|
d26acbcae6
|
more skip connections, as in guided diffusion
v0.22.0
|
2022-06-27 13:23:32 -07:00 |
|
|
Phil Wang
|
9939a48139
|
make sure all versions of torch supported
v0.21.2
|
2022-06-23 12:28:09 -07:00 |
|
|
Phil Wang
|
75ea49a7ef
|
pass parameter for Trainer to EMA properly
v0.21.1
|
2022-06-21 07:37:43 -07:00 |
|
|
Phil Wang
|
8c3609a6e3
|
move EMA logic out of the repository for clarity
v0.21.0
|
2022-06-20 13:17:51 -07:00 |
|
|
Phil Wang
|
1586d1a8a0
|
just pluck the image size off the gaussian diffusion class
v0.20.2a
|
2022-06-17 13:54:41 -07:00 |
|
|
Phil Wang
|
b4fb8804d2
|
conditioning on final resnet block
v0.20.2
v0.20.1
|
2022-06-17 10:38:17 -07:00 |
|
|
Phil Wang
|
9fd05f1b1f
|
switch to learned sinsuoidal pos emb for the continuous case
v0.20.0
|
2022-06-17 09:24:51 -07:00 |
|
|
Phil Wang
|
ec2397f0ba
|
add one more residual
v0.19.2
|
2022-06-16 11:08:42 -07:00 |
|
|
Phil Wang
|
844e557dfb
|
fix a missing residual needed at the top most resolution in the unet
v0.19.1
|
2022-06-15 19:10:05 -07:00 |
|
|
Phil Wang
|
8b30be8042
|
add p2 loss reweighting for default ddpm as an option
v0.18.4
|
2022-06-14 10:49:13 -07:00 |
|
|
Phil Wang
|
f2f3994b92
|
link to Letitia
|
2022-06-12 14:57:44 -07:00 |
|
|
Phil Wang
|
8ec4ea56a5
|
link to yannic
|
2022-06-12 14:56:55 -07:00 |
|
|
Phil Wang
|
99cf9b5b96
|
link to ai educator
|
2022-06-12 14:54:43 -07:00 |
|
|
Phil Wang
|
ecc6f30901
|
for https://github.com/lucidrains/denoising-diffusion-pytorch/issues/36
v0.18.3
|
2022-06-11 10:51:13 -07:00 |
|
|
Phil Wang
|
f900f40f14
|
allow for turning off horizontal flip augmentation
v0.18.2
|
2022-06-09 20:59:59 -07:00 |
|
|
Phil Wang
|
479f60c178
|
add p2 loss weighting to SNR version of denoising diffusion, brought up by @Mut1nyJD, paper is https://arxiv.org/abs/2204.00227
v0.18.0
|
2022-06-09 08:25:05 -07:00 |
|
|
Phil Wang
|
96bb2ff310
|
alpha cosine noise schedule is now working for continuous time gaussian diffusion
v0.17.7
|
2022-06-08 23:07:01 -07:00 |
|
|
Phil Wang
|
582bfe275b
|
successfully did some basic math and clipped the predicted x0 intermediate for the continuous time case
v0.17.6
|
2022-06-08 17:59:41 -07:00 |
|
|
Phil Wang
|
4284c8840d
|
clipping for continuous time diffusion not working
v0.17.4
|
2022-06-08 16:26:18 -07:00 |
|
|
Phil Wang
|
d4ffa3fced
|
link to annotated ddpm
|
2022-06-08 12:55:15 -07:00 |
|
|
Phil Wang
|
c44d3ea01d
|
learned noise schedule seems to be working, allow for one to make the monotonic net learn a bit more slowly than the unet
v0.17.3
|
2022-06-08 12:34:07 -07:00 |
|
|
Phil Wang
|
c4991f576f
|
allow for configuring the hidden dimension of the monotonic mlp parameterizing the noise schedule
v0.17.2
|
2022-06-08 11:18:54 -07:00 |
|
|
Phil Wang
|
a19331aa59
|
fix learned noise schedule
v0.17.1
|
2022-06-08 10:19:02 -07:00 |
|