 Phil Wang
|
989f0fcb8e
|
remove convnext blocks, they do not work well, validated in video diffusion repository
|
2022-05-05 07:03:55 -07:00 |
|
|
Phil Wang
|
84731bb03d
|
groupnorm groups should be actually configurable
|
2022-05-04 10:38:29 -07:00 |
|
|
Phil Wang
|
c6ecca555b
|
allow for configuring expansion factor in convnext
|
2022-05-04 10:33:23 -07:00 |
|
|
Phil Wang
|
1f5c233072
|
bring back resnet blocks, make convnext blocks an experimental option
|
2022-05-04 10:30:09 -07:00 |
|
|
Phil Wang
|
e274fb305a
|
give an initial conv
|
2022-05-01 08:49:38 -07:00 |
|
|
Phil Wang
|
f39b3b1d3f
|
make sure time embedding dimension is kept at 4 x dimension (thanks @borisdayma)
|
2022-04-29 14:55:12 -07:00 |
|
|
Phil Wang
|
782c904d3b
|
fix cosine beta schedule, thanks to @Zhengxinyang
|
2022-04-19 20:51:50 -07:00 |
|
|
Phil Wang
|
71953ebd22
|
fix bug, thanks to @jihoonerd
|
2022-04-15 06:37:31 -07:00 |
|
|
Phil Wang
|
0b8cdb4c8b
|
remove outdated apex in favor of native pytorch AMP
|
2022-04-13 08:59:18 -07:00 |
|
|
Phil Wang
|
bd1e3b676e
|
get rid of numpy
|
2022-04-12 11:58:46 -07:00 |
|
|
Phil Wang
|
f4615599bc
|
use full attention at the center of the unet
|
2022-04-04 09:03:41 -07:00 |
|
|
Phil Wang
|
eb6e1b508e
|
greater kernel size in convnext blocks
|
2022-01-31 17:13:27 -08:00 |
|
|
Phil Wang
|
91cff45939
|
replace resnets with convnext blocks
|
2022-01-25 09:02:45 -08:00 |
|
|
Phil Wang
|
7b51e30da7
|
fix layernorm
|
2021-08-24 14:28:15 -07:00 |
|
|
Phil Wang
|
dadbf20154
|
remove stray print
|
2021-07-16 15:18:20 -07:00 |
|
|
Phil Wang
|
7706bdfc6f
|
use pre-layernorm with linear attention, and also allow for turning off time embedding
|
2021-06-25 10:48:11 -07:00 |
|
|
Phil Wang
|
183e5f3cc5
|
move all constants into configurable class init parameters
|
2021-06-25 10:37:36 -07:00 |
|
|
Phil Wang
|
16c9ae7bb3
|
fix data not being normalized to range of -1 to 1
|
2021-06-21 18:51:36 -07:00 |
|
|
Phil Wang
|
f5916111f8
|
0.6.3
|
2021-06-21 17:41:16 -07:00 |
|
|
Phil Wang
|
ad9e303ff3
|
fix channels
|
2021-06-11 15:28:36 -07:00 |
|
|
Phil Wang
|
ae42f48f6a
|
prepare so that unet can work with a channel of one, and also make it so image size is hard coded in diffusion class. preparing for training on protein distograms
|
2021-06-11 14:06:39 -07:00 |
|
|
Phil Wang
|
d4ce9f6c38
|
save samples and models to ./results path
|
2020-10-09 21:50:23 -07:00 |
|
|
Phil Wang
|
ff451f697e
|
update with new and improved cosine noise scheduler
|
2020-10-09 21:21:02 -07:00 |
|
|
Phil Wang
|
ef2ca0b625
|
new paper suggests image linear attention is more effective without query normalization
|
2020-10-04 21:53:53 -07:00 |
|
|
Phil Wang
|
9f95a03c07
|
fix bug with rezero and linear attention
|
2020-09-21 20:11:34 -07:00 |
|
|
Phil Wang
|
a4c68d3569
|
fix bug
|
2020-09-15 15:57:39 -07:00 |
|
|
Phil Wang
|
b33a48e342
|
make sure when sampling, batch does not exceed training batch size
|
2020-09-15 15:15:10 -07:00 |
|
|
Phil Wang
|
4bf28914bc
|
allow for mixed precision training with fp16 flag
|
2020-09-08 17:26:23 -07:00 |
|
|
Phil Wang
|
88f83d0ff2
|
fix loading checkpoint
|
2020-09-08 15:15:59 -07:00 |
|
|
Phil Wang
|
26b5cab6c8
|
update ema more frequently
|
2020-09-08 15:03:38 -07:00 |
|
|
Phil Wang
|
1307b3115d
|
add exponential moving average of model, also allow passing in custom noise schedule
|
2020-09-08 14:58:09 -07:00 |
|
|
Phil Wang
|
698227ae13
|
fix small bug with gradient accumulation
|
2020-09-07 23:14:38 -07:00 |
|
|
Phil Wang
|
c479adf960
|
add interpolation
|
2020-09-07 22:38:59 -07:00 |
|
|
Phil Wang
|
9c758662a3
|
fix another stray bug
|
2020-09-06 23:25:30 -07:00 |
|
|
Phil Wang
|
1f1e42e9f9
|
update readme
|
2020-09-06 22:35:37 -07:00 |
|
|
Phil Wang
|
11f27032ba
|
offer training class to easily train model off an image directory
|
2020-09-06 14:22:44 -07:00 |
|
|
Phil Wang
|
d59d8b05f6
|
fix a small bug
|
2020-09-06 01:50:59 -07:00 |
|
|
Phil Wang
|
0cc4aecfd5
|
first alpha release
|
2020-09-06 01:40:57 -07:00 |
|
|
Phil Wang
|
c9855c8c74
|
complete model portion
|
2020-09-05 13:55:17 -07:00 |
|
|
Phil Wang
|
dda425dc61
|
add scaffold
|
2020-08-31 12:45:27 -07:00 |
|