 Phil Wang
|
44f95e2e9d
|
readme
|
2022-08-22 09:13:32 -07:00 |
|
|
Phil Wang
|
d9275a744c
|
add weight standardization prior to groupnorm, lessen cosine sim attention scale to 10 for fp16
|
2022-08-17 11:42:54 -07:00 |
|
|
Phil Wang
|
689593a579
|
add the new self conditioning technique from hintons group from bit diffusion paper
0.27.0
|
2022-08-10 10:52:07 -07:00 |
|
|
Phil Wang
|
6eba6cdd50
|
refresh images
|
2022-07-18 11:30:34 -07:00 |
|
|
Phil Wang
|
2b742dd2cc
|
move accelerator backward outside of autocast context, also calculate total loss correctly across gradient accumulated steps
|
2022-07-11 21:02:06 -07:00 |
|
|
Phil Wang
|
931a5af2c3
|
bring in ddim sampling
|
2022-07-09 16:10:23 -07:00 |
|
|
Phil Wang
|
6b56af08a2
|
support multi-gpu training using huggingface accelerate, addressing https://github.com/lucidrains/denoising-diffusion-pytorch/pull/54
|
2022-07-06 11:45:56 -07:00 |
|
|
Phil Wang
|
09b8a1c805
|
some basic scaffold for elucidating diffusion and derived values
|
2022-06-28 13:11:56 -07:00 |
|
|
Phil Wang
|
f2f3994b92
|
link to Letitia
|
2022-06-12 14:57:44 -07:00 |
|
|
Phil Wang
|
8ec4ea56a5
|
link to yannic
|
2022-06-12 14:56:55 -07:00 |
|
|
Phil Wang
|
99cf9b5b96
|
link to ai educator
|
2022-06-12 14:54:43 -07:00 |
|
|
Phil Wang
|
479f60c178
|
add p2 loss weighting to SNR version of denoising diffusion, brought up by @Mut1nyJD, paper is https://arxiv.org/abs/2204.00227
|
2022-06-09 08:25:05 -07:00 |
|
|
Phil Wang
|
d4ffa3fced
|
link to annotated ddpm
|
2022-06-08 12:55:15 -07:00 |
|
|
Phil Wang
|
3bbb6ebf16
|
get working version of gaussian diffusion with continuous time (only beta linear schedule for now, but will eventually contain alpha cosine schedule as well as parameterized, learned monotonic MLP)
|
2022-06-07 15:59:29 -07:00 |
|
|
Phil Wang
|
6b93fa48f6
|
fix comment
|
2022-06-06 17:30:46 -07:00 |
|
|
Phil Wang
|
fc8e4547aa
|
higher default learning rate
|
2022-05-16 13:39:55 -07:00 |
|
|
Phil Wang
|
09613a40f3
|
cleanup
|
2022-05-07 05:47:21 -07:00 |
|
|
Kashif Rasul
|
73591cf1ad
|
updated citation in README
|
2022-05-07 11:23:45 +02:00 |
|
|
Phil Wang
|
989f0fcb8e
|
remove convnext blocks, they do not work well, validated in video diffusion repository
|
2022-05-05 07:03:55 -07:00 |
|
|
Phil Wang
|
de378158e5
|
readme
|
2022-05-01 13:16:06 -07:00 |
|
|
Phil Wang
|
0b8cdb4c8b
|
remove outdated apex in favor of native pytorch AMP
|
2022-04-13 08:59:18 -07:00 |
|
|
Phil Wang
|
91cff45939
|
replace resnets with convnext blocks
|
2022-01-25 09:02:45 -08:00 |
|
|
Phil Wang
|
ae42f48f6a
|
prepare so that unet can work with a channel of one, and also make it so image size is hard coded in diffusion class. preparing for training on protein distograms
|
2021-06-11 14:06:39 -07:00 |
|
|
Phil Wang
|
2082046888
|
set higher num train steps, so non-practitioners do not think it is completed
|
2020-10-11 13:49:49 -07:00 |
|
|
Phil Wang
|
3c5b7e2d56
|
update readme
|
2020-10-10 10:37:44 -07:00 |
|
|
Phil Wang
|
ff451f697e
|
update with new and improved cosine noise scheduler
|
2020-10-09 21:21:02 -07:00 |
|
|
Phil Wang
|
3d96532c60
|
update citations in preparation to add improvements from a iclr 2021 paper
|
2020-10-05 17:15:28 -07:00 |
|
|
Phil Wang
|
8e5fb17063
|
add badge
|
2020-09-14 13:38:06 -07:00 |
|
|
Phil Wang
|
4bf28914bc
|
allow for mixed precision training with fp16 flag
|
2020-09-08 17:26:23 -07:00 |
|
|
Phil Wang
|
1307b3115d
|
add exponential moving average of model, also allow passing in custom noise schedule
|
2020-09-08 14:58:09 -07:00 |
|
|
Phil Wang
|
81fb2a0386
|
add sample
|
2020-09-08 10:17:48 -07:00 |
|
|
Phil Wang
|
d70fb08f8a
|
small helper fn to make sampling more clear
|
2020-09-07 16:40:36 -07:00 |
|
|
Phil Wang
|
1f1e42e9f9
|
update readme
|
2020-09-06 22:35:37 -07:00 |
|
|
Phil Wang
|
e1800c1a8d
|
remove wip, seems to be working
|
2020-09-06 14:26:23 -07:00 |
|
|
Phil Wang
|
11f27032ba
|
offer training class to easily train model off an image directory
|
2020-09-06 14:22:44 -07:00 |
|
|
Phil Wang
|
d8472a6220
|
update readme
|
2020-09-06 03:44:25 -07:00 |
|
|
Phil Wang
|
d59d8b05f6
|
fix a small bug
|
2020-09-06 01:50:59 -07:00 |
|
|
Phil Wang
|
365ce0c335
|
update readme
|
2020-09-06 01:44:05 -07:00 |
|
|
Phil Wang
|
0cc4aecfd5
|
first alpha release
|
2020-09-06 01:40:57 -07:00 |
|
|
Phil Wang
|
df94747c0c
|
Update README.md
|
2020-08-25 19:24:13 -07:00 |
|
|
Phil Wang
|
f94876c6fb
|
Update README.md
|
2020-08-25 19:23:06 -07:00 |
|
|
Phil Wang
|
602421c714
|
Initial commit
|
2020-08-25 19:22:11 -07:00 |
|