49 Commits
Author SHA1 Message Date
Phil Wang ddc31bc489 trust paper 2022-11-27 10:05:55 -08:00
Phil Wang e872ec3618 tweak readme 2022-11-21 10:08:56 -08:00
Phil Wang 60f760ead5 add classifier free guidance example for @ajrheng at https://github.com/lucidrains/denoising-diffusion-pytorch/issues/120 2022-11-11 20:01:42 -08:00
Phil Wang 6205e20e5e ocd 2022-11-05 17:09:34 -07:00
Phil Wang aece9c2a2a help researchers in need of 1d ddpm, ex. https://github.com/lucidrains/denoising-diffusion-pytorch/issues/116 2022-11-05 11:42:00 -07:00
Phil Wang aadaa7d288 bring in the continuous time v-parameterized ddpm, validated to work locally, and which will be used for imagen-video replication 2022-10-23 19:16:31 -07:00
Phil Wang 98f2eeac35 link to flax implementation from @yiyixuxu 2022-09-27 11:21:23 -07:00
Phil Wang 44f95e2e9d readme 2022-08-22 09:13:32 -07:00
Phil Wang d9275a744c add weight standardization prior to groupnorm, lessen cosine sim attention scale to 10 for fp16 2022-08-17 11:42:54 -07:00
Phil Wang 689593a579 add the new self conditioning technique from hintons group from bit diffusion paper
0.27.0
2022-08-10 10:52:07 -07:00
Phil Wang 6eba6cdd50 refresh images 2022-07-18 11:30:34 -07:00
Phil Wang 2b742dd2cc move accelerator backward outside of autocast context, also calculate total loss correctly across gradient accumulated steps 2022-07-11 21:02:06 -07:00
Phil Wang 931a5af2c3 bring in ddim sampling 2022-07-09 16:10:23 -07:00
Phil Wang 6b56af08a2 support multi-gpu training using huggingface accelerate, addressing https://github.com/lucidrains/denoising-diffusion-pytorch/pull/54 2022-07-06 11:45:56 -07:00
Phil Wang 09b8a1c805 some basic scaffold for elucidating diffusion and derived values 2022-06-28 13:11:56 -07:00
Phil Wang f2f3994b92 link to Letitia 2022-06-12 14:57:44 -07:00
Phil Wang 8ec4ea56a5 link to yannic 2022-06-12 14:56:55 -07:00
Phil Wang 99cf9b5b96 link to ai educator 2022-06-12 14:54:43 -07:00
Phil Wang 479f60c178 add p2 loss weighting to SNR version of denoising diffusion, brought up by @Mut1nyJD, paper is https://arxiv.org/abs/2204.00227 2022-06-09 08:25:05 -07:00
Phil Wang d4ffa3fced link to annotated ddpm 2022-06-08 12:55:15 -07:00
Phil Wang 3bbb6ebf16 get working version of gaussian diffusion with continuous time (only beta linear schedule for now, but will eventually contain alpha cosine schedule as well as parameterized, learned monotonic MLP) 2022-06-07 15:59:29 -07:00
Phil Wang 6b93fa48f6 fix comment 2022-06-06 17:30:46 -07:00
Phil Wang fc8e4547aa higher default learning rate 2022-05-16 13:39:55 -07:00
Phil Wang 09613a40f3 cleanup 2022-05-07 05:47:21 -07:00
Kashif Rasul 73591cf1ad updated citation in README 2022-05-07 11:23:45 +02:00
Phil Wang 989f0fcb8e remove convnext blocks, they do not work well, validated in video diffusion repository 2022-05-05 07:03:55 -07:00
Phil Wang de378158e5 readme 2022-05-01 13:16:06 -07:00
Phil Wang 0b8cdb4c8b remove outdated apex in favor of native pytorch AMP 2022-04-13 08:59:18 -07:00
Phil Wang 91cff45939 replace resnets with convnext blocks 2022-01-25 09:02:45 -08:00
Phil Wang ae42f48f6a prepare so that unet can work with a channel of one, and also make it so image size is hard coded in diffusion class. preparing for training on protein distograms 2021-06-11 14:06:39 -07:00
Phil Wang 2082046888 set higher num train steps, so non-practitioners do not think it is completed 2020-10-11 13:49:49 -07:00
Phil Wang 3c5b7e2d56 update readme 2020-10-10 10:37:44 -07:00
Phil Wang ff451f697e update with new and improved cosine noise scheduler 2020-10-09 21:21:02 -07:00
Phil Wang 3d96532c60 update citations in preparation to add improvements from a iclr 2021 paper 2020-10-05 17:15:28 -07:00
Phil Wang 8e5fb17063 add badge 2020-09-14 13:38:06 -07:00
Phil Wang 4bf28914bc allow for mixed precision training with fp16 flag 2020-09-08 17:26:23 -07:00
Phil Wang 1307b3115d add exponential moving average of model, also allow passing in custom noise schedule 2020-09-08 14:58:09 -07:00
Phil Wang 81fb2a0386 add sample 2020-09-08 10:17:48 -07:00
Phil Wang d70fb08f8a small helper fn to make sampling more clear 2020-09-07 16:40:36 -07:00
Phil Wang 1f1e42e9f9 update readme 2020-09-06 22:35:37 -07:00
Phil Wang e1800c1a8d remove wip, seems to be working 2020-09-06 14:26:23 -07:00
Phil Wang 11f27032ba offer training class to easily train model off an image directory 2020-09-06 14:22:44 -07:00
Phil Wang d8472a6220 update readme 2020-09-06 03:44:25 -07:00
Phil Wang d59d8b05f6 fix a small bug 2020-09-06 01:50:59 -07:00
Phil Wang 365ce0c335 update readme 2020-09-06 01:44:05 -07:00
Phil Wang 0cc4aecfd5 first alpha release 2020-09-06 01:40:57 -07:00
Phil Wang df94747c0c Update README.md 2020-08-25 19:24:13 -07:00
Phil Wang f94876c6fb Update README.md 2020-08-25 19:23:06 -07:00
Phil Wang 602421c714 Initial commit 2020-08-25 19:22:11 -07:00