Commit Graph
124 Commits
Author SHA1 Message Date
Dr. Kashif Rasul 91e21aaea5 fix variable name 2020-01-30 16:50:46 +01:00
Dr. Kashif Rasul 721adece9f permute back the transformer output for conditioning 2020-01-29 15:14:25 +01:00
Dr. Kashif Rasul d95a217801 another typo 2020-01-29 15:04:07 +01:00
Dr. Kashif Rasul 2b51a2ad25 use target dim to reshape lags 2020-01-29 15:00:46 +01:00
Dr. Kashif Rasul 50893b3f13 fix typo 2020-01-29 14:51:36 +01:00
Dr. Kashif Rasul 054104019c fix typo 2020-01-29 14:47:07 +01:00
Dr. Kashif Rasul 6ffa46d0f5 fix dims of conditioning vector 2020-01-29 14:46:51 +01:00
Dr. Kashif Rasul d05fc7a242 added missing tgt_mask 2020-01-29 14:42:37 +01:00
Dr. Kashif Rasul e32ea17ce6 unroll_length = subsequences_length 2020-01-29 14:36:01 +01:00
Dr. Kashif Rasul 7a7ddc5997 typos 2020-01-29 14:25:22 +01:00
Dr. Kashif Rasul c7bea1e084 added decoder sampling 2020-01-29 14:12:17 +01:00
Dr. Kashif Rasul b121a29800 initial TransformerTempFlowEstimator 2020-01-28 21:16:06 +01:00
Dr. Kashif Rasul 96cd2393b7 cleanup 2020-01-28 15:21:55 +01:00
Dr. Kashif Rasul d0a19abeb9 use helper function to generate mask 2020-01-28 15:05:47 +01:00
Dr. Kashif Rasul fcb69e83d2 mask with diagonal=1 2020-01-28 14:29:06 +01:00
Dr. Kashif Rasul ad482cb526 formatting 2020-01-28 14:01:48 +01:00
Dr. Kashif Rasul 7bede84f45 enc_out needs to be repeated at dim=1 2020-01-28 13:44:17 +01:00
Dr. Kashif Rasul 438785cde1 copy trainer network to device 2020-01-28 12:12:32 +01:00
Dr. Kashif Rasul 23b0d39412 set tgt_mask as a buffer 2020-01-28 12:03:29 +01:00
Dr. Kashif Rasul 8760a9dc08 no cache reset in pytorch 2020-01-28 11:45:32 +01:00
Dr. Kashif Rasul 79902625d7 another typo 2020-01-28 11:31:32 +01:00
Dr. Kashif Rasul f19d402475 fix typo 2020-01-28 11:30:01 +01:00
Dr. Kashif Rasul 9322ce004a fix argumment name 2020-01-28 11:27:58 +01:00
Dr. Kashif Rasul 1ab2babbe3 transfomer takes [T, B, F] tensors 2020-01-28 11:21:06 +01:00
Dr. Kashif Rasul 5141ae69e9 fix loss 2020-01-28 10:50:53 +01:00
Dr. Kashif Rasul 969b8c41b3 fix typos 2020-01-28 10:30:53 +01:00
Dr. Kashif Rasul 1c257bd317 added encoder and decoder input layers 2020-01-28 10:17:00 +01:00
Dr. Kashif Rasul 72710c21d9 api to set the transformer dim and ff_dim 2020-01-28 10:10:47 +01:00
Kashif Rasul 8d92ae4b89 added static real features 2020-01-27 21:19:16 +01:00
Kashif Rasul 064baee01c fix mask
TODO check this
2020-01-27 21:08:41 +01:00
Kashif Rasul ff92cbad50 more typos 2020-01-27 20:28:38 +01:00
Kashif Rasul 9c22720b60 import missing 2020-01-27 20:19:16 +01:00
Kashif Rasul d95bcfe57f fix imports 2020-01-27 20:15:03 +01:00
Kashif Rasul eea4d90aba formatting 2020-01-27 20:05:12 +01:00
Kashif Rasul da584d309c typos 2020-01-27 20:03:10 +01:00
Kashif Rasul b1d1cdbea6 fix api to nn.Transformer 2020-01-27 19:57:54 +01:00
Dr. Kashif Rasul 2dc6f23efe use nn.Transformer 2020-01-27 17:43:51 +01:00
Dr. Kashif Rasul 4a1de2d06f fix typo 2020-01-27 17:00:09 +01:00
Dr. Kashif Rasul 3184f5d588 initial transformer model
todo decoder encoder
2020-01-27 16:24:02 +01:00
Dr. Kashif Rasul d1005e2aa5 renamed flag to dequantize 2020-01-22 11:05:39 +01:00
Dr. Kashif Rasul 04bdd7bbf2 added MAF option to model 2020-01-17 11:42:46 +01:00
Dr. Kashif Rasul 4c5b02864f added quantization option to model 2020-01-17 10:26:42 +01:00
Dr. Kashif Rasul e34561373e another typo 2020-01-16 10:51:16 +01:00
Dr. Kashif Rasul 177834451a another typo 2020-01-16 10:43:15 +01:00
Dr. Kashif Rasul 28f6ed1dbc fix typo 2020-01-16 10:41:38 +01:00
Dr. Kashif Rasul 00d790a66d use pytorch Dataloader and TransformedIterableDataset 2020-01-16 10:32:30 +01:00
Dr. Kashif Rasul 7fd92875fe RNN always gets mean scaled values 2020-01-15 15:49:09 +01:00
Dr. Kashif Rasul 6ee817ab72 dont set scale if scaling is false 2020-01-15 15:24:11 +01:00
Dr. Kashif Rasul b5ef5f90c2 put back scaling to flow 2020-01-15 13:12:23 +01:00
Kashif Rasul 9938121a42 Test conditioning (#1)
* explicitly set the conditioning to flow

* try ELUs

* return first element of tuple

* typo

* revert ELU
2020-01-15 11:39:10 +01:00