* ASF-3099 Bootstrap: write backbones of test, distribution and distribution output
* ASF-3099 First proposition for IQN distribution output
Mostly for backbones, the functions themselves are far from final
* ASF-3099 Add sample() to ImplicitQuantile and its test
* ASF-3099 Test prediction, sampling and convergence logic for IQN
* ASF-3099 IQN module takes the data input and taus in
* ASF-3099 Add torch.no_grad in the sampling
* ASF-3099 Add tests on quantiles (10%, 90%), for both normal and uniform
* ASF-3099 Improve feeting of quantile function:
Increase depth of quantile network, change activation to PReLU
* ASF-3099 Fix distribution attributes and module imports
* ASF-3099 Fix implicit quantile init
* ASF-3099 Add integration test with deepAR
* ASF-3099 Add a transformed distribution
* ASF-3099 Fix init of ImplicitQuantile
* ASF-3099 Make iqn distribution compatible with forecast-length>1
* ASF-3099 Fix device for new tensors
* ASF-3099 Fix device for new tensors: device is not a function...
* ASF-3099 Fix output size of the network
* ASF-3099 Define torch network in the DistributionOutput only
Distribution takes only the predicted quantiles, or the parameters
of the trained model to define a new quantile function
* ASF-3099 Test: create quantile function on compatible device
Attempt: class method might force the module to be created only once,
not necessarily with the right device
* ASF-3099 Second attempt: create quantile function on compatible device
* ASF-3099 Sampling returns a tensor of the correct shape
Shape is (num_sample, batch_size, forecast_length)
* ASF-3099 Handle empty sample shapes
* ASF-3099 Fix tau device at inference time
* ASF-3099 Fix device of the layer
* ASF-3099 Handle empty sample shapes (fix output)
* ASF-3099 Last activation of quantile layer should be removed
That way, embedded quantiles are symetrically distributed around the 0.5
quantile. Otherwise we distort part of their distribution before applying
it to the forecasted quantities
* ASF-3099 (test) Add a bunch of layers
* ASF-3099 [test] reduce the embedding size of tau
* ASF-3099 [test] Use same IQN version as in sales forecaster
* ASF-3099 Put original parameters back
* use @torch.no_grad() decorator
* ASF-3099 [test, to be reverted] Remove - in front of the loss
* ASF-3099 Revert former commit: put - back in the loss
* ASF-3099 [fix] Add log_prob method in piecewise linear
* ASF-3099 [test] ImplicitQuantileModule should be instanciated only once
Current problem: it's instanciated once at training and once at prediction,
as if the model was never trained. Thus it is now defined as a
global variable. However, this can only be a temporary hack: it means that
only one model can be trained during a session.
* ASF-3099 [test] ImplicitQuantileModule should be instanciated only once
Current problem: it's instanciated once at training and once at prediction,
as if the model was never trained.
However here, if the same model is retrained in the same session,
the module is not reset.
* ASF-3099 Add notebooks for experiments
* ASF-3099 [test] Move module to the distribution
* ASF-3099 Class method for args_proj
* ASF-3099 Clean up
* ASF-3099 More clean up
* ASF-3099 Define options for domain of preditected quantiles
Predicted quantiles can be either positive, either real
* ASF-3099 Set quantile_arg_proj in the init of the distribution output
Before it was instanciated once per python session, thus when retraining
the same models, the previously trained module was used, and not a fresh
one
* ASF-3099 Add test on number of instantiation of the quantile_arg_proj
* ASF-3099 Add an example notebook
* ASF-3099 Remove some notebooks
* ASF-3099 Remove diff vs master
Co-authored-by: Kashif Rasul <kashif.rasul@zalando.de>
Co-authored-by: Mateusz Koren <mateusz.koren@zalando.de>
Co-authored-by: Adele Gouttes <agouttes@bm1-lxslurmctl01.corp.ad.zalando.net>
* First go at IndependentDistributionOutput, subclassed by NormalOutput and NegativeBinomialOutput for now
* Multivariate test for new implementation of NormalOutput
* adding scaling parameter to NormalOutput
* IndependentNormalOutput now is an alias of NormalOutput with a DeprecatedWarning. Some more univariate distributions now inherit from IndependentDistributionOutput
* IndependentNormalOutput now is an alias of NormalOutput with a DeprecatedWarning. Some more univariate distributions now inherit from IndependentDistributionOutput
Dr. Kashif Rasul