Because of random word embedding for out of vocabulary words, the performance of the final saved model was variable. This is now fixed.
Pytorch deep learning models.