Chinese-poem-generator
Chinese poem generator with LSTM network
Results
Trained on one GTX1080 for 12 hours. Went through 35% of the data and both loss and validation loss settled. See full training output here
Findings
The first few epochs started with random(very rare) charaters, with no or random punctuations.
It figured out how to add punctuations into sentences after 5 epochs- one comma and one period.
After around 30 epochs the charaters used start to have a theme.
Adding dropout layer helped improve the issue of overfitting - because punctuations were so frequent comparing to other charaters, it was just generating lines of punctuations with no other contents.
Future Works
Does it start to rhyme at some point?
Group training data into catagories (5 words, 7 words, etc...)
Try GAN network.
Sample Acrostic Poem with different diver