Language Model

<style> pre { white-space: pre-wrap; } </style>

Language-Model

Implement the Chinese language model based on the PyTorch paradigm.

Dataset

"Romance of the Three Kingdoms" + "Three-Body Problem"

Model

 RNNModel(
  (drop): Dropout(p=0.5)
  (encoder): Embedding(3719, 200)
  (rnn): GRU(200, 200, num_layers=2, dropout=0.5)
  (decoder): Linear(in_features=200, out_features=3719, bias=True)
)

Generate effects

Romance of the Three Kingdoms

"Three-Body"