A tensorflow 2.x BERT implementation using League of Legends myth data(Chinese).
使用Tensorflow2.x实现了BERT模型
https://zhuanlan.zhihu.com/p/360420236
for Chinese readers. but the code is easy to understand and I believe English readers could see it.
any question, just issue or contact me at cmd2333@qq.com
tensorflow 2.x
tensorboard设置config，运行pretrain.py即可。
可使用tensorboard --logdir Logs来运行Tensorboard端口检测训练过程中损失函数变化。