Base model?

[motowntek]

Hi. I see WAN mentioned in the readme. Was WAN used as a base model for this? If so, which model? Hopefully it's the 2.2 14b.

[Phospheneser]

Yes, our backbone is WAN 2.2 A14B.
You can also look forward to our upcoming technical report, which will provide more details about the model architecture and training!

[motowntek]

Awesome. That's a relief. The low parameter models(5B, 1.3B) are very limited. Looking forward to the paper.