lmt-60-1.7B outputs the prompt content repeatedly

[lhjjldx233-create]

Hello, I'm trying to reproduce your model. I'm testing LMT-60-1.7B with the given test cases and I've found that it keeps repeating the input prompt. I'm wondering if there's a problem with my configuration? :)

here is my env
accelerate 0.33.0
flash-attn 2.0.2
tokenizers 0.22.1
torch 2.8.0
transformers 4.56.0

the script is copy from quick start code, and it output:

response: ['Translate', ' the', ' following', ' text', ' from', ' English', ' into', ' Chinese', '.\n', ' English', ':', ' The', ' concept', ' came', ' from', ' China', ' where', ' plum', ' bloss', 'oms', ' were', ' the', ' flower', ' of', ' choice', '.\n', ' Chinese', ':', ' ', '', '\n', ' debilitating', '\n', 'Translate', ' the', ' following', ' text', ' from', ' English', ' into', ' Chinese', '.\n', ' English', ':', ' The', ' concept', ' came', ' from', ' China', ' where', ' plum', ' bloss', 'oms', ' were', ' the', ' flower', ' of', ' choice', '.\n', ' Chinese', ':', ' ', ' -/\n', ' debilitating', '\n', 'Translate', ' the', ' following', ' text', ' from', ' English', ' into', ' Chinese', '.\n', ' English', ':', ' The', ' concept', ' came', ' from', ' China', ' where', ' plum', ' bloss', 'oms', ' were', ' the', ' flower', ' of', ' choice', '.\n', ' Chinese', ':', ' ', ' -/\n', ' debilitating', '\n', 'Translate', ' the', ' following', ' text', ' from', ' English', ' into', ' Chinese', '.\n', ' English', ':', ' The', ' concept', ' came', ' from', ' China', ' where', ' plum', ' bloss', 'oms', ' were', ' the', ' flower', ' of', ' choice', '.\n', ' Chinese', ':', ' ', ' -/\n', ' debilitating', '\n', 'Translate', ' the', ' following', ' text', ' from', ' English', ' into', ' Chinese', '.\n', ' English', ':', ' The', ' concept', ' came', ' from', ' China', ' where', ' plum', ' bloss', 'oms', ' were', ' the', ' flower', ' of', ' choice', '.\n', ' Chinese', ':', ' ', ' -/\n', ' debilitating', '\n', 'Translate', ' the', ' following', ' text', ' from', ' English', ' into', ' Chinese', '.\n', ' English', ':', ' The', ' concept', ' came', ' from', ' China', ' where', ' plum', ' bloss', 'oms', ' were', ' the', ' flower', ' of', ' choice', '.\n', ' Chinese', ':', ' ', ' -/\n', ' debilitating', '\n', 'Translate', ' the', ' following', ' text', ' from', ' English', ' into', ' Chinese', '.\n', ' English', ':', ' The', ' concept', ' came', ' from', ' China', ' where', ' plum', ' bloss', 'oms', ' were', ' the', ' flower', ' of', ' choice', '.\n', ' Chinese', ':', ' ', ' -/\n', ' debilitating', '\n', 'Translate', ' the', ' following', ' text', ' from', ' English', ' into', ' Chinese', '.\n', ' English', ':', ' The', ' concept', ' came', ' from', ' China', ' where', ' plum', ' bloss', 'oms', ' were', ' the', ' flower', ' of', ' choice', '.\n', ' Chinese', ':', ' ', ' -/\n', ' debilitating', '\n', 'Translate', ' the', ' following', ' text', ' from', ' English', ' into', ' Chinese', '.\n', ' English', ':', ' The', ' concept', ' came', ' from', ' China', ' where', ' plum', ' bloss', 'oms', ' were', ' the', ' flower', ' of', ' choice', '.\n', ' Chinese', ':', ' ', ' -/\n', ' debilitating', '\n', 'Translate', ' the', ' following', ' text', ' from', ' English', ' into', ' Chinese', '.\n', ' English', ':', ' The', ' concept', ' came', ' from', ' China', ' where', ' plum', ' bloss', 'oms', ' were', ' the', ' flower', ' of', ' choice', '.\n', ' Chinese', ':', ' ', ' -/\n', ' debilitating', '\n', 'Translate', ' the', ' following', ' text', ' from', ' English', ' into', ' Chinese', '.\n', ' English', ':', ' The', ' concept', ' came', ' from', ' China', ' where', ' plum', ' bloss', 'oms', ' were', ' the', ' flower', ' of', ' choice', '.\n', ' Chinese', ':', ' ', ' -/\n', ' debilitating', '\n', 'Translate', ' the', ' following', ' text', ' from', ' English', ' into', ' Chinese', '.\n', ' English', ':', ' The', ' concept', ' came', ' from', ' China', ' where', ' plum', ' bloss', 'oms', ' were', ' the', ' flower', ' of', ' choice', '.\n', ' Chinese', ':', ' ', ' -/\n', ' debilitating', '\n', 'Translate', ' the', ' following', ' text', ' from', ' English', ' into', ' Chinese', '.\n', ' English', ':', ' The', ' concept', ' came', ' from', ' China', ' where', ' plum', ' bloss', 'oms', ' were', ' the', ' flower', ' of', ' choice', '.\n', ' Chinese', ':', ' ', ' -/\n', ' debilitating', '\n', 'Translate', ' the', ' following', ' text', ' from', ' English', ' into', ' Chinese', '.\n', ' English', ':', ' The', ' concept', ' came', ' from', ' China', ' where', ' plum', ' bloss', 'oms', ' were', ' the', ' flower', ' of', ' choice', '.\n', ' Chinese', ':', ' ', ' -/\n', ' debilitating', '\n', 'Translate', ' the', ' following', ' text', ' from', ' English', ' into', ' Chinese', '.\n', ' English', ':', ' The', ' concept', ' came', ' from', ' China', ' where', ' plum', ' bloss', 'oms', ' were', ' the', ' flower', ' of', ' choice', '.\n', ' Chinese', ':', ' ', ' -/\n', ' debilitating', '\n', 'Translate', ' the', ' following', ' text', ' from', ' English', ' into', ' Chinese', '.\n', ' English', ':', ' The', ' concept', ' came', ' from', ' China', ' where', ' plum', ' bloss', 'oms', ' were', ' the', ' flower', ' of', ' choice', '.\n', ' Chinese', ':', ' ', ' -/\n', ' debilitating']

[Luoyingfeng8]

Thanks for testing the model.
The issue comes from using the Base checkpoint: NiuTrans/LMT-60-1.7B-Base.
This one isn’t instruction-tuned. Please switch to the SFT model: NiuTrans/LMT-60-1.7B.
That should fix the problem.