Drafts of poetry leave commas and full stops at the beginning of the next line

[RaymondLuong3]

On one project a user reported that the poetry punctuation was a little off. You can see that in Chapter 2 the lines of poetry often have commas and full stops incorrectly added to the beginning of the following line. It seems like the line breaks are being inserted just 1 position too early.

Build ID:
6a1d8dbcf2315bc97f51bd27

Translation Engine ID:
6a1d8dbbf2315bc97f51bd0e

Project ID:
6a105ed7fa4446d4c72d4051

[Enkidu93]

I think this will be fixed once this PR goes through, is ported, and Serval is updated to use the new Machine code, but we can double-check.

[Enkidu93]

For context, we've seen something similar in the past with other projects. Often it was because the source text had conjunctions where the target did not (in a sense, the comma or other punctuation was acting as the conjunction). The update I mentioned above will nudge those boundaries in situations like these so that segments aren't ending or beginning at punctuation we know should never occur at the end/beginning.

[RaymondLuong3]

Thanks for the update on this.

[mmartin9684-sil]

Another project where this is occurring - PKP project with drafts of PRO.

Here's a sample (PRO 1:22-25), translated from NIV11R:

\v 22 “E wea te loa o tā kōtou manatunga pāioio nā, e mina wua ai i a kōtou waiwai pāioio nā?
\q2 E wea te loa o te mina o te kau wai akanaú i te kata āvili ia kōtou
\q2 , te veliveli oki a nā pāioió i te māwutu?
\q1
\v 23 Wuwuli kōtou ki muli nō taku wakalapanga ia kōtou!
\q2 Eia lā, koa lilingi atu ai au i aku manatunga kia kōtou,
\q2 ka tala atu oki au i aku akoakonga kia kōtou.
\q1
\v 24 Yaulā, ko yē wakalongo mai kōtou kē tauvalo atu au
\q2 , kāe oki tangata ko malawia mai kē tāki atu toku lima kia kōtou;
\q1
\v 25 nō tēlā ko yē au tuanakia aku wī talatala akoako
\q2 , ko yē āliki oki koe i aku wakalapanga.

[Enkidu93]

This is related to sillsdev/machine.py#280

[Enkidu93]

The machine.py PR has been merged. Now we need to port it: sillsdev/machine#429.