replace python-based Ukrainian lemmatizer in docker image with native built-in lemmatizer

[tomatolog]

Proposal:

After manticoresoftware/manticoresearch#4414 is merged we nned to update the Docker image to use the new native built-in Ukrainian lemmatizer instead of the old pymorphy2-based setup

as requested at manticoresoftware/manticoresearch#4414 (comment)

current docker image still includes the old Ukrainian lemmatizer path:

• Dockerfile installs manticore-lemmatizer-uk
• Dockerfile installs Python 3.9, pymorphy2, and pymorphy2-dicts-uk for lemmatize_uk
• PYTHONWARNINGS is set for pymorphy2.analyzer

once the native Ukrainian lemmatizer is available in manticore packages we need to remove the Python runtime and pymorphy2 dependency chain from the Docker image and rely on the native asset-backed implementation.

That should allow:

• daster docker image builds
• smaller image and dependency surface
• fewer python/pip/CVE maintenance issues
• Ukrainian morphology should continue to work with morphology = 'lemmatize_uk'

Acceptance criteria:

• Remove Python 3.9 / pip / pymorphy2 / pymorphy2-dicts-uk install steps from Dockerfile
• Remove obsolete PYTHONWARNINGS for pymorphy2.analyzer
• Stop installing the old external manticore-lemmatizer-uk package if it is no longer needed
• Keep or update clt_tests/tests/test-ukrainian-morphology.rec so Docker CI verifies lemmatize_uk
• Confirm Docker image build succeeds and Ukrainian morphology CLT passes

Checklist:

^{To be completed by the assignee. Check off tasks that have been completed or are not applicable.}

Details

• Implementation completed
• Tests developed
• Documentation updated
• Documentation reviewed
• Changelog updated

[tomatolog]

Fixed.

Related changes:

• Main Manticore built-in Ukrainian lemmatizer support:

  • feat: built-in Ukrainian lemmatizer prototype manticoresearch#4414
  • merge commit: af564220b42ee8709bf811a8794570b34d30aa24

• Language packs now include uk.pak:

  • publish language packs to release and dev repos; added uk pack manticoresearch-language-packs#5
  • merge commit: eadde16d4108ea19b9f3b654d5219305e9d9d0ef
  • fixed package: manticore-language-packs 1.0.15-260430-eadde16

• Docker image no longer installs the legacy Ukrainian Python/plugin stack:

  • fixed docker build to use manticore-language-packs with uk pack data #128
  • merge commit: 7a460302615ef799d994a96d7703aae236822f1e

Validated:

• Docker repo CI passed:

  • https://github.com/manticoresoftware/docker/actions/runs/25207295926

• Main repo downstream test-kit validation passed:

  • https://github.com/manticoresoftware/manticoresearch/actions/runs/25210275314

The generated test-kit image was also inspected manually and confirmed to have:

• /usr/share/manticore/uk.pak
• manticore-language-packs 1.0.15-260430-eadde16
• no manticore-lemmatizer-uk
• no /usr/local/lib/manticore/lemmatize_uk.so
• no Python 3.9 / pymorphy2 stack

Runtime probe also passed:

CALL KEYWORDS('бігаю', 'test_uk');

returned normalized form:

бігати

Closing this issue as fixed for the current/dev Docker image and downstream test-kit path.

Note: the default DEV=0 release Docker path still needs separate prerelease validation once the hardcoded release package set is moved to a Manticore server build that includes the native Ukrainian lemmatizer.