Prototype: ML Assisted labeling using superpixels

[IgorSusmelj]

What has changed and why?

This is a prototype for ML assisted labeling using superpixels (SLIC algorithm).

• We add a new toolbar button for the labeling feature using ML assistance
• The moment the user clicks on it we compute super pixels for the whole image
• To speed things up we compute super pixels on a reduced resolution (we resize the image to be contained in max 512 pixels width/height)
• We compute superpixels on a fine grained level and then merge cells in two stages to make them bigger. We end up with three levels of details (coarse, medium, fine)
• The user can either click on a cell or paint over the cells to "toggle" the current class. The output annotation is always an instance segmentation
• Users can also edit existing instance segmentations using the ML assisted labeling feature
• The backend remains unchanged (we don't have to change anything as we simply add a "smart" brush in the frontend

superpixel-labeling.mp4

How has it been tested?

• New tests and manual testing

Did you update CHANGELOG.md?

• Yes
• Not needed (internal change)

[coderabbitai]

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Repository UI

Review profile: CHILL

Plan: Pro

Run ID: c71b40b9-fd9f-4fb9-8771-bf027d9d3ec1

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

• 🔍 Trigger review

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Commit unit tests in branch ml-assisted-labeling-prototype-is

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}