Prostate Visualization and Target Aiming Software

A ROS2-based software tool for intraoperative visualization of the prostate gland and clinician-guided biopsy target selection. The software renders a three-dimensional prostate model reconstructed from robotic ultrasound sweep data, displays corresponding ultrasound slices, and allows the clinician to pick and confirm biopsy target locations. It is part of the PRONOBIS autonomous robotic prostate biopsy platform.

Features

• 3D Visualization: Renders a three-dimensional model of the prostate reconstructed from ultrasound sweep contours and robot positional data.
• Slice viewer: Displays individual 2D ultrasound frames from the sweep alongside the 3D model for anatomical reference.
• Target picking: Enables the clinician to select and confirm biopsy target locations on the reconstructed model.
• ROS2 integration: Subscribes to robot pose and ultrasound image topics for real-time data ingestion.

Requirements

This software is tested on Ubuntu 22.04 with ROS2 humble with Python 3.10.12. Programs are placed in the src folder.

Steps

Clone the repository into your ROS2 workspace and move to the workspace root:

git clone git@github.com:CRTA-Lab/vtk.git
cd vtk

Install Python dependencies listed in requirements.txt. Even though global library installation is not recommended, we suggest you make an exception in this case as it easier to work with because of ROS2 integration:

pip install -r requirements.txt

Source ros2 and local setup in your terminal. Build project.

source /opt/ros/humble/setup.bash (put your path to setup)
colcon build
source install/local_setup.bash

Note: Run source /opt/ros/humble/setup.bash and source install/local_setup.bash in every new terminal session, or add them to your ~/.bashrc.

Usage

Run the script.

ros2 run targeting lesion_targeting

Workflow

1. Complete a robotic ultrasound sweep using the PRONOBIS platform.
2. Launch the visualization node - the 3D prostate model is reconstructed automatically from the sweep data.
3. Use the graphical interface to inspect ultrasound slices and navigate the 3D model.
4. Click on the model to select biopsy target locations.
5. Confirm targets — the robot will align the probe and targeting mechanism accordingly.

Known Issues and Limitations

• Currently validated on anatomically realistic medical phantoms only; clinical validation is ongoing.
• 3D reconstruction assumes a standardized rotational sweep; freehand sweep data is not yet supported.

Note

This module is part of the PRONOBIS project, one of CRTA's (Regional Center of Excellence for Robotic Technology) projects. Please check out the project website as well as CRTA website in order to learn more. Reach out to us if you would like to collaborate.