Skip to content

Latest commit

 

History

History
248 lines (237 loc) · 133 KB

File metadata and controls

248 lines (237 loc) · 133 KB

Supported Models

This page lists models supported by DL Streamer.

NOTE: DL Streamer relies on inference provided by the OpenVINO™ toolkit. Whether a particular model can be used on a given platform depends on its compatibility with OpenVINO™. See the OpenVINO™ documentation for details.

Supported Architectures

DL Streamer supports the following model architectures from GETI and major model hubs such as Ultralytics and Hugging Face.

The table provides links to model preparation instructions describing download and conversion steps that can be performed either manually or by using dedicated scripts.

Architecture Model Preparation Example Model Demo App
--- Anomaly Detection:
Padim GETI   GETI Deployment
STFPM GETI   GETI Deployment
UFlow GETI   GETI Deployment
--- Detection:
YOLOv5u Ultralytics Exporter yolov5nu.pt Object Detection and Classification with YOLO
YOLOv8 Ultralytics Exporter yolov8n.pt Object Detection and Classification with YOLO
YOLOv9 Ultralytics Exporter yolov9s.pt Object Detection and Classification with YOLO
YOLOv10 Ultralytics Exporter yolov10n.pt Object Detection and Classification with YOLO
YOLO11 Ultralytics Exporter yolo11n.pt Object Detection and Classification with YOLO
YOLO26 Ultralytics Exporter yolo26n.pt Object Detection and Classification with YOLO
YOLOE-26 Ultralytics Exporter yoloe-26n-seg.pt Prompt-based Object Detection
RTDetrForObjectDetection Optimum-onnx + OpenVINO ovc PekingU/​rrtdetr_r50vd Smart Network Video Recorder for Lane Hogging Detection
RtDetrV2ForObjectDetection Optimum-onnx + OpenVINO ovc PekingU/​rtdetr_v2_r18vd Smart Network Video Recorder for Lane Hogging Detection
ATSS with ResNet or MobilenetV2 GETI    
SSD with MobilenetV2 GETI    
RT-DETR GETI    
YOLOX GETI    
D-Fine GETI    
CenterFace download_public_models.sh centerface.onnx Custom Post-Processing Library Sample - Classification
YOLOv7 download_public_models.sh
labels-file=coco_80cl.txt
model-proc=yolo-v7.json
yolov7.pt Object Detection and Classification with YOLO
--- Emotion Recognition:
HSEmotion download_public_models.sh enet_b0_8_va_mtl.onnx Custom Post-Processing Library Sample - Classification
--- Feature Extraction:  
Mars-small128 download_public_models.sh   Deep SORT Tracking
--- Image Classification:
ViTForImageClassification Optimum-Intel dima806/​fairface_age_image_detection Face Detection and Classification
Mobilenet-V3 GETI    
EfficientNet-B0 GETI    
DeitTiny GETI    
--- Image Embeddings:
CLIPModel CLIP ViT Conversion openai/​clip-vit-large-patch14 Frame Embeddings
--- Instance Segmentation:
YOLOv8-seg Ultralytics Exporter yolov8n-seg.pt Object Detection and Classification with YOLO
YOLO11-seg Ultralytics Exporter yolo11n-seg.pt Object Detection and Classification with YOLO
YOLO26-seg Ultralytics Exporter yolo26n-seg.pt Object Detection and Classification with YOLO
MaskRCNN with EfficientNet, ResNet50, or Swin Transformer GETI    
RTMDet GETI    
--- Optical Character Recognition:
Paddle OCRv4 download_public_models.sh ch_PP-OCRv4_rec_infer License Plate Recognition Sample
--- Oriented Detection:
YOLOv8-obb Ultralytics Exporter yolov8n-obb.pt Object Detection and Classification with YOLO
YOLO11-obb Ultralytics Exporter yolo11n-obb.pt Object Detection and Classification with YOLO
YOLO26-obb Ultralytics Exporter yolo26n-obb.pt Object Detection and Classification with YOLO
--- Pose Estimation:
YOLOv8-pose Ultralytics Exporter yolov8n-pose.pt Object Detection and Classification with YOLO
YOLO11-pose Ultralytics Exporter yolo11n-pose.pt Object Detection and Classification with YOLO
YOLO26-pose Ultralytics Exporter yolo26n-pose.pt Object Detection and Classification with YOLO
--- Semantic Segmentation:
Lite-HRNet GETI    
SegNext GETI    
DinoV2 GETI    
--- Speech Recognition:
WhisperForConditionalGeneration Optimum-Intel openai/​whisper-tiny Audio Transcription
--- VLM:
InternVLChatModel Optimum-Intel OpenGVLab/​InternVL2-1B Gvagenai Demo
LlavaForConditionalGeneration Optimum-Intel llava-hf/​llava-1.5-7b-hf Gvagenai Demo
LlavaQwen2ForCausalLM Optimum-Intel qnguyen3/​nanoLLaVA Gvagenai Demo
BunnyQwenForCausalLM Optimum-Intel qnguyen3/​nanoLLaVA-1.5 Gvagenai Demo
LlavaNextForConditionalGeneration Optimum-Intel llava-hf/​llava-v1.6-mistral-7b-hf Gvagenai Demo
LlavaNextVideoForConditionalGeneration Optimum-Intel llava-hf/​LLaVA-NeXT-Video-7B-hf Gvagenai Demo
MiniCPMO Optimum-Intel openbmb/​MiniCPM-o-2_6 Gvagenai Demo
MiniCPMV Optimum-Intel openbmb/​MiniCPM-V-2_6 Gvagenai Demo
Phi3VForCausalLM Optimum-Intel microsoft/​Phi-3-vision-128k-instruct Gvagenai Demo
Phi4MMForCausalLM Optimum-Intel microsoft/​Phi-4-multimodal-instruct Gvagenai Demo
Qwen2VLForConditionalGeneration Optimum-Intel Qwen/​Qwen2-VL-2B-Instruct Gvagenai Demo
Qwen2_5_VLForConditionalGeneration Optimum-Intel Qwen/​Qwen2.5-VL-3B-Instruct Gvagenai Demo
Gemma3ForConditionalGeneration Optimum-Intel google/​gemma-3-4b-it Gvagenai Demo

OMZ Models

The table below lists supported models from OpenVINO™ Open Model Zoo. These models can be downloaded using the download_omz_models.sh script:

Model Name labels-file model-proc Demo App
--- Action Recognition:
action-recognition-0001 kinetics_400.txt   Action Recognition Demo
driver-action-recognition-adas-0002 driver_actions.txt   Action Recognition Demo
weld-porosity-detection-0001   weld-porosity-detection-0001.json Action Recognition Demo
--- Classification:
anti-spoof-mn3   anti-spoof-mn3.json Interactive Face Detection Demo
densenet-121-tf imagenet_2012.txt preproc-aspect-ratio.json Classification Demo
dla-34 imagenet_2012.txt preproc-aspect-ratio.json Classification Demo
efficientnet-b0 imagenet_2012.txt preproc-aspect-ratio.json Classification Demo
efficientnet-b0-pytorch imagenet_2012.txt preproc-aspect-ratio.json Classification Demo
efficientnet-v2-b0 imagenet_2012.txt preproc-aspect-ratio.json Classification Demo
efficientnet-v2-s imagenet_2012.txt preproc-aspect-ratio.json Classification Demo
emotion-ferplus-8   emotion-ferplus-8.json  
googlenet-v1-tf imagenet_2012.txt preproc-aspect-ratio.json Classification Demo
googlenet-v2-tf imagenet_2012_bkgr.txt preproc-aspect-ratio.json Classification Demo
googlenet-v3 imagenet_2012_bkgr.txt preproc-aspect-ratio.json Classification Demo
googlenet-v3-pytorch imagenet_2012.txt preproc-aspect-ratio.json Classification Demo
googlenet-v4-tf imagenet_2012_bkgr.txt preproc-aspect-ratio.json Classification Demo
hbonet-0.25 imagenet_2012.txt preproc-aspect-ratio.json Classification Demo
hbonet-1.0 imagenet_2012.txt preproc-aspect-ratio.json Classification Demo
inception-resnet-v2-tf imagenet_2012_bkgr.txt preproc-aspect-ratio.json Classification Demo
mixnet-l imagenet_2012.txt preproc-aspect-ratio.json Classification Demo
mobilenet-v1-0.25-128 imagenet_2012_bkgr.txt preproc-aspect-ratio.json Classification Demo
mobilenet-v1-1.0-224-tf imagenet_2012_bkgr.txt preproc-aspect-ratio.json Classification Demo
mobilenet-v2-1.0-224 imagenet_2012_bkgr.txt preproc-aspect-ratio.json Classification Demo
mobilenet-v2-1.4-224 imagenet_2012_bkgr.txt preproc-aspect-ratio.json Classification Demo
mobilenet-v2-pytorch imagenet_2012.txt preproc-aspect-ratio.json Classification Demo
mobilenet-v3-large-1.0-224-tf imagenet_2012.txt preproc-aspect-ratio.json Classification Demo
mobilenet-v3-small-1.0-224-tf imagenet_2012.txt preproc-aspect-ratio.json Classification Demo
mobilenetv2-7   mobilenetv2-7.json  
nfnet-f0 imagenet_2012.txt preproc-aspect-ratio.json Classification Demo
open-closed-eye-0001   open-closed-eye-0001.json Gaze Estimation Demo
regnetx-3.2gf imagenet_2012.txt preproc-aspect-ratio.json Classification Demo
repvgg-a0 imagenet_2012.txt preproc-aspect-ratio.json Classification Demo
repvgg-b1 imagenet_2012.txt preproc-aspect-ratio.json Classification Demo
repvgg-b3 imagenet_2012.txt preproc-aspect-ratio.json Classification Demo
resnest-50-pytorch imagenet_2012.txt preproc-aspect-ratio.json Classification Demo
resnet-18-pytorch imagenet_2012.txt preproc-aspect-ratio.json Classification Demo
resnet-34-pytorch imagenet_2012.txt preproc-aspect-ratio.json Classification Demo
resnet-50-pytorch imagenet_2012.txt preproc-aspect-ratio.json Classification Demo
resnet-50-tf imagenet_2012_bkgr.txt preproc-aspect-ratio.json Classification Demo
resnet18-xnor-binary-onnx-0001   resnet18-xnor-binary-onnx-0001.json Classification Demo
resnet50-binary-0001   resnet50-binary-0001.json Classification Demo
rexnet-v1-x1.0 imagenet_2012.txt preproc-aspect-ratio.json Classification Demo
shufflenet-v2-x1.0 imagenet_2012.txt preproc-aspect-ratio.json Classification Demo
swin-tiny-patch4-window7-224 imagenet_2012.txt preproc-aspect-ratio.json Classification Demo
--- Detection:
efficientdet-d0-tf coco_91cl.txt   Object Detection Demo
efficientdet-d1-tf coco_91cl.txt   Object Detection Demo
face-detection-0200   face-detection-0200.json Object Detection Demo
face-detection-0202   face-detection-0202.json Object Detection Demo
face-detection-0204   face-detection-0204.json Object Detection Demo
face-detection-0205   face-detection-0205.json Object Detection Demo
face-detection-0206   face-detection-0206.json Object Detection Demo
face-detection-adas-0001   face-detection-adas-0001.json Object Detection Demo
face-detection-retail-0004   face-detection-retail-0004.json Object Detection Demo
face-detection-retail-0005   face-detection-retail-0005.json Object Detection Demo
faster_rcnn_inception_resnet_v2_atrous_coco coco_91cl_bkgr.txt preproc-image-info.json Object Detection Demo
faster_rcnn_resnet50_coco coco_91cl_bkgr.txt preproc-image-info.json Object Detection Demo
horizontal-text-detection-0001   horizontal-text-detection-0001.json Text Detection Demo
mobilenet-yolo-v4-syg   mobilenet-yolo-v4-syg.json Object Detection Demo
pedestrian-and-vehicle-detector-adas-0001   pedestrian-and-vehicle-detector-adas-0001.json Object Detection Demo
pedestrian-detection-adas-0002   pedestrian-detection-adas-0002.json Object Detection Demo
person-detection-0200   person-detection-0200.json Object Detection Demo
person-detection-0201   person-detection-0201.json Object Detection Demo
person-detection-0202   person-detection-0202.json Object Detection Demo
person-detection-0203   person-detection-0203.json Object Detection Demo
person-detection-asl-0001   person-detection-0203.json Object Detection Demo
person-detection-retail-0013   person-detection-retail-0013.json Object Detection Demo
person-vehicle-bike-detection-2000   person-vehicle-bike-detection-2000.json Object Detection Demo
person-vehicle-bike-detection-2001   person-vehicle-bike-detection-2001.json Object Detection Demo
person-vehicle-bike-detection-2002   person-vehicle-bike-detection-2002.json Object Detection Demo
person-vehicle-bike-detection-2003   person-vehicle-bike-detection-2003.json Object Detection Demo
person-vehicle-bike-detection-2004   person-vehicle-bike-detection-2004.json Object Detection Demo
person-vehicle-bike-detection-crossroad-0078   person-vehicle-bike-detection-crossroad-0078.json Object Detection Demo
person-vehicle-bike-detection-crossroad-1016   person-vehicle-bike-detection-crossroad-1016.json Object Detection Demo
person-vehicle-bike-detection-crossroad-yolov3-1020   person-vehicle-bike-detection-crossroad-yolov3-1020.json Object Detection Demo
product-detection-0001   product-detection-0001.json Object Detection Demo
retinaface-resnet50-pytorch     Object Detection Demo
retinanet-tf coco_91cl_bkgr.txt preproc-image-info.json Object Detection Demo
rfcn-resnet101-coco-tf coco_91cl_bkgr.txt preproc-image-info.json Object Detection Demo
ssd_mobilenet_v1_coco coco_91cl_bkgr.txt preproc-image-info.json Object Detection Demo
ssd_mobilenet_v2_coco coco_91cl_bkgr.txt preproc-image-info.json Object Detection Demo
ssd_mobilenet_v1_fpn_coco coco_91cl_bkgr.txt preproc-image-info.json Object Detection Demo
ssdlite_mobilenet_v2 coco_91cl_bkgr.txt preproc-image-info.json Object Detection Demo
torchvision.models.detection.ssdlite320_mobilenet_v3_large coco_80cl.txt    
ultra-lightweight-face-detection-rfb-320   ultra-lightweight-face-detection-rfb-320.json Object Detection Demo
ultra-lightweight-face-detection-slim-320   ultra-lightweight-face-detection-slim-320.json Object Detection Demo
vehicle-detection-0200   vehicle-detection-0200.json Object Detection Demo
vehicle-detection-0201   vehicle-detection-0201.json Object Detection Demo
vehicle-detection-0202   vehicle-detection-0202.json Object Detection Demo
vehicle-detection-adas-0002   vehicle-detection-adas-0002.json Object Detection Demo
vehicle-license-plate-detection-barrier-0106   vehicle-license-plate-detection-barrier-0106.json Security Barrier Camera Demo
vehicle-license-plate-detection-barrier-0123   vehicle-license-plate-detection-barrier-0123.json Security Barrier Camera Demo
yolo-v3-tf coco_80cl.txt yolo-v3-tf.json Object Detection Demo
yolo-v3-tiny-tf coco_80cl.txt yolo-v3-tiny-tf.json Object Detection Demo
yolo-v4-tf coco_80cl.txt yolo-v4-tf.json Object Detection Demo
yolo-v4-tiny-tf coco_80cl.txt yolo-v4-tiny-tf.json Object Detection Demo
Head Pose Estimation:
head-pose-estimation-adas-0001     Gaze Estimation Demo
Human Pose Estimation:
human-pose-estimation-0001   human-pose-estimation-0001.json Multi Channel Human Pose Estimation Demo
single-human-pose-estimation-0001   single-human-pose-estimation-0001.json Single Human Pose Estimation Demo
Instance Segmentation:
product-detection-0001   product-detection-0001.json Object Detection Demo
retinaface-resnet50-pytorch     Object Detection Demo
retinanet-tf coco_91cl_bkgr.txt preproc-image-info.json Object Detection Demo
rfcn-resnet101-coco-tf coco_91cl_bkgr.txt preproc-image-info.json Object Detection Demo
ssd_mobilenet_v1_coco coco_91cl_bkgr.txt preproc-image-info.json Object Detection Demo
ssd_mobilenet_v2_coco coco_91cl_bkgr.txt preproc-image-info.json Object Detection Demo
ssd_mobilenet_v1_fpn_coco coco_91cl_bkgr.txt preproc-image-info.json Object Detection Demo
ssdlite_mobilenet_v2 coco_91cl_bkgr.txt preproc-image-info.json Object Detection Demo
ultra-lightweight-face-detection-rfb-320   ultra-lightweight-face-detection-rfb-320.json Object Detection Demo
ultra-lightweight-face-detection-slim-320   ultra-lightweight-face-detection-slim-320.json Object Detection Demo
vehicle-detection-0200   vehicle-detection-0200.json Object Detection Demo
vehicle-detection-0201   vehicle-detection-0201.json Object Detection Demo
vehicle-detection-0202   vehicle-detection-0202.json Object Detection Demo
vehicle-detection-adas-0002   vehicle-detection-adas-0002.json Object Detection Demo
vehicle-license-plate-detection-barrier-0106   vehicle-license-plate-detection-barrier-0106.json Security Barrier Camera Demo
vehicle-license-plate-detection-barrier-0123   vehicle-license-plate-detection-barrier-0123.json Security Barrier Camera Demo
yolo-v3-tf coco_80cl.txt yolo-v3-tf.json Object Detection Demo
yolo-v3-tiny-tf coco_80cl.txt yolo-v3-tiny-tf.json Object Detection Demo
yolo-v4-tf coco_80cl.txt yolo-v4-tf.json Object Detection Demo
yolo-v4-tiny-tf coco_80cl.txt yolo-v4-tiny-tf.json Object Detection Demo
--- Head Pose Estimation:
head-pose-estimation-adas-0001     Gaze Estimation Demo
--- Human Pose Estimation:
human-pose-estimation-0001   human-pose-estimation-0001.json Multi Channel Human Pose Estimation Demo
single-human-pose-estimation-0001   single-human-pose-estimation-0001.json Single Human Pose Estimation Demo
--- Instance Segmentation:
instance-segmentation-person-0007     Background Subtraction Demo
instance-segmentation-security-0002 coco_80cl.txt   Background Subtraction Demo
instance-segmentation-security-0091 coco_80cl.txt   Background Subtraction Demo
instance-segmentation-security-0228 coco_80cl.txt   Background Subtraction Demo
instance-segmentation-security-1039 coco_80cl.txt   Background Subtraction Demo
instance-segmentation-security-1040 coco_80cl.txt   Background Subtraction Demo
mask_rcnn_inception_resnet_v2_atrous_coco   mask-rcnn.json Mask RCNN Demo
mask_rcnn_resnet50_atrous_coco   mask-rcnn.json Mask RCNN Demo
--- Object Attributes:
age-gender-recognition-retail-0013   age-gender-recognition-retail-0013.json Interactive Face Detection Demo
emotions-recognition-retail-0003   emotions-recognition-retail-0003.json Interactive Face Detection Demo
facial-landmarks-35-adas-0002   facial-landmarks-35-adas-0002.json Gaze Estimation Demo
facial-landmarks-98-detection-0001   facial-landmarks-98-detection-0001.json Gaze Estimation Demo
landmarks-regression-retail-0009   landmarks-regression-retail-0009.json Face Recognition Demo
person-attributes-recognition-crossroad-0230   person-attributes-recognition-crossroad-0230.json Crossroad Camera Demo
person-attributes-recognition-crossroad-0234   person-attributes-recognition-crossroad-0234.json Crossroad Camera Demo
person-attributes-recognition-crossroad-0238   person-attributes-recognition-crossroad-0238.json Crossroad Camera Demo
vehicle-attributes-recognition-barrier-0039   vehicle-attributes-recognition-barrier-0039.json Security Barrier Camera Demo
vehicle-attributes-recognition-barrier-0042   vehicle-attributes-recognition-barrier-0042.json Security Barrier Camera Demo
--- Optical Character Recognition:
license-plate-recognition-barrier-0007   license-plate-recognition-barrier-0007.json Security Barrier Camera Demo
--- Sound Classification:
aclnet   aclnet.json Sound Classification Demo

Legal Information

Ultralytics, Hugging Face, PyTorch, TensorFlow, PaddlePaddle, Caffe, Keras, and MXNet are trademarks or brand names of their respective owners. All company, product, and service names used on this website are for identification purposes only. Use of these names, trademarks, and brands does not imply endorsement.