VPU Support

[adtrytech]

Hi Teams,

Can the OpenVINO sample code support VPU acceleration?
And, How to achieve it?

Thank You!

[amr-mokhtar]

Hi @adtrytech. Yes, it can.
You need to update the env variable OPENVINO_ACCL to the value MYRIAD or CPU_MYRIAD to have alternating processing through VPU & CPU. More details at this section.

[adtrytech]

Hi @amr-mokhtar,

Thanks for your support.
I ran the command directly(not follow the producer and consumer rule) and I were failed by using the PCIE card "Intel® Movidius™ Myriad™ X VPU" hardware accelerator.

Below are my procedures and hope you can help me on this. I need to utilize this PCIE card successfully.

1. Launch the consumer app and clientsim app with proper IP settings and initialization.
2. Using CPU was OK. The command:
   /root/omz_demos_build/intel64/Release/object_detection_demo_ssd_async -d CPU -i rtp://127.0.0.1:5000?overrun_nonfatal=1 -m pedestrian-detection-adas-0002/FP32/pedestrian-detection-adas-0002.xml
   3. Using the HDDL was failed. The command + log:
   root@openvino-cons-app-6744f45755-gnwld:~# /root/omz_demos_build/intel64/Release/object_detection_demo_ssd_async -d HDDL -i rtp://127.0.0.1:5000?overrun_nonfatal=1 -m pedestrian-detection-adas-0002/FP16/pedestrian-detection-adas-0002.xml
   InferenceEngine:
   API version ............ 2.0
   Build .................. custom_releases/2019/R2_f5827d4773ebbe727c9acac5f007f7d94dd4be4e
   Description ....... API
   [ INFO ] Parsing input parameters
   [ INFO ] Reading input
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   [rtp @ 0x2082660] Received packet without a start chunk; dropping frame.
   OpenCV: FFMPEG: tag 0x47504a4d/'MJPG' is not supported with codec id 8 and format 'mjpeg / raw MJPEG video'
   [ INFO ] Loading Inference Engine
   [ INFO ] Device info:
   HDDL
   HDDLPlugin version ......... 2.0
   Build ........... 27579
   [ INFO ] Loading network files
   [ INFO ] Batch size is forced to 1.
   [ INFO ] Checking that the inputs are as the demo expects
   [ INFO ] Checking that the outputs are as the demo expects
   [ INFO ] Loading model to the device
   [06:12:24.2845][4709]I[ServiceStarter.cpp:93] Info: Found HDDL Service is not running. To start HDDL Service ...
   [06:12:24.2878][4709]I[ServiceStarter.cpp:40] Info: Waiting for HDDL Service getting ready ...
   open /dev/ion failed!
   [ion_close][69]close ion_fd = -1
   open /dev/ion failed!
   [06:12:24.2989][4713]I[main.cpp:243] ## HDDL_INSTALL_DIR: /opt/intel/openvino_2019.2.275/deployment_tools/inference_engine/external/hddl
   [06:12:24.2990][4713]I[main.cpp:245] Config file '/opt/intel/openvino_2019.2.275/deployment_tools/inference_engine/external/hddl/config/hddl_service.config' has been loaded
   [06:12:24.2996][4713]I[FileHelper.cpp:272] Set file:/var/tmp/hddl_service_alive.mutex owner: user-'no_change', group-'users', mode-'0660'
   [06:12:24.2997][4713]I[FileHelper.cpp:272] Set file:/var/tmp/hddl_service_ready.mutex owner: user-'no_change', group-'users', mode-'0660'
   [06:12:24.2997][4713]I[FileHelper.cpp:272] Set file:/var/tmp/hddl_start_exit.mutex owner: user-'no_change', group-'users', mode-'0660'
   [06:12:24.2999][4713]I[AutobootStarter.cpp:155] Info: No running autoboot process. Start autoboot daemon...
   open /dev/ion failed!
   [06:12:24.3040][4714]ERROR[DeviceMonitorMyxImpl.cpp:107] Error: libusb initialise failed (LIBUSB_ERROR_OTHER)
   [06:12:24.3054][4714]I[FileHelper.cpp:272] Set file:/var/tmp/hddl_autoboot_alive.mutex owner: user-'no_change', group-'users', mode-'0660'
   [06:12:24.3055][4714]I[FileHelper.cpp:272] Set file:/var/tmp/hddl_autoboot_ready.mutex owner: user-'no_change', group-'users', mode-'0660'
   [06:12:24.3055][4714]I[FileHelper.cpp:272] Set file:/var/tmp/hddl_autoboot_start_exit.mutex owner: user-'no_change', group-'users', mode-'0660'
   [06:12:24.3056][4714]I[FileHelper.cpp:272] Set file:/tmp/hddl_autoboot_device.map owner: user-'no_change', group-'users', mode-'0660'
   [06:12:24.3057][4714]I[AutoBoot.cpp:300] [Firmware Config] deviceName=default deviceNum=0 firmwarePath=/opt/intel/openvino_2019.2.275/deployment_tools/inference_engine/external/hddl/lib/mvnc/MvNCAPI-ma2x8x.mvcmd
   [I:] [BSL] Config file detected at /opt/intel/openvino_2019.2.275/deployment_tools/inference_engine/external/hddl/config/bsl.json
   [I:] [BSL] hid-f75114 is disabled by config, skipping
   [I:] [BSL] ioexpander is disabled by config, skipping
   [I:] [BSL] mcu is disabled by config, skipping
   [I:] [BSL] Performing auto-scan
   [I:] [BSL] scan F75114 device...
   [I:] [BSL] A matched device found at /sys/devices/pci0000:85/0000:85:02.0/0000:88:00.0/0000:89:04.0/0000:8d:00.0/usb9/9-2/9-2.2/9-2.2:1.0/0003:2C42:5114.0001/hidraw/hidraw0
   [I:] [BSL] found 1 F75114 device
   [I:] [BSL] Found 1 devices
   [I:] [BSL] hddl_set_device bsl_device=2
   [I:] [BSL] Reset all devices with device type 2
   [06:12:24.3093][4714]ERROR[AutoBoot.cpp:470] Error: HDDL hardware initialization failed, exits now.
   [ion_close][69]close ion_fd = -1
   [06:12:25.3033][4713]I[AutobootStarter.cpp:78] Info: Service has been waiting for Autoboot to boot up for 1 seconds ...
   [06:12:26.3066][4713]I[AutobootStarter.cpp:78] Info: Service has been waiting for Autoboot to boot up for 2 seconds ...
   [06:12:27.3096][4713]I[AutobootStarter.cpp:78] Info: Service has been waiting for Autoboot to boot up for 3 seconds ...
   [06:12:28.3125][4713]I[AutobootStarter.cpp:78] Info: Service has been waiting for Autoboot to boot up for 4 seconds ...
   [06:12:29.3156][4713]I[AutobootStarter.cpp:78] Info: Service has been waiting for Autoboot to boot up for 5 seconds ...
   [06:12:30.3188][4713]I[AutobootStarter.cpp:78] Info: Service has been waiting for Autoboot to boot up for 6 seconds ...
   [06:12:31.3219][4713]I[AutobootStarter.cpp:78] Info: Service has been waiting for Autoboot to boot up for 7 seconds ...
   [06:12:32.3251][4713]I[AutobootStarter.cpp:78] Info: Service has been waiting for Autoboot to boot up for 8 seconds ...
   [06:12:33.3284][4713]I[AutobootStarter.cpp:78] Info: Service has been waiting for Autoboot to boot up for 9 seconds ...
   [06:12:34.3312][4713]I[AutobootStarter.cpp:78] Info: Service has been waiting for Autoboot to boot up for 10 seconds ...
   [06:12:34.3313][4713]ERROR[AutobootStarter.cpp:88] Error: Service wait Autoboot to get ready failed due to timeout after 10 seconds.
   [06:12:34.3314][4713]W[AutobootStarter.cpp:98]
   ** Suggestion: The timeout by default is 10 seconds, and you can increase it by following steps:
   (1) Add following entry in $HDDL_INSTALL_DIR/config/hddl_service.config like this:
   "service_settings":
   {
   "autoboot_boot_timeout_sec": 10,
   ...
   }
   (2) Change the '10' to a larger value to increase the time out window, then try again.

[06:12:34.3317][4713]ERROR[AutobootStarter.cpp:48] Error: Failed to start autoboot
[06:12:34.3317][4713]ERROR[main.cpp:76] Error: Start Service failed due to autoboot failure
[ion_close][69]close ion_fd = -1
[06:14:04.4606][4709]ERROR[ServiceStarter.cpp:55] Error: Wait HDDL Service Ready failed.
[06:14:04.4609][4709]ERROR[ServiceStarter.cpp:29] Error: Failed to start HDDL Service
[06:14:04.4609][4709]ERROR[HddlClient.cpp:215] Error: Failed to boot service.

[06:14:04.4611][4709]I[HddlClient.cpp:203] Info: Hddl client unregistered.
[ ERROR ] _client->query(QUERY_TYPE_DEVICE, &query) failed: HDDL_NOT_INITIALIZED

[adtrytech]

Hi @amr-mokhtar,

Provide the HOST OS information and I just deployed the OpenNESS and utilized its sample applications.
It means there is no other extra installation such as OpenVINO on the HOST.

[root@en01 ~]# cat /etc/centos-release
CentOS Linux release 7.8.2003 (Core)

[root@en01 ~]# uname -a
Linux en01 3.10.0-1127.el7.x86_64 #1 SMP Tue Mar 31 23:36:51 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

[amr-mokhtar]

Hi @adtrytech. I see that you are using HDDL.
For HDDL, you need to enable HDDL service by setting variable ne_hddl_enable: true in the converged-edge-experience-kits/inventory/default/group_vars/all/10-default.yml before running CEEK playbooks.

More details at Using Intel® Movidius™ Myriad™ X High Density Deep Learning (HDDL) solution in OpenNESS document.

[adtrytech]

Hi @amr-mokhtar,

Thanks for your support.
I took some time to redeploy the OpenNESS with enabling the parameter "ne_hddl_enable: true".
But, unfortunately I still got failed on using the HDDL device for inference.
Do you have any suggestion or anything I should provide and check? Thank you!

At the openvino consumer APP, I got the same error message attached before with the same command:
/root/omz_demos_build/intel64/Release/object_detection_demo_ssd_async -d HDDL -i rtp://127.0.0.1:5000?overrun_nonfatal=1 -m pedestrian-detection-adas-0002/FP16/pedestrian-detection-adas-0002.xml

At the edge node equipped with HDDL device, the HDDL daemon was started normally. I built the drv_ion and install it to the edge node.
[root@en01 drv_ion]# ls /dev/ion
/dev/ion

[root@en01 ~]# ps ax | grep hddl
40941 ? Ssl 0:00 /usr/local/bin/docker run --name ov_hddl --rm --device-cgroup-rule=c 10:* rmw --device-cgroup-rule=c 89:* rmw --device-cgroup-rule=c 189:* rmw --device-cgroup-rule=c 180:* rmw -v /usr/src:/usr/src -v /lib/modules:/lib/modules -v /etc/modules-load.d:/etc/modules-load.d -v /dev:/dev -v /var/tmp:/var/tmp openvisualcloud/openness-ubuntu1804-analytics-hddldaemon /usr/local/bin/run_hddl.sh
41449 ? Ss 0:00 /bin/bash /usr/local/bin/run_hddl.sh
42239 ? Sl 0:28 ./hddldaemon
42244 ? Sl 0:00 /opt/intel/openvino/deployment_tools/inference_engine/external/hddl/bin/autoboot --auxiliary
66831 pts/2 S+ 0:00 grep --color=auto hddl

[mcping]

@adtrytech could you show us the deploy logs and your oek commit?

1. You should have myriad0-7 dev which are vpus in HDDL card.
   ls /dev
   autofs dm-2 i2c-2 mqueue port sda2 tty12 tty26 tty4 tty53 ttyS0 usbmon6 vcsa4
   block dri i2c-3 myriad0 ppp sda3 tty13 tty27 tty40 tty54 ttyS1 usbmon7 vcsa5
   bsg fb0 i2c-4 myriad1 ptmx sg0 tty14 tty28 tty41 tty55 ttyS2 usbmon8 vcsa6
   btrfs-control fd i2c-5 myriad2 ptp0 shm tty15 tty29 tty42 tty56 ttyS3 usbmon9 vfio
   bus full initctl myriad3 ptp1 snapshot tty16 tty3 tty43 tty57 uhid vcs vga_arbiter
   centos fuse input myriad4 ptp2 snd tty17 tty30 tty44 tty58 uinput vcs1 vhci
   char hidraw0 ipmi0 myriad5 ptp3 stderr tty18 tty31 tty45 tty59 urandom vcs2 vhost-net
   console hidraw1 kmsg myriad6 pts stdin tty19 tty32 tty46 tty6 usb vcs3 zero
   core hidraw2 kvm myriad7 qat_adf_ctl stdout tty2 tty33 tty47 tty60 usbmon0 vcs4
   cpu hidraw3 log net random termination-log tty20 tty34 tty48 tty61 usbmon1 vcs5
2. docker logs ov_hddl should as below:
   [setupvars.sh] OpenVINO environment initialized
   [04:58:08.8236][25]I[main.cpp:246] ## HDDL_INSTALL_DIR: /opt/intel/openvino/deployment_tools/inference_engine/external/hddl
   [04:58:08.8237][25]I[main.cpp:248] Config file '/opt/intel/openvino/deployment_tools/inference_engine/external/hddl/config/hddl_service.config' has been loaded
   [04:58:08.8252][25]I[FileHelper.cpp:272] Set file:/var/tmp/hddl_service_alive.mutex owner: user-'no_change', group-'users', mode-'0660'
   [04:58:08.8252][25]I[FileHelper.cpp:272] Set file:/var/tmp/hddl_service_ready.mutex owner: user-'no_change', group-'users', mode-'0660'
   [04:58:08.8253][25]I[FileHelper.cpp:272] Set file:/var/tmp/hddl_service_failed.mutex owner: user-'no_change', group-'users', mode-'0660'
   [04:58:08.8253][25]I[FileHelper.cpp:272] Set file:/var/tmp/hddl_start_exit.mutex owner: user-'no_change', group-'users', mode-'0660'
   [04:58:08.8257][25]I[AutobootStarter.cpp:156] Info: No running autoboot process. Start autoboot daemon...
   [04:58:31.8325][25]I[AutobootStarter.cpp:85] Info: Autoboot is running.
   �[1;36;40m[04:58:31.8474][25]W[ConfigParser.cpp:269] Warning: Cannot find key, path=scheduler_config.max_graph_per_device subclass=0, use default value: 1.�[0m
   �[1;36;40m[04:58:31.8474][25]W[ConfigParser.cpp:292] Warning: Cannot find key, path=scheduler_config.use_sgad_by_default subclass=0, use default value: false.�[0m
   [04:58:31.8479][25]I[FileHelper.cpp:272] Set file:/var/tmp/hddl_snapshot.sock owner: user-'no_change', group-'users', mode-'0660'
   [04:58:31.8493][25]I[DeviceSchedulerFactory.cpp:56] Info: ## DeviceSchedulerFacotry ## Created Squeeze Device-Scheduler2.
   [04:58:31.8493][25]I[DeviceManager.cpp:551] ## SqueezeScheduler created ##
   [04:58:31.8493][25]I[DeviceManager.cpp:649] times 0: try to create worker on device(10.2)
   [04:58:33.8532][25]I[DeviceManager.cpp:670] [SUCCESS] times 0: create worker on device(10.2)
   [04:58:33.8533][25]I[DeviceManager.cpp:719] worker(Wt10.2) created on device(10.2), type(0)
   [04:58:33.8533][25]I[DeviceManager.cpp:649] times 0: try to create worker on device(10.1)
   [04:58:35.8577][25]I[DeviceManager.cpp:670] [SUCCESS] times 0: create worker on device(10.1)
   [04:58:35.8578][25]I[DeviceManager.cpp:719] worker(Wt10.1) created on device(10.1), type(0)
   [04:58:35.8579][25]I[DeviceManager.cpp:649] times 0: try to create worker on device(8.2)
   [04:58:37.8617][25]I[DeviceManager.cpp:670] [SUCCESS] times 0: create worker on device(8.2)
   [04:58:37.8618][25]I[DeviceManager.cpp:719] worker(Wt8.2) created on device(8.2), type(0)
   [04:58:37.8619][25]I[DeviceManager.cpp:649] times 0: try to create worker on device(8.1)
   [04:58:39.8660][25]I[DeviceManager.cpp:670] [SUCCESS] times 0: create worker on device(8.1)
   [04:58:39.8661][25]I[DeviceManager.cpp:719] worker(Wt8.1) created on device(8.1), type(0)
   [04:58:39.8662][25]I[DeviceManager.cpp:649] times 0: try to create worker on device(6.2)
   [04:58:41.8703][25]I[DeviceManager.cpp:670] [SUCCESS] times 0: create worker on device(6.2)
   [04:58:41.8704][25]I[DeviceManager.cpp:719] worker(Wt6.2) created on device(6.2), type(0)
   [04:58:41.8705][25]I[DeviceManager.cpp:649] times 0: try to create worker on device(6.1)
   [04:58:43.8738][25]I[DeviceManager.cpp:670] [SUCCESS] times 0: create worker on device(6.1)
   [04:58:43.8739][25]I[DeviceManager.cpp:719] worker(Wt6.1) created on device(6.1), type(0)
   [04:58:43.8740][25]I[DeviceManager.cpp:649] times 0: try to create worker on device(4.2)
   [04:58:45.8781][25]I[DeviceManager.cpp:670] [SUCCESS] times 0: create worker on device(4.2)
   [04:58:45.8782][25]I[DeviceManager.cpp:719] worker(Wt4.2) created on device(4.2), type(0)
   [04:58:45.8782][25]I[DeviceManager.cpp:649] times 0: try to create worker on device(4.1)
   [04:58:47.8816][25]I[DeviceManager.cpp:670] [SUCCESS] times 0: create worker on device(4.1)
   [04:58:47.8817][25]I[DeviceManager.cpp:719] worker(Wt4.1) created on device(4.1), type(0)
   [04:58:47.8817][25]I[DeviceManager.cpp:145] DEVICE FOUND : 8
   [04:58:47.8817][25]I[DeviceManager.cpp:146] DEVICE OPENED : 8
   [04:58:47.8819][25]I[DeviceManagerCreator.cpp:81] New device manager(DeviceManager0) created with subclass(0), deviceCount(8)
   [04:58:47.8834][25]I[TaskSchedulerFactory.cpp:45] Info: ## TaskSchedulerFactory ## Created Polling Task-Scheduler.
   [04:58:47.8855][25]I[FileHelper.cpp:272] Set file:/var/tmp/hddl_service.sock owner: user-'no_change', group-'users', mode-'0660'
   [04:58:47.8857][25]I[MessageDispatcher.cpp:87] Message Dispatcher initialization finished
   [04:58:47.8858][25]I[main.cpp:106] SERVICE IS READY ...
   [04:58:52.8861][45]I[DeviceManager.cpp:916] DeviceSnapshot(subclass=0):
   | deviceId | 6(0x6) | 5(0x5) | 4(0x4) | 3(0x3) | 2(0x2) | 1(0x1) | 0(00) | 7(0x7) |
   | device | 10.1 | 8.2 | 8.1 | 6.2 | 6.1 | 4.2 | 4.1 | 10.2 |
   | util% | 0.0 % | 0.0 % | 0.0 % | 0.0 % | 0.0 % | 0.0 % | 0.0 % | 0.0 % |
   | thermal | 40.28(0) | 46.90(0) | 48.70(0) | 41.66(0) | 40.28(0) | 43.27(0) | 40.97(0) | 40.28(0) |
   | scheduler | squeeze | squeeze | squeeze | squeeze | squeeze | squeeze | squeeze | squeeze |
   | comment | | | | | | | | |
   | resetTimes | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
   | cacheNum | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
   | cacheGraph0 | | | | | | | | |
   | cacheGraph1 | | | | | | | | |
   | cacheGraph2 | | | | | | | | |
   | cacheGraph3 | | | | | | | | |
   +-------------+-------------------+-------------------+-------------------+-------------------+-------------------+-------------------+-------------------+-------------------+

[04:58:57.8865][45]I[DeviceManager.cpp:916] DeviceSnapshot(subclass=0):
| deviceId | 6(0x6) | 5(0x5) | 4(0x4) | 3(0x3) | 2(0x2) | 1(0x1) | 0(00) | 7(0x7) |
| device | 10.1 | 8.2 | 8.1 | 6.2 | 6.1 | 4.2 | 4.1 | 10.2 |
| util% | 0.0 % | 0.0 % | 0.0 % | 0.0 % | 0.0 % | 0.0 % | 0.0 % | 0.0 % |
| thermal | 41.66(0) | 46.45(0) | 47.80(0) | 41.66(0) | 40.97(0) | 42.81(0) | 40.97(0) | 41.43(0) |
| scheduler | squeeze | squeeze | squeeze | squeeze | squeeze | squeeze | squeeze | squeeze |
| comment | | | | | | | | |
| resetTimes | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| cacheNum | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| cacheGraph0 | | | | | | | | |
| cacheGraph1 | | | | | | | | |
| cacheGraph2 | | | | | | | | |
| cacheGraph3 | | | | | | | | |
+-------------+-------------------+-------------------+-------------------+-------------------+-------------------+-------------------+-------------------+-----------

3. to be sure your hddl card is pulg in:
   lspci | grep USB
   00:14.0 USB controller: Intel Corporation C620 Series Chipset Family USB 3.0 xHCI Controller (rev 09)
   1b:00.0 USB controller: ASMedia Technology Inc. ASM1042A USB 3.0 Host Controller
   1c:00.0 USB controller: ASMedia Technology Inc. ASM1042A USB 3.0 Host Controller
   1e:00.0 USB controller: ASMedia Technology Inc. ASM1042A USB 3.0 Host Controller
   1f:00.0 USB controller: ASMedia Technology Inc. ASM1042A USB 3.0 Host Controller

4. to get the VPU info in HDDL:
   lsusb | grep "Myriad VPU"
   Bus 010 Device 002: ID 03e7:f63b Intel Myriad VPU [Movidius Neural Compute Stick]
   Bus 010 Device 003: ID 03e7:f63b Intel Myriad VPU [Movidius Neural Compute Stick]
   Bus 008 Device 002: ID 03e7:f63b Intel Myriad VPU [Movidius Neural Compute Stick]
   Bus 008 Device 003: ID 03e7:f63b Intel Myriad VPU [Movidius Neural Compute Stick]
   Bus 006 Device 002: ID 03e7:f63b Intel Myriad VPU [Movidius Neural Compute Stick]
   Bus 006 Device 003: ID 03e7:f63b Intel Myriad VPU [Movidius Neural Compute Stick]
   Bus 004 Device 002: ID 03e7:f63b Intel Myriad VPU [Movidius Neural Compute Stick]
   Bus 004 Device 003: ID 03e7:f63b Intel Myriad VPU [Movidius Neural Compute Stick]

[adtrytech]

Hi mcping,

Sorry for I don't realize the meaning of "oek commit". Could you please describe it more detailed? Thank you!
By the way, I didn't install the OpenVINO toolkits on the edge node(host name: en01) that was equipped with VPU PCIE Cards.

Deploy Logs:
I deployed the OpenNESS several times to complete it eventually. So, there was three log files of this deployment.
2021-04-06_01-20-52_ansible.log
2021-04-06_01-57-20_ansible.log
2021-04-06_02-09-19_ansible.log

1. You should have myriad0-7 dev which are vpus in HDDL card.
   [root@en01 ~]# ls /dev
   autofs crash hidraw1 ipmi0 mei0 net ptp0 sda2 tty0 tty19 tty29 tty39 tty49 tty59 ttyS1 usbmon4 vcs5 vhci
   block disk hidraw2 kmsg mem network_latency ptp1 serial tty1 tty2 tty3 tty4 tty5 tty6 ttyS2 usbmon5 vcs6 vhost-net
   bsg dm-0 hidraw3 kvm mqueue network_throughput ptp2 sg0 tty10 tty20 tty30 tty40 tty50 tty60 ttyS3 usbmon6 vcsa watchdog
   btrfs-control dm-1 hidraw4 log myriad0 null ptp3 shm tty11 tty21 tty31 tty41 tty51 tty61 uhid usbmon7 vcsa1 watchdog0
   bus dm-2 hpet loop-control myriad1 nvram pts snapshot tty12 tty22 tty32 tty42 tty52 tty62 uinput usbmon8 vcsa2 zero
   centos dri hugepages lp0 myriad2 oldmem random snd tty13 tty23 tty33 tty43 tty53 tty63 urandom usbmon9 vcsa3
   char fb0 hwrng lp1 myriad3 port raw stderr tty14 tty24 tty34 tty44 tty54 tty7 usbmon0 vcs vcsa4
   console fd i2c-0 lp2 myriad4 ppp rtc stdin tty15 tty25 tty35 tty45 tty55 tty8 usbmon1 vcs1 vcsa5
   core full i2c-1 lp3 myriad5 pps0 rtc0 stdout tty16 tty26 tty36 tty46 tty56 tty9 usbmon10 vcs2 vcsa6
   cpu fuse initctl mapper myriad6 pps1 sda termination-log tty17 tty27 tty37 tty47 tty57 ttyACM0 usbmon2 vcs3 vfio
   cpu_dma_latency hidraw0 input mcelog myriad7 ptmx sda1 tty tty18 tty28 tty38 tty48 tty58 ttyS0 usbmon3 vcs4 vga_arbiter

2. docker logs ov_hddl should as below:
   Please refer to the file: hddl_docker_log.txt
   hddl_docker_log.txt

3. to be sure your hddl card is pulg in:
   [root@en01 ~]# lspci | grep USB
   00:14.0 USB controller: Intel Corporation C620 Series Chipset Family USB 3.0 xHCI Controller (rev 09)
   8a:00.0 USB controller: Renesas Technology Corp. uPD720202 USB 3.0 Host Controller (rev 02)
   8b:00.0 USB controller: Renesas Technology Corp. uPD720202 USB 3.0 Host Controller (rev 02)
   8c:00.0 USB controller: Renesas Technology Corp. uPD720202 USB 3.0 Host Controller (rev 02)
   8d:00.0 USB controller: Renesas Technology Corp. uPD720202 USB 3.0 Host Controller (rev 02)

4. to get the VPU info in HDDL:
   [root@en01 ~]# lsusb | grep "Myriad VPU"
   Bus 010 Device 002: ID 03e7:f63b Intel Myriad VPU [Movidius Neural Compute Stick]
   Bus 010 Device 003: ID 03e7:f63b Intel Myriad VPU [Movidius Neural Compute Stick]
   Bus 008 Device 002: ID 03e7:f63b Intel Myriad VPU [Movidius Neural Compute Stick]
   Bus 008 Device 003: ID 03e7:f63b Intel Myriad VPU [Movidius Neural Compute Stick]
   Bus 006 Device 002: ID 03e7:f63b Intel Myriad VPU [Movidius Neural Compute Stick]
   Bus 006 Device 003: ID 03e7:f63b Intel Myriad VPU [Movidius Neural Compute Stick]
   Bus 004 Device 002: ID 03e7:f63b Intel Myriad VPU [Movidius Neural Compute Stick]
   Bus 004 Device 003: ID 03e7:f63b Intel Myriad VPU [Movidius Neural Compute Stick]

[mcping]

I just want to know the version of openness-experience-kits, which you are using. I can see it in the deply log now.
Can you give me the lsusb and ls /dev lspci info? thanks.
To be sure your have the HDDL card for I am not very clear about 'VPU PCIE Cards' you mentioned.
You don't need to install OpenVINO on the host(node).

[adtrytech]

Hi mcping,

Regarding the "lsusb and ls /dev lspci info", please refer to my previous responses.
I checked it on the edge node which is equipped with HDDL card.
The "VPU PCIE Card" is equal to HDDL card. FYI. Sorry for confusing.

Is the "drv_ion" driver required by the HDDL host node?

[mcping]

your hddldeamon is normal showed by the logs.
drv_ion is not needed.

[adtrytech]

Hi mcping,

OK. So, just deploy the OpenNESS with enabling the parameter "ne_hddl_enable: true", righ?
If the answer is YES, please help to resolve why I can't execute the openvino sample code at the edge node. Thank you!

[mcping]

1. which openvino version are you using? l_openvino_toolkit_p_2020.2.120? or l_openvino_toolkit_p_2019.3.334?
   I use l_openvino_toolkit_p_2021.1.110 and I can not find object_detection_demo_ssd_async
   ls -al
   total 2480
   drwxr-xr-x. 3 root root 4096 Apr 20 11:28 .
   drwxr-xr-x. 3 root root 21 Apr 20 11:27 ..
   -rwxr-xr-x. 1 root root 486336 Apr 20 11:27 benchmark_app
   -rwxr-xr-x. 1 root root 307656 Apr 20 11:27 classification_sample_async
   -rwxr-xr-x. 1 root root 181168 Apr 20 11:27 hello_classification
   -rwxr-xr-x. 1 root root 156584 Apr 20 11:27 hello_nv12_input_classification
   -rwxr-xr-x. 1 root root 60784 Apr 20 11:27 hello_query_device
   -rwxr-xr-x. 1 root root 178320 Apr 20 11:28 hello_reshape_ssd
   drwxr-xr-x. 2 root root 62 Apr 20 11:27 lib
   -rwxr-xr-x. 1 root root 354904 Apr 20 11:28 ngraph_function_creation_sample
   -rwxr-xr-x. 1 root root 263984 Apr 20 11:28 object_detection_sample_ssd
   -rwxr-xr-x. 1 root root 282584 Apr 20 11:28 speech_sample
   -rwxr-xr-x. 1 root root 243792 Apr 20 11:27 style_transfer_sample

2. pedestrian-detection-adas-0002 for this model, do you download it manually?

3. can you try to run /root/inference_engine_samples_build/intel64/Release/classification_sample_async -i /opt/intel/openvino_2021/deployment_tools/demo/car.png -m /root/openvino_models/ir/public/squeezenet1.1/FP16/squeezenet1.1.xml -d HDDL
   to verify that your HDDL works.
   This is a simple demo model for test.

[adtrytech]

Hi @mcping,

After upgrading to the latest version, it can utilize the HDDL device.
Thank you !