Raspberry Pi 5 + Hailo AI - (3)

Two of my previous blogs have been talking about Hailo, respectively:

• Raspberry Pi 5 + Hailo AI - (1)
• Raspberry Pi 5 + Hailo AI - (2)

Since I’m now back to Vancouver for Christmas, let me write my 3rd blog about Hailo today.

0. Hailo 4.23.0 Released

Good news !!! Hailo 4.23.0 has been released, and it supports Raspberry Pi 5 with native Python 3.11 installation, which is incredibly convenient. The only thing to remember: make sure to install DKMS by sudo apt install dkms.

1. Raspberry Pi 5 Enviroment

1.1 neofetch

1.2 Package Installation

Please visit Hailo Software Downloads to download and install the following three MUST software packages:

1.2.1 HailoRT – Ubuntu package (deb) for arm64 hailort_4.23.0_arm64.deb

➜  ~ dpkg -L hailort  
/.
/etc
/etc/default
/etc/default/hailort_service
/lib
/lib/systemd
/lib/systemd/system
/lib/systemd/system/hailort.service
/usr
/usr/bin
/usr/bin/hailortcli
/usr/include
/usr/include/gstreamer-1.0
/usr/include/gstreamer-1.0/gst
/usr/include/gstreamer-1.0/gst/hailo
/usr/include/gstreamer-1.0/gst/hailo/include
/usr/include/gstreamer-1.0/gst/hailo/include/hailo_gst.h
/usr/include/gstreamer-1.0/gst/hailo/tensor_meta.hpp
/usr/include/hailo
/usr/include/hailo/buffer.hpp
/usr/include/hailo/device.hpp
/usr/include/hailo/dma_mapped_buffer.hpp
/usr/include/hailo/event.hpp
/usr/include/hailo/expected.hpp
/usr/include/hailo/genai
/usr/include/hailo/genai/common.hpp
/usr/include/hailo/genai/llm
/usr/include/hailo/genai/llm/llm.hpp
/usr/include/hailo/genai/text2image
/usr/include/hailo/genai/text2image/text2image.hpp
/usr/include/hailo/genai/vdevice_genai.hpp
/usr/include/hailo/hailo_gst_tensor_metadata.hpp
/usr/include/hailo/hailo_session.hpp
/usr/include/hailo/hailort.h
/usr/include/hailo/hailort.hpp
/usr/include/hailo/hailort_common.hpp
/usr/include/hailo/hailort_defaults.hpp
/usr/include/hailo/hailort_dma-heap.h
/usr/include/hailo/hef.hpp
/usr/include/hailo/infer_model.hpp
/usr/include/hailo/inference_pipeline.hpp
/usr/include/hailo/network_group.hpp
/usr/include/hailo/network_rate_calculator.hpp
/usr/include/hailo/platform.h
/usr/include/hailo/quantization.hpp
/usr/include/hailo/runtime_statistics.hpp
/usr/include/hailo/stream.hpp
/usr/include/hailo/transform.hpp
/usr/include/hailo/vdevice.hpp
/usr/include/hailo/vstream.hpp
/usr/lib
/usr/lib/aarch64-linux-gnu
/usr/lib/aarch64-linux-gnu/gstreamer-1.0
/usr/lib/aarch64-linux-gnu/gstreamer-1.0/libgsthailo.so
/usr/lib/cmake
/usr/lib/cmake/HailoRT
/usr/lib/cmake/HailoRT/HailoRTConfig.cmake
/usr/lib/cmake/HailoRT/HailoRTConfigVersion.cmake
/usr/lib/cmake/HailoRT/HailoRTTargets-release.cmake
/usr/lib/cmake/HailoRT/HailoRTTargets.cmake
/usr/lib/libhailort.so.4.23.0
/usr/local
/usr/local/bin
/usr/local/bin/hailort_service
/usr/share
/usr/share/doc
/usr/share/doc/hailort
/usr/share/doc/hailort/copyright
➜  ~ 

1.2.2 HailoRT – PCIe driver Ubuntu package (deb) hailort-pcie-driver_4.23.0_all.deb

➜  ~ dpkg -L hailort-pcie-driver
/.
/lib
/lib/firmware
/lib/firmware/hailo
/lib/firmware/hailo/hailo8_fw.4.23.0.bin
/lib/udev
/lib/udev/rules.d
/lib/udev/rules.d/51-hailo-udev.rules
/share
/share/opt
/share/opt/hailo
/share/opt/hailo/common
/share/opt/hailo/common/fw_operation.c
/share/opt/hailo/common/fw_operation.h
/share/opt/hailo/common/fw_validation.c
/share/opt/hailo/common/fw_validation.h
/share/opt/hailo/common/hailo_ioctl_common.h
/share/opt/hailo/common/hailo_resource.c
/share/opt/hailo/common/hailo_resource.h
/share/opt/hailo/common/pcie_common.c
/share/opt/hailo/common/pcie_common.h
/share/opt/hailo/common/soc_structs.h
/share/opt/hailo/common/utils.h
/share/opt/hailo/common/vdma_common.c
/share/opt/hailo/common/vdma_common.h
/share/opt/hailo/linux
/share/opt/hailo/linux/pcie
/share/opt/hailo/linux/pcie/51-hailo-udev.rules
/share/opt/hailo/linux/pcie/Kbuild
/share/opt/hailo/linux/pcie/Makefile
/share/opt/hailo/linux/pcie/Readme.md
/share/opt/hailo/linux/pcie/dkms.conf.in
/share/opt/hailo/linux/pcie/dkms_uninstall.sh
/share/opt/hailo/linux/pcie/hailo_pci.conf
/share/opt/hailo/linux/pcie/src
/share/opt/hailo/linux/pcie/src/fops.c
/share/opt/hailo/linux/pcie/src/fops.h
/share/opt/hailo/linux/pcie/src/nnc.c
/share/opt/hailo/linux/pcie/src/nnc.h
/share/opt/hailo/linux/pcie/src/pcie.c
/share/opt/hailo/linux/pcie/src/pcie.h
/share/opt/hailo/linux/pcie/src/soc.c
/share/opt/hailo/linux/pcie/src/soc.h
/share/opt/hailo/linux/pcie/src/sysfs.c
/share/opt/hailo/linux/pcie/src/sysfs.h
/share/opt/hailo/linux/pcie/tools
/share/opt/hailo/linux/pcie/tools/hailo_load.sh
/share/opt/hailo/linux/pcie/tools/hailo_pci_driver_dkms_remove.sh
/share/opt/hailo/linux/pcie/tools/hailo_unload.sh
/share/opt/hailo/linux/utils
/share/opt/hailo/linux/utils/compact.h
/share/opt/hailo/linux/utils/fw_common.h
/share/opt/hailo/linux/utils/integrated_nnc_utils.c
/share/opt/hailo/linux/utils/integrated_nnc_utils.h
/share/opt/hailo/linux/utils/logs.c
/share/opt/hailo/linux/utils/logs.h
/share/opt/hailo/linux/vdma
/share/opt/hailo/linux/vdma/ioctl.c
/share/opt/hailo/linux/vdma/ioctl.h
/share/opt/hailo/linux/vdma/memory.c
/share/opt/hailo/linux/vdma/memory.h
/share/opt/hailo/linux/vdma/vdma.c
/share/opt/hailo/linux/vdma/vdma.h
/usr
/usr/share
/usr/share/doc
/usr/share/doc/hailort
/usr/share/doc/hailort/hailo_firmware_eula
➜  ~ 

1.2.3 HailoRT – Python package (whl) for Python 3.11, aarch64 hailort-4.23.0-cp311-cp311-linux_aarch64.whl

1.2.4 TAPPAS Python Binding (Optional)

➜  ~ pip list | rg hailo
hailo_model_zoo                    5.0.0
hailort                            4.23.0
➜  ~ 

Finally, let’s test if Hailo is correctly configured on our Raspberry Pi 5.

2 Models

2.1 Prepare HAILO8L Models

2.2 hailortcli run *.hefs

3. Demonstration

3.1 On My Cellphone

Live Stream - Deep Night Beautiful Vancouver	Live Stream - Beautiful Dublin	Live Stream - Bears In Katmai Nation Park, Alaska

3.1 From My Desktop