Collaborative Computing: Networking, Applications and Worksharing. 14th EAI International Conference, CollaborateCom 2018, Shanghai, China, December 1-3, 2018, Proceedings

Research Article

A Hardware/Software Co-design Approach for Real-Time Binocular Stereo Vision Based on ZYNQ (Short Paper)

Download
223 downloads
  • @INPROCEEDINGS{10.1007/978-3-030-12981-1_50,
        author={Yukun Pan and Minghua Zhu and Jufeng Luo and Yunzhou Qiu},
        title={A Hardware/Software Co-design Approach for Real-Time Binocular Stereo Vision Based on ZYNQ (Short Paper)},
        proceedings={Collaborative Computing: Networking, Applications and Worksharing. 14th EAI International Conference, CollaborateCom 2018, Shanghai, China, December 1-3, 2018, Proceedings},
        proceedings_a={COLLABORATECOM},
        year={2019},
        month={2},
        keywords={Binocular stereo vision system Hardware/software co-design Data interaction Processing system Programmable logic},
        doi={10.1007/978-3-030-12981-1_50}
    }
    
  • Yukun Pan
    Minghua Zhu
    Jufeng Luo
    Yunzhou Qiu
    Year: 2019
    A Hardware/Software Co-design Approach for Real-Time Binocular Stereo Vision Based on ZYNQ (Short Paper)
    COLLABORATECOM
    Springer
    DOI: 10.1007/978-3-030-12981-1_50
Yukun Pan1, Minghua Zhu1,*, Jufeng Luo2, Yunzhou Qiu2
  • 1: East China Normal University
  • 2: Shanghai Internet of Things CO., LTD
*Contact email: mhzhu@sei.ecnu.edu.cn

Abstract

Based on the ZYNQ platform, this paper proposes a hardware/software co-design approach, and implements a binocular stereo vision system with high real-time performance and good human-computer interaction, which can be used to assist advanced driver assistance systems to improve driving safety. Combining the application characteristics of binocular stereo vision, the approach firstly modularizes the system’s functions to perform hardware/software partitioning, accelerates the data processing on FPGA, and performs the data control on ARM cores; then uses the ARM instruction set to configure the registers within FPGA to design relevant interfaces to complete the data interaction between hardware and software; finally, combines the implementation of specific algorithms and logical control to complete the binocular stereo vision system. The test results show that the frame rate with an image resolution of 640 * 480 can reach 121.43 frames per second when the FPGA frequency is 100M, and the frame rate is also high for large resolution images. At the same time, the system can achieve real-time display and human-computer interaction with the control of the graphical user interface.