Recently, Orbi Zhongguang, an industry-leading provider of 3D visual perception overall technology solutions, and Horizon Horizon, a global leader in edge artificial intelligence computing platforms, jointly launched a 3D vision application solution suitable for service robots and sweeping robots. Based on the full-stack technical capabilities of Orbi-China in the field of 3D vision and the Horizon Hobot Platform (Horizon Hobot Platform), the two parties have further deepened their cooperation. Through the high-performance binocular structured light camera Dabai Pro, The miniaturized 3D area array iToF module FC200 is connected to the Horizon Rising Sun X3, and customers can independently develop functions such as robot perception, obstacle avoidance, and navigation.
High-performance binocular structured light camera + miniaturized iToF module
Enabling Robot Core Vision Applications
The emergence of 3D visual perception technology conforms to the trend of robots advancing to high-dimensional intelligence. Traditional service robots follow a set path and cannot achieve obstacle avoidance and higher-level intelligent judgment. 3D visual perception technology can help robots accurately locate in complex environments, realize functions such as perception, obstacle avoidance, navigation, and three-dimensional map reconstruction, making them more intelligent.
Orbi Zhongguang is one of the few companies in the market that can provide 3D visual perception products with core independent intellectual property rights, and can provide customers with full-stack technologies from bottom-level chips, algorithms to upper-level solutions. Based on the cooperation between Orbi Zhongguang and Horizon, robot manufacturers can use the 3D cameras and modules provided by Orbi Zhongguang to be connected to the Horizon Rising Sun X3 to complete the development of various robot 3D vision applications.
Aiming at the service robot scene, Orbi Zhongguang launched Dabai Pro, a high-performance binocular structured light camera based on the self-developed ASIC chip, which empowers the robot to realize functions such as perception, obstacle avoidance, and navigation.
Dabai Pro depth image output resolution is 640*[email protected], with millimeter-level detection accuracy, working distance is 0.3m-3m, effective depth field of view is H 67.9°, V 45.3°, can provide complete depth and point cloud information. The average power consumption of Dabai Pro is less than 1.5W. It is equipped with a standard USB data interface. The depth quality in different environments is stable, safe and reliable. It has achieved mass production on different types of service robots.
In the process of adapting to the Horizon X3 Pie, Dabai Pro makes full use of the BPU of the X3 Pie, which greatly reduces the CPU load and further improves the efficiency of high frame rate and multi-camera applications. Coupled with the millisecond-level motion delay of Dabai Pro itself, in low-speed motion scenarios, it can not only improve the accuracy of perception, but also save more computing resources for customers and promote the application of multi-sensor fusion.
For the sweeping robot scene, in addition to developing high-performance binocular cameras, Orbi Zhongguang also independently developed and launched a small and low-cost 3D area array iToF sensor FC200 module, providing fully self-developed iToF sensor and depth algorithm for the development of sweeping robots 3D vision system solution including SDK.
The FC200 module’s depth image output resolution is 640*[email protected], with short-distance millimeter-level detection accuracy. At a working distance of 0.1m-6m, the effective field of view is as high as 110°, which is convenient for the sweeping robot to accurately complete navigation and obstacle avoidance Two core vision applications. The average power consumption of the module is less than 1W, and the overall heat generation is low, which is more suitable for embedded access of sweeping robots.
In the process of adapting the Horizon Rising Sun X3, the FC200 module creatively adopts the solution of unpacking ebd (MIPI extended information) by reading registers separately, and completes the acquisition of MIPI information without affecting the overall work efficiency. The FC200 module can obtain bright and moderate grayscale and depth images in a high-contrast environment, with high image integrity and good accuracy.
In order to obtain richer point cloud information and achieve high frame rate and low latency effects, Orbi Zhongguang cooperated with Horizon to tackle key problems, reducing CPU load while achieving high precision, and saving more computing resources for customers. Improve the overall product performance of the sweeping robot.
Full-stack 3D solution
Helping Robot Vision Evolution
Orbi Zhongguang, as an early company in the domestic robot industry, based on its own 3D visual perception full-stack technology research and development capabilities, has created a robot 3D vision solution including the underlying chip, laser radar, visual module and depth algorithm. At present, Obi Zhongguang has become a major domestic 3D vision sensor provider, creating 3D “wisdom eyes” for well-known domestic robot companies such as UBTECH, Purdue, Gaoxian, Qinglang, Yunji, and Orion Star.
Based on the full-field layout of mainstream 3D visual perception technologies such as structured light, iToF, binocular, dToF, Lidar, and industrial 3D measurement, Orbi Zhongguang has launched 3D vision-related product solutions for different application scenarios.
In terms of structured light, Orbi Zhongguang has mass-produced binocular structured light series products for robots as early as 2019. This series of products adopts Obi Zhongguang self-developed chips, which is the first choice for service robots in obstacle avoidance applications.
In terms of ToF, Orbi Zhongguang will launch the iToF intelligent vision platform in 2021 and launch the Femto series iToF cameras. At the same time, Orbi Zhongguang also cooperates with Microsoft to create a new generation of Kinect 3D vision sensor Femto Mega, which is aimed at the global market and is expected to be mass-produced and launched by the end of 2022.
Relying on the million-level mature mass production technology experience, the products provided by Orbi Zhongguang for robot customers have the dual advantages of high stability and low cost.
With the continuous transition from 2D vision to 3D vision, Orbi Zhongguang has built a 3D visual perception technology system of “full-stack technology research and development innovation capabilities + full-field technology route layout”, promotes the iteration of core underlying technologies, and continues to expand robots and smart cars , smart terminals, smart homes, digital twins and other application scenarios. In the future, Orbi Zhongguang will continue to join hands with many partners including Microsoft, Nvidia, and Horizon to jointly build a 3D vision development and application ecosystem and promote the upgrade of the smart industry to 3D vision.
Reviewing editor: Tang Zihong