Wearing Mr glasses, several people in different places can “see each other in the same space”, communicate in real time, work together, and even edit 3D materials in the space together. Space transmission sounds incredible, but this technology has been realized. It not only supports multiple people in different places, but also supports users of different MR and VR devices to work together. In the next generation 5g wireless network, the richer way of cooperation through AR may soon enter the mass market.

Spatial systems, a software developer for AR collaboration, nreal, a manufacturer of Mr glasses, and Qualcomm, a chip manufacturer, announced that they will establish partnerships with operators to accelerate the implementation of AR collaboration applications. Today, spatial, nreal and Qualcomm will work with LG uplus, KDDI and Deutsche Telekom AG to enhance ar collaboration with more participants and richer applications in highly complex 3D content and more diverse formats.

Spatial believes that the combination of its platform and nreal lightweight large field of view head display will be the first platform combination specially developed for 5g wireless standard launched for operators. Spatial is an AR application developer, mainly for multi person remote collaboration scenarios. With nreal light and smart phones equipped with the computing platforms of Qualcomm snapdragon 855 and 865, 5g network can be used to make people living in different places seem to work in the same space and realize smooth multi person real-time interaction.

Anand agarawala, co-founder and CEO of spatial, said: “consumers will be able to work together or interact anywhere as if they were sitting next to someone else. Spatial has been put into use, and many Fortune 1000 companies have actively explored it. A large part of this interest is driven by the ease of use of hardware, and as 5g networks and consumer grade head shows like nreal light become commonplace, it will drive the market faster. ” “This combination of hardware, chipsets and operators is a perfect storm for AR, just like the revolution in the mobile market driven by smartphones, high-speed mobile data and app stores in the early 2000s,” it added

In 2019, nreal launched its nreal light Mr glasses, which were quickly favored by the market with 88g light body, fashionable appearance and high cost performance of $499. In just a few months, it successfully gathered thousands of content developers. The device not only supports 6DOF positioning and tracking, but also can connect with smart phones equipped with high pass 855 and above 5g chips through usb-c cable, effectively reducing the use threshold. The developer suite is now available for $1199.

In addition, as one of the partners, Brian Vogelsang, senior director of product management of Qualcomm, also mentioned: “Qualcomm is committed to connecting and supporting the ecosystem, making XR the next mobile computing platform, and our cooperation with spatial is an example. As operators and XR supporters around the world deploy 5g on a large scale and enter the enterprise and consumer markets with partners (such as nreal and 5g smartphones using snapdragon platform), we will change telecommuting through holographic telepresence and virtual collaboration with spatial platform in 2020. “

People have always envied the portal props in Dora’s dream. Many researchers are also studying the related “transmission technology”, such as space-time distortion and wormhole creation by gravity to realize space movement. Obviously, this is still far away. Although physically impossible, real-time synchronization through virtual avatar has become possible, and the threshold of use is constantly decreasing.

In 2016, Microsoft Research Institute once showed black technology holoportion. Two people in different places in the video can see each other’s lifelike virtual avatars when wearing hololens. Whether they are moving in space, or displaying body movements and facial expressions, or even the communication and interaction between the two sides, they can be displayed in real time, Of course, when the two sides clap hands, although they can see the palms together, they don’t have any touch.

The effect is amazing, but the cost is not low. This system needs to capture human images from all angles by a series of 3D cameras for everyone who needs to transmit, then seamlessly splice them into 3D models, and then compress them for real-time transmission. Both hardware, algorithm and network have very high requirements, so it is still in the research stage. Spatial or can be understood as “low configuration version” space transmission, although the effect is not as good as holoportion, but the cost and use threshold are greatly reduced, becoming the form that enterprises can truly implement the application.

According to the official introduction, the character modeling in the application can be directly generated by scanning 2D images, which saves the high cost of modeling with 3D cameras and facilitates faster identification between participants. In order to make the action expression more natural, in the application, the character’s expression can be intelligently judged and generated by the sound( Upper body) body movement, through the MR glasses gesture recognition or handle capture.

Using spatial, people with different MR hardware can work together in the same space in different places, watch product demonstrations, mark 3D model space, and communicate face to face in real time. As most of the enterprise files are 2D, you can use the image wall function to view them in spatial, and the daily documents are also unfolded in tile form, which is intuitive and convenient. The application supports a variety of file formats, including pictures, videos, animations, 3D documents, etc.

Because the application involves multi-party cooperation, it needs real-time rendering of 3D virtual avatar to maintain the fidelity of voice, position, gesture and facial expression, and it also needs relatively low delay, otherwise the experience will become unstable and the lack of continuity may make communication difficult. This is why 5g with high bandwidth and low latency is essential for AR / VR collaboration.

In 2020, online office has become the main way of people’s work. Although online office is not uncommon, it has existed for many years. However, in this extraordinary period, when only online office is available, some disadvantages that are not noticed at ordinary times will be magnified infinitely, such as difficult communication, low efficiency, unclear information transmission… When most people focus on AR game entertainment, In fact, AR can be integrated into the work scene, become a powerful productivity tool, and change the way people work.

Porsche’s “techlivelook” brings MR to dealers. Through real-time interaction between dealer technicians and professional technicians, the service time is greatly reduced by up to 40%. Mercedes Benz uses 100 Mr glasses at its training center in Stuttgart for faster and more attractive training. France Airbus provides Mr application to Japan Airlines. After importing MR equipment into pilot program, the operation time of design engineering such as experiment in virtual space is reduced by 80%.

Ar collaborative work has been applied in many large and well-known enterprises. The “transmission” of people to the same space not only reduces the unnecessary trouble in the traditional voice and video communication, but also makes the remote cooperation more natural and efficient by space editing, infinite screen, multi-user cooperation and the embodiment of body expression. Overseas media gave a high evaluation of this kind of AR collaborative experience, and even thought it was very subversive.

With the continuous iteration of chip performance, graphics processing and optical technology, as well as the gradual improvement of the industrial chain, the threshold of AR glasses is gradually reduced. With the exploration of developers and enterprises in the application end, although ar glasses have not entered the daily entertainment life of the public, they have experienced a rapid transition from the initial stage of trial to the large-scale application stage in the enterprise end.


Leave a Reply

Your email address will not be published.