As an artificial intelligence media, the brain pole body also often pays attention to various cutting-edge technologies such as quantum computing, brain-like chips, and the metaverse. Many people have asked me: What is the use of AI media’s attention to these? Is it bad to focus on researching algorithms, models, etc.?

In fact, the reason is very simple. We hope to see how a series of mysteries such as industry, scientific research, and consumer market work behind the concrete technology. Only then can the full potential of a technology be seen and hidden levels unlocked.

Speaking of this, it is because mobile phone photography, which we cannot do without every day, has become the flagship "fighting arena" of high-end mobile phone brands, and it is the fastest-changing field in the mobile phone technology system. The new technologies, new experiences, and new changes brought about by each iteration have many intriguing points behind them.

73eb71da468e47c7ad24c29d0362aab4~tplv-tt-shrink:640:0.image
The source of this article is the polar body of the brain

On November 25, OPPO Reno7 series new products were officially released. Among them, two pieces of information are particularly worthy of attention: First, the world's first IMX709 super-sensitive cat-eye lens jointly developed by OPPO and Sony will bring all-round improvements in portrait video and image experience; second, the bottom-packaged OPPO self-developed The image processing unit is permanently exclusive to OPPO.

Cooperative development, in-depth tuning, and software and hardware collaboration are the directions that leading mobile phone manufacturers have been making in recent years, and OPPO is not an isolated case. But the permanent exclusive self-research strength is really rare.

What are the challenges and values ​​of the mobile photography track where the heroes are competing? What kind of accumulation and thin hair has OPPO experienced after successfully capturing industrial opportunities and occupying a unique position? At the time of the release of the OPPO Reno7 series, it is very suitable to look back at the hidden context behind the portrait photography technology.

Why Is Upgrading Portrait Photography Important?

The most famous cat in the tech world is probably Schrödinger's cat. The appearance of this cat overturned the three axioms "superposition of states", "uncertainty" and "observer" that were considered unchallengable by physicist Bohr. On the portrait video track, the appearance of the IMX709 super-sensitive cat-eye lens is also to solve three major challenges:

1. Photosensitive is difficult.To shoot clear images in low light conditions, it is necessary to increase the amount of light entering the camera, but limited by the space and weight of the fuselage, it is impossible to blindly increase the size of the photosensitive components. At this time, many manufacturers will choose to combine software algorithms to make up for it, which will increase the power consumption of mobile phones. Compared with flat photography, video has a higher level of calculation and higher real-time performance, and it also makes it more difficult to coordinate photosensitive software and hardware.

2. Naturalness.The information density of videos is higher, the interaction is stronger, and the emotions of characters can be more vividly presented. In order to be more realistic and personalized, it is also necessary to add real-time beautification and atmospheric modification, which relies on more powerful computing power, algorithm capabilities, and understanding of aesthetics. A single optimization cannot fully meet the shooting needs of portrait videos.

3. The threshold is high.Today, ordinary people can easily shoot professional-level flat portraits, but shooting, editing, and processing video is still quite difficult. How to lower the threshold for users to shoot videos and embrace image creation more easily is a proposition for many mobile phone manufacturers.

The "cat's eye" photography on the first launch of the OPPO Reno7 series is aimed at these unsolved challenges.

OPPO Reno7's Portrait Butterfly Trilogy

As mentioned before, the portrait video track is a competition of comprehensive strength. This time, the Reno7 series has also leveraged the multiple advantages of OPPO to complete the qualitative change in portrait video capabilities:

The first step, the soft and hard synergy, greatly improves the photosensitive ability.

The IMX709 "cat-eye lens" officially commercialized on Reno7 uses OPPO's self-developed RGBW image processing unit at the bottom layer, which solves the problem of balance between power consumption and computing power. The photosensitive ability is increased by 60% and the noise is reduced by 35%.

44ae8b116e2549e39dd1a0433504d21d~tplv-tt-shrink:640:0.image

Specifically, OPPO starts from the bottom layer of the sensor and combines the self-developed four-in-one pixel aggregation algorithm with the RGBW pixel arrangement paradigm to enhance the light-capturing ability, greatly improve the performance of low-light shooting, and at the same time make the super-sensitive cat-eye lens have the main camera, wide-angle lens , Black and white three shooting capabilities, with one for three. At the same time, IMX709 is compatible with different SoC platforms and third-party apps, with stronger compatibility, which can effectively reduce power consumption while improving video quality.

The algorithm is written into the sensor hardware for the first time, achieving a balance between image quality and mobile phone power consumption.

The second step is aesthetic blessing, presenting the most beautiful portraits of masters.

The breakthrough in hardware capabilities is just the beginning. With the help of master-level portrait tuning, the OPPO Reno7 series integrates excellent aesthetics into the algorithm to present a more natural beauty of portraits.

With the help of AI capabilities, different algorithms can be adjusted in different scenarios. For example, the moonlight night scene algorithm is automatically invoked in dark light to optimize brightness, color and purity to make the video picture brighter and purer; in a backlight environment, the Live HDR algorithm is automatically invoked to keep the background and subject clear, allowing Portrait details are more prominent, showing a blockbuster effect.

In terms of video beauty and video beauty, 3 new Reno7 exclusive makeup looks have been added, with a total of 14 AI beauty makeup, helping users to easily achieve freedom on the mirror; AI radiant beauty 2.0, supports 6 levels of 100-level beauty adjustment, can Intelligent identification of facial features and physiological flaws makes selfie videos natural and textured.

Through AI self-learning, hair-level portrait matting can be achieved, and AI natural depth-of-field effect can be constructed. The background light source reconstruction technology makes the light spot more layered, making the portrait more atmospheric in the video, and creating an "atmospheric beauty". Add emotional filters to increase the layering of the background light source and enhance the atmosphere; multiple scenes are recorded simultaneously, the front supports basic portrait beauty, and the rear supports zoom to enhance the sense of presence…

Based on OPPO's years of aesthetic understanding and technical application of portrait photography, the sensory ceiling of portrait video has been continuously improved.

The third step is to lower the threshold and release the value of video creation.

To balance the difficulty of shooting portrait videos with the simplicity of the user experience, OPPO Reno7 chose to use richer AI videos as the answer.

For example, the newly upgraded Soloop Instant Recording App has opened up the system album, and can intelligently select the video materials in the album, and through the built-in 23 smart templates, one-click output into a film, realizing instant shooting and sharing.

With 21 stylized music templates and 44 "one sentence into a movie" templates, the threshold for video editing is further lowered, allowing ordinary people to easily record their lives and make blockbusters.

What is the specific effect? Let's experience it with three high-frequency scenes:

When you want to record your life easily, keep the beautiful moments of celebrating birthdays with family and friends and blowing out candles:

The front super-sensitive cat-eye lens of the OPPO Reno7 series makes the portraits in low light environments clearer and more textured, so that the precious "little luck" in life in the post-epidemic era can be preserved.

5dd50b0412354337aa2fddeef70f0be1~tplv-tt-shrink:640:0.image

When you are eager to become a personal blogger, start a second career or share your life, whether it is in-store video or outdoor camping, the ultra-high latitude of the OPPO Reno7 series allows portraits and backgrounds to be clearly presented under harsh conditions such as backlighting.

e9cb4ca9dfb740e79db292d4ac53637f~tplv-tt-shrink:640:0.image

If you are a handicapped party who is complained by your lover every time you take a photo, then the OPPO Reno7 series equipped with SLR-level portrait background blur function may end your title of "portrait killer" and let the other party always be the most beautiful protagonist under your lens.

6c815017e1ef42f8b585e18ed0eb1811~tplv-tt-shrink:640:0.image

It can be seen that the front super-sensitive cat-eye lens of the OPPO Reno7 series brings not only a certain technology or hardware innovation, but a multi-dimensional upgrade of software and hardware, aesthetics, and user experience.

Strongest Spear and Strongest Shield

From Reno5's first concept of portrait video, to Reno7's perfect balance of portrait and video dimensions, OPPO's self-developed technology has made the original intention of the Reno series "easy to shoot the most beautiful portraits" with both technology and market persuasion.

If portrait video is a mobile phone manufacturer's "high card", then OPPO undoubtedly has many cards to play. Behind every iteration, the triple support force can be seen.

First, the determination to deepen the RGBW imaging technology route.

The self-developed image processing unit is encapsulated in the IMX709 sensor logic layer, allowing OPPO to enjoy permanent exclusive rights to the IMX709, opening a differentiated competitive position. The first in-depth cooperation in the industry stems from OPPO's persistence and investment in the innovative direction of RGBW imaging technology.

2bfda2eba1bb423cb2dc9d3022a8e6a4~tplv-tt-shrink:640:0.image

OPPO R7 Plus is the first to carry RGBW sensor

On the R7 Plus, which was launched in 2015, OPPO took the lead in commercializing Sony's RGBW sensor, the IMX278, to improve the imaging performance of mobile phones in low-light environments. At that time, limited by technical conditions, process technology, etc., RGBW failed to become the mainstream technology of mobile phone imaging. OPPO insists on accumulating on this technical route.

OPPO found that writing the self-developed four-in-one pixel aggregation algorithm into the sensor hardware and using the sensor's own computing power to preprocess the image data can reduce power consumption and heating problems.

However, the technical route of "hardening" this algorithm is not easy: the algorithm cannot be modified after being written to the hardware, and part of the performance will also be lost. This requires the algorithm model to be powerful enough and to be perfectly integrated with the hardware, so as to maximize its performance. The value of RGBW sensors.

Finally, through the "horse racing mechanism" multiple rounds of PK, the best among the best were selected. In December 2019, the algorithm developed by OPPO's internal team was determined as the optimal RGBW algorithm solution, and the productization process of RGBW technology with Sony began. The IMX709 super-sensitive cat-eye lens on the OPPO Reno7 adopts the industry's most advanced 22nm process technology, which saves 30% of power consumption under the same performance.

The long-term adherence to the technical direction has led to the breakthrough of finally completing the challenge of "hardening" the algorithm.

Second, it is a strategic choice for the long-term layout of portrait photography.

Technical dividends have become an essential element in the high-end mobile phone market. New products such as the iPhone 13 released this year have begun to emphasize the functions and applications of combining portrait and video, and OPPO has used portrait photography as a long track for product development. This strategic choice can be traced back to 2012.

As early as 2012, OPPO released the Ulike U701, the world's first smartphone with a "beauty camera" function, which can intelligently recognize faces, modify skin, and beautify facial features. The Reno series, which truly represents the evolutionary path of OPPO portrait photography, continues to integrate and iterate technology, aesthetics, and experience, and promote continuous innovation in the field of portrait video.

On the Reno3, OPPO launched the video stabilization algorithm for the first time, while the Reno4 Pro is equipped with a custom Sony IMX708 sensor and a self-developed moonlight night scene video algorithm. Since the Reno5 series, the industry has officially ushered in the first mobile phone with portrait video as its core selling point. OPPO has created a portrait video track with innovative features such as video beautification, AI video enhancement, and video super image stabilization 3.0.

91a96bee3f7c4ef5b8a3142ed3eabeea~tplv-tt-shrink:640:0.image

Since then, OPPO has continued to deepen the competitive barriers of portrait videos. In order to increase the "sense of atmosphere" of beauty, Reno6 introduces a triple AI model to enhance the beauty of portrait videos in an all-round way. Ordinary users can easily shoot portrait video clips with a sense of movie atmosphere. Today, the Reno7 series has once again improved portrait video to an unprecedented level of texture and portability through the underlying self-developed algorithm.

Today, mobile phone images have also become the primary demand point in the public's mobile life, and OPPO's long-term strategy for the portrait photography track has not missed this window of opportunity, forming a unique product advantage.

The third is the insight and emphasis on user experience.

Is it necessary to rush down the hard bone of algorithm "hardening" now? Where does the basis and confidence of OPPO's insistence on portrait photography come from?

Further, OPPO's strategic vision and the urgency of the underlying self-developed technology may all stem from the same source: insight and emphasis on user experience.

It is extremely difficult to predict the future development of mobile phone imaging capabilities and create a perfect imaging system. But if you think from the user's center, everything becomes very simple.

What is certain is that with the official commercial use of 5G, China's mobile Internet users have exceeded 1 billion, and two obvious needs have emerged: First, the image representation has been continuously enriched. Live streaming, short videos, vlogs and other video content can carry more diverse and three-dimensional information, and become the mainstream media form for the consumption of digital content by the whole people. Second, the production threshold for video shooting has been continuously lowered. In daily life, the frequency that mobile phones are used to shoot videos has also increased rapidly. According to OPPO's user research report, the proportion of OPPO mobile phone users who turn on the system camera and directly switch to the video recording interface has increased rapidly. From the countryside to the city, from children to the elderly, the whole society has entered the era of personalized video.

For mobile phone manufacturers, imaging technology can be implemented in countless ways, but for users, there is only one purpose, and that is to become a recorder and creator of the beauty of life. How to help users achieve self-realization may be the most correct way, no one.

The OPPO Reno series that "takes the most beautiful portraits easily", the exploration of portrait photography in the past two years has also explored a way forward for the entire industry to some extent, opening up new opportunities.

In the smartphone market, users are eager for differentiated innovation, manufacturers are looking for new spaces, and observers are looking forward to seeing imaginative technical directions and possibilities.

Technology is the strongest spear, allowing enterprises to constantly break through limitations; technology is also the strongest shield, forming a barrier to defend the city. OPPO uses the strongest spear and the strongest shield to iterate the capabilities of the IMX709 super-sensitive cat-eye lens, which also makes the familiar function point of photography, which is emerging with new kinetic energy and changes.

Going back to the question at the beginning, why the technology behind Reno7 deserves to be seen and paid attention to, perhaps because the seemingly simple functions actually hide a bigger world: when we look at every photo or every frame of video , The power of technology is also gaining momentum, waiting for another widening of the world.

Leave a Reply

Your email address will not be published. Required fields are marked *