Facebook's recent actions in the AR field once caused widespread concern in the AR and VR industries. It is said that Facebook has obtained a new patent in the work of AR and VR. A few days ago, the United States Patent and Trademark Office published an AR patent continuation application from Facebook, which mainly describes a method to reduce rainbow artifacts in waveguide displays. Specifically, this is a multilayer grating structure used to reduce rainbow artifacts.
1. Facebook's AR patent is proposed to achieve the effect of reducing rainbow artifacts
In fact, most technology manufacturers are eager to develop AR glasses with a shape similar to sunglasses. It is quite simple to achieve this level, but it will be accompanied by the problem of stray light. As we all know, the more open the AR glasses are, the more rays of light from redundant directions and light sources can enter the system. Although AR displays can usually cope well with ambient light from the front, light from the side or behind the user can cause serious problems. Conventional glasses usually do not reflect too much light, so it is not a big problem. But AR displays must reflect and bend light, so they are more susceptible to stray light. Diffractive waveguides are particularly affected by it, and light from the side will appear on the display in the form of rainbow artifacts. Although the performance of reflective waveguides is better, there are also problems in this regard.
The main purpose of the Facebook patent is to solve the problem of stray light. As an example, a multilayer grating can be coupled to the waveguide. The waveguide includes a waveguide body, an in-coupling grating, and a multilayer grating. When light propagates in the waveguide, the waveguide expands the received image light in at least one dimension. The input grating is configured to couple image lights into the waveguide. The multi-layer grating is configured to output the first part of the expanded image light to the window, and the ambient light incident on the first pattern layer and the second pattern layer of the multi-layer grating generates the first diffracted light and the second diffracted light, respectively. The first diffracted light and the second diffracted light partially interfere with each other destructively based on the inverted refractive index profile, thereby playing a role in reducing rainbow artifacts.
Earlier, Cook publicly discussed that AR (augmented reality) will be a very important technology in the next ten years, and Apple will invest more in this field. AR-related patent applications will also continue to rise, allowing people to use AR functions anytime and anywhere. Apple, Facebook, and other giants focus on the layout to promote the acceleration of the AR ecosystem. According to IDC, the sales of AR glasses and headsets this year will be close to 1 million, and will increase to 23.4 million by 2025. Enterprises will be the main users, accounting for 85% of the total purchasing power.
2. Overseas giants continue to deploy AR ecosystem, and manufacturers step up to enter this field
Facebook CEO Zuckerberg also said in an interview that AR is the man-machine interface of the next generation of the Internet. At present, many high-tech companies are betting on AR glasses. Microsoft uses Hololens as an entry point to polish MR products for business and the ecosystem. Google continues to improve consumer AR products and the ecosystem. Facebook plans to continue to enrich the Oculus ecosystem. The companies focus on technology layout and launch products one after another.
Facebook plans to continue to enrich the Oculus ecosystem. In recent years, Facebook has acquired machine vision company Scape, VR game developer Sanzaru, AR map data company Mapillary, VR zoom headset technology manufacturer Lemnis, etc. At the same time, it has also developed a new VR/AR operating system to get rid of its dependence on Google Android. Besides, it launched Quest 2, which is expected to sell more than 7 million units in 2021, and it cooperated with Ray-Ban to produce AR glasses, which are expected to be available in 2021.
Apple continues to lay out in the AR industry chain and will release products soon. The lens of the AR device has been trial-produced at the Foxconn factory, and it is expected to release head-mounted display products in the second half of 2022 and glasses products in 2023. Apple acquired Next VR, deployed the content field, and released ARKit4. Moreover, its LiDAR Depth API applied for an adjustable lens AR waveguide display system and dozens of VR and AR patents. Google continues to improve consumer AR products and the ecosystem. Google AR glasses Glass 2 is open for purchase, priced at $999. At the same time, it officially launched the ARCore Depth API and acquired the Canadian AR glasses company North for $180 million. Besides, Google search adds AR function to support MR video recording of 3D animals.
Tencent focuses on content and the cloud ecosystem. Tencent Games and a company established a joint innovation laboratory to explore cutting-edge technologies such as VR/AR. It cooperates with Nvidia to fully provide Cloud XR on Tencent Marketplace and invests in VR content companies. WIMI focuses on holographic cloud services, mainly in vehicle-mounted AR holographic HUD, 3D holographic pulse LiDAR, head-mounted light field holographic equipment, holographic semiconductor, holographic cloud software, holographic car navigation, and other professional fields, covering multiple links of AR technology, including holographic vehicle-mounted AR technology, 3D holographic pulse LiDAR technology, holographic vision semiconductor technology, holographic software development, holographic AR advertising technology, holographic AR entertainment technology, holographic ARSDK payment, interactive holographic communication, and so on. It is a holographic cloud comprehensive technical solution provider.
The current AR industry value chain consists of three main parts. The key hardware, software, services, providers, and participants related to content production are the upstream part. The midstream part is a provider of holographic AR solutions, integrating upstream hardware and software systems to form final products or solutions, such as holographic AR advertising platforms and head-mounted displays. The downstream part refers to end-users, including governments, enterprises, and individual consumers. The business model of the upstream part of the holographic AR market is different. While hardware, software, and service providers focus on R&D to further improve their core technologies and reduce production costs, holographic AR device integrators and content creators must also identify target users, build brand reputation, and enhance user experience.
3. WIMI accelerates the development of AR devices, focusing on the holographic cross-field consumer market
WIMI is a high-quality holographic AR equipment integrator with strong internal R&D capabilities and can play an active role in the upstream and midstream markets. It takes care of participating in the upstream part, including the development of software, the provision of content production technology, and the creation and distribution of content. As for the midstream part, it provides a comprehensive holographic AR solution provider. WIMI has the leading AR holographic application platform and a comprehensive holographic IP rights content library. The format of virtual holographic content covers from 3D models to holographic virtual products. In addition, it has a total of nearly 5,000 holographic virtual IP rights content, which can be used for WIMI and even industry-wide holographic AR products and solutions.
It covers a wide range of categories, including holographic animation, virtual live broadcast, virtual idol, and virtual social. Among them, 2,961 holographic IPs are used for virtual education, 851 holographic IPs are used for virtual tourism, 739 holographic IPs are used for virtual art and entertainment, and 103 holographic IPs are used for virtual science. It can be said that currently in the entertainment, advertising, education, medical, automotive, and other industries, the hardware is relatively mature, and the development of software and content in these fields has a unique advantage.
WIMI announced that it has obtained a patent for a holographic AR head-mounted display, and a 3D holographic pulse laser radar product "WiMi HoloPulse LiDAR". The holographic AR head-mounted display adopts retinal scanning display (RSD) and semi-permeable film array slab waveguide technology. The head-mounted display optical system is used to digitize the output of the holographic AR image source and holographically image it in the user's field of vision, and to realize the simulation technology that reproduces the specific environment. This can be used for telemedicine, industrial construction, environmental simulation, traffic instructions, virtual education, holographic communication, 3D printing, etc.
Due to the explosion of demand for holographic applications in automobiles, WIMI has developed a 3D holographic pulse laser radar product "WiMi HoloPulse LiDAR" to meet consumer demand. Lidar is equivalent to the "eyes" of the high-tech, with a large detection field, long detection range, unique scanning mode, small size, and lightweight. It also comes with a point cloud interface, and no additional connection adapter box is required during operation. Industrial applications such as intelligent robots, unmanned driving, unmanned aerial vehicles, medical imaging, and the Internet of Things can be realized, and the lidar market will grow substantially.
WIMI is a key software that takes into account both the upstream and midstream parts, as well as content production. WIMI also integrates upstream hardware and software systems to form the final product or solution. Moreover, it further proposes to improve the requirements for automotive AR holographic HUD, holographic AR navigation, holographic AR window, holographic AR rearview mirror, and holographic AR vehicle communication in terms of car networking. Besides, it will also develop holographic vehicle equipment, holographic vehicle chips, and holographic vehicle software to form an integrated solution of in-vehicle holographic software and hardware, which is suitable for holographic AR patents and products in the automotive industry.
At present, VR and AR will unlock more business scenarios after the arrival of 5G. The VR and AR industries have entered a stage of accelerated growth and gradually entered the stage of industrialization. On the one hand, the volume of VR shipments has accelerated significantly; on the other hand, the application ecosystem is gradually improving. The two complement each other and promote the industry to enter a positive cycle. More application scenarios will emerge in the future, driving the VR and AR industry chain to usher in explosive growth. With the development of cloud VR and AR technologies, lightweight head-mounted display devices and AR glasses are expected to be rapidly developed and popularized. The mobility demand for VR and AR technologies will increase immediately, and the demand for 5G technology will continue to increase. We look forward to the early popularization of more new products.
Tailor Insight (www.TailorInsight.com) provides easy and quick solutions that allow customers to capture, monitor, and audit market data from a holistic view down to an individual task on market research and industry trend insights.