Apple Glass can provide night vision
In September of this year, the newest iPhone 12 was launched. Similarly to the 2020 iPad Pro, a LiDAR sensor was included in the camera grid for the Pro versions. This time, however, it found a very practical application. It is a tool that improves the ability to take pictures in difficult weather conditions. More specifically, it helps with auto-focus. The latest patent from the Cupertino company shows that it can do much more in the future. Used in AR glasses (Apple Glass) can allow us to see in the dark.
A patent entitled “Head-Mounted Display With Low Light Operation” describes the use of the new sensor in combination with AR glasses such as the highly anticipated Apple Glass. Thanks to this synergy it will be possible to expand the capabilities of our eyesight. The work of the human eye varies depending on the lighting conditions. Photopic vision, taking place in good lighting conditions, provides much better-quality information than mesopic or scotopic vision, which, in poor lighting conditions, loses some data.
Ordinary cameras capture the image in the visible light area just like our eyes. LiDAR is based on infrared light, which is both emitted and registered by the sensor. Thanks to this, it allows for depth detection, and thus the geometry of the surrounding space, even in complete darkness.
What’s more, Apple is not limiting its solution to the LiDAR only, leaving a door for use of other sensors, such as structure light sensor, time-of-flight, or radar. However, the example given in the document is based on a LiDAR in particular.
The authors of the patent are Trevor J. Ness and Fletcher R. Rothkopf, who have previously worked on technologies in the field of AR dealing with face mapping or solving the problem of motion sickness.
In addition, Apple also deals with issues related to the presentation of AR content when the user moves his head and eyes. The patent “Image Enhancement Devices With Gaze Tracking” proposes to combine the user’s vision parameters with information about the environment. For example, in mixed reality, people with poorer eyesight may be able to enlarge a fragment of an image.
The patents presented above, along with many previous studies, show that Apple takes the issues related to augmented and mixed reality very seriously. By solving subsequent problems, they try to develop an optimal experience for the user. Let’s hope that the final effect of their work in the form of Apple Glass will be seen soon.
