It has been reported that apple is developing VR or ar head display for some time. Various reports and patent applications indicate that it may have many research and development directions. In a pair of patents granted to Apple by the U.S. patent and Trademark Office on Tuesday, Apple’s ar head display or future iPhones can use display light to track the movement of almost any surface, and finger devices may provide the system with details of objects that users may touch. One of the advantages of the AR head display is that the camera is added to the settings. The same hardware can be used to perform object tracking and view the real-time position changes of objects relative to the head display position. However, the resources needed for object recognition and object tracking are very heavy burden for the system, so apple can solve this problem in these two new patents. < / P > < p > in the patent for the AV / VR Controller & quot; with an event camera, apple proposes the idea that the camera system does not necessarily need to track all the pixels associated with the tracked object at all times, but only needs a rough inspection to trace the pixels, so as to reduce the number of tracking to a minimum. Apple proposed that the system would select specific pixels in the image associated with the object being tracked to provide readings of light intensity and other attributes. When the camera or object moves or changes its position, the light intensity change of these pixels will exceed the set limit, thus triggering the whole system to start using more resources to search for changes in objects. In addition, the system can simply search for the same light spot instead of trying to detect the object. If there are multiple light points on an object, and the system only tracks these light points, then it can use very few resources to determine the change of position and direction. < / P > < p > while these dots can easily be reflections of ambient lighting on an object’s shell, Apple seems to be considering the possibility of using light sources generated by other objects, such as LED lights or graphic displays. If it is the latter, as long as the screen is visible, it can provide sufficient positioning and direction data for the system. This light based reference point is not necessarily for visible light, as apple recommends that the lighting mode include non visible wavelengths. This will provide a hidden system that will not be seen by users, or a system that can be invisible and use different wavelengths of light, allowing the system to work with multiple users or objects. < / P > < p > the second patent involves data collection, which specifically covers how the system obtains information about the user’s touch. Such a system needs to know how to reproduce what users might feel when they touch real-world objects, so that it can simulate effects with tactile feedback tools. In the patent for a computer system with finger devices for sampling object attributes, apple proposes a device that uses fingers to detect features that users may be exposed to real-world objects. Sensors in each finger device can read the effects of the real-world object surfaces that the user touches, such as surface contours, textures, object colors and patterns, acoustic properties, and weight. When combined with other elements, such as the camera on the head display, the system will be able to collect a lot of data about objects and then provide them to users. < / P > < p > although worn at the end of the finger, the patent shows that the user can still experience the feeling of touching the object, because the finger pad will remain unobstructed. The sensor can be detected by touching protuberances extending beyond the fingertip, or by detecting changes in the way the user’s fingers touch the object. The collected data about objects can be compiled and filed for future use by the system, and may be shared as a database. This information can then be used with tactile feedback elements to simulate touching a user or other user’s object. < / P > < p > Apple submits a large number of patent applications every week, but although the existence of patent applications indicates areas of interest for Apple’s R & D work, there is no guarantee that these ideas will appear in future products or services. Global Tech