Apple is developing a system that can generate mixed reality or virtual reality environments from flat video content, allowing users to navigate and explore in previously two-dimensional clips. The & quot; office of Patent & quot; and the patent for reconstructing the content of the real world device named & quot; was published by the U.S. Patent Office on Thursday. The patent explicitly defines synthetic reality or SR as digitally generated objects and environments. SR is essentially a broad category, and Apple’s representation includes virtual reality, augmented reality and hybrid reality. < / P > < p > users can participate in SR experience on devices, whether it’s a handheld device like an iPhone iPad or a rumored & quot; Apple Glasses & quot; headset. They can interact with the SR environment through one or more senses, including vision, taste, smell and touch. However, most of the content of the patent focuses on a system that can generate SR characters, objects and environments from flat video content. In other words, it can turn TV programs into a VR environment that users can explore with these devices. < / P > < p > as apple has pointed out, most Sr content is carefully crafted in advance. However, this patent describes an on-demand SR reconstruction method to generate video content through & quot; digital assets, so as to seamlessly and quickly transplant flat content into the SR experience. The working principle of the system is to identify the & quot; scenario executor & quot; in the scene, synthesize the scene description, and drive the first digital asset associated with the first scenario performer to generate the scene reconstruction according to the scene description. < / P > < p > although the system can generate SR reconstruction based on video content, it can also obtain information from relevant text content and external data. That could be a picture of the actor in the video clip, the height and size of the actor, various views of the scene, and other data. In some embodiments, digital assets are generated instantaneously, at least in part, based on video content and external data associated with video content. Interestingly, Apple also pointed out that similar SR generation systems can build interactive scenes based on audio and related content, including audiobooks, radio plays, and other pure audio content. < / P > < p > Apple submits a large number of patent applications every week, but there is no guarantee that the technology described in it will enter the market. Similarly, the patent application doesn’t give any indication when Apple will launch a new product with the technology. Spontaneous combustion at a Guangzhou Motor vehicle intersection and other traffic lights in Shenzhen

By ibmwl