U.S. Patent No. 10,688,396: Second screen virtual window into VR environment
Issued June 23, 2020, to Sony Interactive Entertainment Inc.
Filed: April 25, 2018 (claiming priority to April 28, 2017)
Overview:
U.S. Patent No. 10,688,396 (the ‘396 patent) relates to locally observing the virtual reality environment of someone playing virtual reality (VR) through a virtual window into the environment. The ‘396 patent details a method of observing the VR environment of a VR player using a head mounted display (HMD). This is achieved by establishing a connection between a handheld device of an observer and the computer executing the presented VR environment. Then the camera of the handheld device captures the current position of the VR player in real space, and uses a second camera on the handheld device to capture the face position of the observer to determine a viewing direction for a screen of the handheld device. The screen is then configured to present the VR environment and at least part of the VR player. Meanwhile, the camera continually shares the position of the observer with the computer executing the VR environment. The VR environment presented to the handheld device is configured to the position and viewing direction of the observer. The ‘396 patent could allow observers of VR gameplay to have a window into the virtual world in which the player is playing, in real time.
Abstract:
Methods for observing a virtual reality environment of a virtual reality player is are provided. One method includes establishing, by a handheld device of an observer, a connection with a computer executing the virtual reality environment being presented to the virtual reality player using a head mounted display (HMD). Capturing, by a first camera of the handheld device, a current position of the virtual reality player in a real world space. Capturing, by a second camera of the handheld device, a face position of the observer. The face position being monitored to determine a viewing direction to a screen of the handheld device. The screen of the handheld device is configured to present the virtual reality environment and at least part of the virtual reality player interacting in the virtual reality environment. A current position of the handheld device and the face position of the observer are continually shared with the computer executing the virtual reality environment presented to the virtual reality player. The method then enables receiving, from the computer, a video stream of the virtual reality environment that includes at least part of the virtual reality player adjusted for the current position of the virtual reality player in the real world and the viewing direction of the observer to the screen of the handheld device.
Illustrative Claim:
- A method for observing a virtual reality environment of a virtual reality player, comprising, establishing, by a handheld device of an observer, a connection with a computer executing the virtual reality environment being presented to the virtual reality player using a head mounted display (HMD); capturing, by a first camera of the handheld device, a current position of the virtual reality player in a real world space; capturing, by a second camera of the handheld device, a face position of the observer, the face position being monitored to determine a viewing direction to a screen of the handheld device, the screen of the handheld device is configured to present the virtual reality environment and at least part of the virtual reality player interacting in the virtual reality environment, wherein a current position of the handheld device and the face position of the observer being continually shared with the computer executing the virtual reality environment presented to the virtual reality player; and receiving, from the computer, a video stream of the virtual reality environment that includes at least part of the virtual reality player adjusted for the current position of the virtual reality player in the real world and the viewing direction of the observer to the screen of the handheld device.