U.S. Patent No. 10,493,363: Reality-based video game elements

Issued December 3, 2019 to Activision Publishing Inc.
Priority Date: November 9, 2016

Summary:
U.S. Patent No. 10,493,363 (the ’363 Patent) relates to using video imagery from the camera of a real-life vehicle in a video game. The ’363 Patent details a method of displaying video from a vehicle’s camera by a game device and transmitting user input to the vehicle to modify the gameplay state. In some embodiments, overlays of in-game features (such as a heads-up-display) may be superimposed onto the video from the vehicle’s camera. Other objects or structures that are visible to the vehicle’s camera, including other vehicles, may be identified by a process performed by a game device and assigned gameplay elements, such as points for circumnavigating an identified object or structure. Surfaces may also be identified and assigned gameplay elements, such as a point reduction for driving on grass, or a powerup for driving on another type of surface. 

Abstract:
A videogame may make use of real world imagery for play of a video game utilizing a real world vehicle. Items may be identified in the real world imagery, and the identified items may become gameplay elements.

Illustrative Claim:
1. A method for use in providing videogame play of a videogame, comprising: receiving, by a game device, video imagery from a camera of a vehicle; displaying the video imagery by the game device; receiving, by the game device, user inputs for operation of the vehicle; transmitting, by the game device, operation commands to the vehicle; modifying a gameplay state of the videogame based on information of the video imagery and the user inputs for operation of the vehicle, including determining types of surfaces for areas of the gameplay world by comparing information of the video imagery with a library of information about potential types of surfaces and modifying the gameplay state of the videogame based on a type of surface identified in the video imagery upon which the vehicle is located; identifying items in the video imagery and assigning gameplay elements of the videogame to at least some of the items; and modifying display of the at least some of the items in the video imagery identified as gameplay elements of the videogame based on gameplay status of the at least some of the items.