Rundown:
- Sony Interactive Entertainment has recently published a patent that describes a system for displaying a heads-up display (HUD) interface in a virtual reality (VR) environment during video games.
- The system involves rendering the virtual environment in a virtual reality (VR) headset, tracking the player’s gaze, and generating a heads-up display (HUD) interface with relevant information when the player focuses on an object for a certain period of time.
- The heads-up display (HUD) interface appears near the object in the virtual reality (VR) view, providing details or tips to assist the player without distracting them from the in-game world.
- The system uses artificial intelligence (AI) to identify important objects, determine the context, and generate information for the heads-up display (HUD) interface.
- It also includes features such as zooming in and out of the heads-up display (HUD) based on the player’s gaze and the ability to share heads-up display (HUD) information with teammates in multiplayer video game sessions.
Earlier today, we came across a recently published patent from Sony Interactive Entertainment titled “HEADS UP DISPLAY IN VIRTUAL REALITY,” filed in November 2021 under the name of Sony Interactive Entertainment LLC. The patent, published earlier this month, describes a system for displaying a heads-up display (HUD) in a virtual reality (VR) environment during a video game. The heads-up display (HUD) interface provides information about objects in the video game world and is generated based on the player’s gaze and attention.
The method involves rendering the virtual environment for display in a virtual reality (VR) headset, tracking the player’s gaze, detecting when the player focuses on an object for a certain period of time, generating the heads-up display (HUD) interface with relevant information about that object, and displaying the heads-up display (HUD) near the object in the virtual reality (VR) view.
For example, if a player looks at a weapon or an enemy character for a few seconds, a heads-up display (HUD) display will appear near that object, showing relevant details or tips to assist the player in the video game. This helps the player access important information without taking their attention away from the in-game world.
“A method including rendering a view of a virtual environment of a video game for display in a head mounted display of a user, wherein the virtual environment includes a plurality of objects. The method including tracking gaze of the user,” reads the abstract for the patent.
“The method including detecting that the gaze of the user is directed towards an object in the view for a period of time. The method including generating a heads up display (HUD) interface including information related to the object. The method including surfacing the HUD interface near the object in the view of the virtual environment.”
According to Sony Interactive Entertainment’s claims, the system involves rendering a virtual environment of a video game in a player’s virtual reality (VR) headset. The player’s gaze is tracked, and if the gaze remains on an object in the view for a certain period of time, a heads-up display (HUD) interface is generated with information related to that object.
The heads-up display (HUD) interface is then displayed near the object as an overlay on the virtual environment. Furthermore, the patent specifies that the heads-up display (HUD) interface is embedded within the virtual environment itself. The heads-up display (HUD) interface is also opaque, allowing the player to see the virtual environment through the heads-up display (HUD).
Additionally, if the player’s gaze is directed away from the object, a gaze history function is generated to measure the player’s attention to the object. If the attention decays over time, the heads-up display (HUD) interface is removed. The transparency of the heads-up display (HUD) interface may gradually increase before it is removed as long as the player’s attention continues to decay.
The system from Sony Interactive Entertainment involves using artificial intelligence (AI) to identify multiple objects in the virtual environment and determine the context of the scene in the video game. If an object is deemed important based on the context, information related to that object is generated for the heads-up display (HUD) interface, and the highlighted object is displayed prominently in the view of the virtual environment.
The system also includes zooming in on the heads-up display (HUD) interface, gradually making it larger within the player’s field of view when the player’s gaze is on the object. If the gaze shifts away from the object, the heads-up display (HUD) interface zooms out, gradually becoming smaller within the field of view. The field of view mentioned in the patent is specifically related to a sniper mode view in the virtual environment.
Furthermore, the information within the heads-up display (HUD) interface can be shared with another player who is part of a team in a multiplayer video game session. The system also involves establishing a communication session between the player and another player who is part of the same multiplayer video game session.
The audio of the communication session is monitored, and speech recognition is performed on the audio to identify the context. Based on the context, the second information is generated and presented in the heads-up display (HUD) interface. This innovation has the potential to enhance player communication and alleviate audio conflicts, streamlining gameplay and facilitating smoother navigation through challenging scenarios.
Although the patent is a significant step forward, it’s important to remember that it is currently in the patent stage. As of now, Sony Interactive Entertainment has not made any official announcements regarding the practical implementation of this patent. However, if realised, with the potential to transform how players interact with virtual environments, this system holds the promise of heightened immersion, improved gameplay, and streamlined communication.
What do you think about this? Do tell us your opinions in the comments below!
Similar Reads: Activision Making Mobile Games “Less Distracting” For Players
Good job! Please give your positive feedback 😏
How could we improve this post? Please Help us. 💡
From writing short stories in his room to finding true enthusiasm for video game and computer hardware journalism, Huzaifa plays video games and write all the latest and greatest news about them. Currently pursuing a Bachelor of Science degree in Data Science, he dives deep into the news, authenticating every tiny detail to serve his audience. When he’s not breaking news, he becomes a master storyteller, conjuring up captivating tales from the depths of his imagination. With a wealth of experience as a Video Game Journalist. He has also worked with Publishers like eXputer, The Nerd Mag and Gamesual making him an expert in Gaming News Industry.
