A recently published patent from Sony could lead to the implementation of a form of video game streaming based entirely on AI.
A system that would enable AI video game streaming that respond to viewer feedback has been filed for patent by Sony. This technique could be connected to other Sony patents that were recently made public and that employ AI to interact with people and react to input data.
While it’s not something Sony has used previously, AI streaming is not a completely novel idea. Vedal987, better known on Twitch as Neuro-Sama, is a prominent example of an AI broadcaster who gained attention at the beginning of the year. A mixture of astonishment and incredulity has been expressed by viewers in response to streamers such as Neuro-Sama since many of them are convincing and lifelike while being obviously unnatural. This may be particularly true when these AIs are combined with common VTuber (Virtual YouTuber) accessories, including completely computer-generated avatars, as it allows for more realism and interpretation.
Sony has filed a patent defining a framework for AI streaming, continuing its drive into experimental technologies. As to the patent, this framework would enable an artificial intelligence player to engage in games and broadcast it across a network for viewing by “one or more spectators.” The AI player may use machine learning to simulate how human players might behave in-game. Additionally, it may examine “feedback data” and modify its actions accordingly. Other important criteria listed in the patent are:
- Analyzing feedback data to determine level of spectator interest
- Gathering training data from spectator feedback
- Gathering input data from a user’s microphone or camera
- Performing facial analysis based on data received from a camera