Google is testing AI agents named Gemini that assist you in video games.

Google recently introduced Gemini 2.0, and as part of its announcement, it is exploring how AI agents designed with this new technology can understand the rules in video games to offer assistance to users. According to Demis Hassabis and Koray Kavukcuoglu, CEO and CTO of Google DeepMind, respectively, these agents are capable of "reasoning about the game solely based on what happens on the screen and providing suggestions on what to do next in real-time conversations."

Additionally, the executives mentioned that the agents have the ability to "access Google Search to connect players with a vast amount of information about games available on the web." In terms of practical uses, they are being tested to evaluate their "ability to interpret rules and challenges" in titles such as Clash of Clans and Hay Day by Supercell.

It’s not surprising that Google is pursuing these ideas; theoretically, an AI agent that guides you through a strategy or puzzle could be quite useful. However, it seems this work is in its early stages, and many questions arise about the effectiveness of the advice these agents may provide.

Google is also investing in the gaming and AI sector in another way: developing instantly playable virtual worlds from an input image, using a "base world model" called Genie 2, which was introduced last week. Nonetheless, this development also appears to be in its early stages, as the company states that Genie 2 can only generate coherent worlds for "up to one minute."