The Technology section is published with the support of Favbet Tech
Following Sora from OpenAI, which generates digital virtual worlds in the style of Minecraft , the Google DeepMind generative model has distinguished itself with its own talent for creating games.
As reported by MIT Technology Review, Genie can take a short text description, a hand-drawn sketch or a snapshot, and turn it into a video game in the style of classic 2D platformers like Super Mario Bros. You can't expect a fast pace from AI creations yet – they work at a speed of one frame per second versus the typical 30-60 frames per second in most modern games.
Genie was trained on 30,000 hours of online gaming videos from hundreds of 2D platformers. Other models use a similar approach – Nvidia trained GameGAN this way, which was noted for creating a Pac-Man clone.
All of the previous examples trained models on input actions (such as pressing buttons on a controller) as well as combining them with videos (a video of Mario jumping combined with a Jump action) – but adding such tags requires a lot of work. Genie instead learns only from video recordings and analyzes which of the possible actions will cause the character to change its position
Genie generates each new frame of the game on the fly based on the player's action: press “jump” and it will update the current image to show the player character jumping; press left and the image will change to show the character moved to the left
Genie can create simple games from hand-drawn sketches
When it comes to speed limits, it's only a matter of time, says Tim Rockteschel, Google DeepMind Research Scientist:
“There are no fundamental limitations that would prevent us from achieving 30 frames per second. Genie uses many of the same technologies as today's large language models, where significant progress has been made in improving inference speed.”
Genie has also studied some of the typical visual features of platformers – such as parallax, where the foreground moves sideways faster than the background – and often adds this effect to games.
3D modeling in Blender. You will have 22 hours of work to go through the work flow of a 3D modeler. Get started with the functionality of Blender. Further – sharpen the skills of creating 3D models. Registration for the course
The model is currently an internal research project and is not available to the public.
At the same time, games are not the only area of interest for the creators of Genie. The team is working on AI-controlled bots that will be able to sit in a virtual environment and solve various problems through trial and error. In 2021, another DeepMind team developed a virtual playground called XLand that ran similar bots. Apparently, Genie may well create such an environment in the future.
The Technology section is published with the support of Favbet Tech
Favbet Tech is IT a company with 100% Ukrainian DNA, which creates perfect services for iGaming and Betting using advanced technologies and provides access to them. Favbet Tech develops innovative software through a complex multi-component platform that can withstand enormous loads and create a unique experience for players. The IT company is part of the FAVBET group of companies.
The competition for ITS authors continues. Write an article about the development of games, gaming and gaming devices and win a professional gaming wheel Logitech G923 Racing Wheel, or one of the low-profile gaming keyboards Logitech G815 LIGHTSYNC RGB Mechanical Gaming Keyboard!