Linxi "Jim" Fan, an AI researcher at the chipmaker Nvidia, worked with some colleagues to devise a way to set the powerful language model GPT-4 loose inside the blocky video game Minecraft.
The team created a Minecraft bot called Voyager that uses GPT-4 to solve problems inside the game. The language model generates objectives that help the agent explore the game, and code that improves the bot's skill at the game over time.
Voyager can read the state of the game directly, via an API. The most novel part of the project is the code that GPT-4 generates to add behaviors to Voyager. If the code initially suggested doesn't run perfectly, Voyager will try to refine it using error messages.
Voyager shows the huge potential for language models to perform helpful actions on computers. Using language models in this way could perhaps automate many routine office tasks, potentially one of the technology's biggest economic impacts.
View Full Article
No entries found