OpenAI’s new model is a YouTube addict! Learns Minecraft via 70,000 hours of videos

OpenAI’s new model is a YouTube addict! Learns Minecraft via 70,000 hours of videos
Published on

OpenAI's Dall-E apparently watched 70,000 hours of video to learn Minecraft.

As training regimes go, being forced to watch eight years' worth of someone else playing Minecraft feels pretty harsh. When the revolution comes I fear OpenAI could be first against the wall after the Robot uprising after what it's put its latest AI through in order to get it to play the standard version of Minecraft.

OpenAI neural network can now craft a diamond pickaxe off its own back. The detailed blog post on the OpenAI site explains how it managed to teach the network to play Minecraft, and it's some fascinating stuff. Not least how, of those 70,000 hours of Minecraft gameplay footage, it paid $160,000 to a team of contractors to create and tag up 2,000 hours of footage with labels so the AI could understand what it was looking at and how that related to its actions in the game.

The method is called Video PreTraining (VPT) and it claims its model can learn to craft diamond tools, which it says takes a proficient human around 20 minutes.

"Additionally, the model performs other complex skills humans often do in the game," states the OpenAI post, "such as swimming, hunting animals for food, and eating that food. It also learned the skill of "pillar jumping", a common behavior in Minecraft of elevating yourself by repeatedly jumping and placing a block underneath yourself."

It's also worth noting that this uses the standard interface of mouse and keyboard, not some unique AI-focused build of the game. If it was just watching the videos without context it would be extremely challenging to train a neural network, which is why it retained a pool of contractors to create a smaller dataset where they recorded both their video and the actions they took—keypresses and mouse movements. This is then used to tag those 2,000 hours of footage, and then train something called an Inverse Dynamics Model (IDM) with that dataset so it can then go off and tag the larger 70,000-hour dataset accurately.

More Trending Stories 

Join our WhatsApp Channel to get the latest news, exclusives and videos on WhatsApp

                                                                                                       _____________                                             

Disclaimer: Analytics Insight does not provide financial advice or guidance. Also note that the cryptocurrencies mentioned/listed on the website could potentially be scams, i.e. designed to induce you to invest financial resources that may be lost forever and not be recoverable once investments are made. You are responsible for conducting your own research (DYOR) before making any investments. Read more here.

Related Stories

No stories found.
logo
Analytics Insight
www.analyticsinsight.net