A Meta prototype lets you build virtual worlds by describing them

Meta is testing an artificial intelligence system that lets people build parts of virtual worlds by describing them, and CEO Mark Zuckerberg showed off a prototype at a live event today. The proof of the concept, called Builder Bot, could eventually draw more people into the virtual reality world. Artificial intelligence could be used to power machine-generated art.

In a pre recorded demo video, Facebook founder and CEO Mark Zuckerberg showed viewers how to use Builder Bot to create a virtual space. Later commands range from broad demands like creating an island to extremely specific requests like adding altocumulus clouds. They also include playing sound effects like tropical music, which is what the builder bot created, although it could also have been general background audio. The video doesn't specify whether Builder Bot draws on a limited library of human-created models or if the artificial intelligence plays a role in generating the designs.

Several artificial intelligence projects have demonstrated image generation based on text descriptions, as well as more accessible applications like Dream by Wombo. These well-known projects involve creating 2D images without interactive components, but some researchers are working on 3D object generation.

Meta describes Builder Bot as using voice input to add 3D objects that users can walk around, and it is aiming for more ambitious interactions. Meta made several other announcements during the event, including plans for a universal language translator, a new version of a chat system, and an initiative to build new translation models for languages without large written data sets.

The kinds of usable virtual objects many users take for granted pose major challenges. If users ask for offensive content or training that reproduces human biases, moderation problems can arise. We don't know the limits of the current system. You can get a taste of Meta's plans for its artificial intelligence future, but you shouldn't expect to see Builder Bot pop up in Meta's social virtual reality platform.

Details about later event announcements from Meta have been added.