- We are releasing our Cube 3D foundational model for generative AI.
- We are also open-sourcing a version of the Cube 3D foundational model.
- The beta version of Cube 3D mesh generation—in Roblox Studio and as an in-experience Lua API—will be available this week.
Last fall, we announced an ambitious project to build an open-source 3D foundational model to create 3D objects and scenes on Roblox. This week, we are open-sourcing the first release for this model to make it available for use by anyone on or off the Roblox platform on both GitHub and HuggingFace. We’ve named this model Cube 3D. We are also launching the first of its capabilities, with the beta launch of our mesh generation API. Cube will underpin many of the AI tools we’ll develop in the years to come, including highly complex scene-generation tools. It will ultimately be a multimodal model, trained on text, images, video, and other types of input—and will integrate with our existing AI creation tools.
Cube 3D generates 3D models and environments directly from text and, in the future, image inputs. Today, state-of-the-art 3D generation uses images and a reconstruction approach to build 3D objects. This is a good option when there isn’t sufficient 3D training data. However, thanks to the nature of our platform, we train on native 3D data. The generated object is fully compatible with game engines today and can be extended to make objects functional.
The difference here is similar to a racetrack movie set. On TV, you might see what looks like a fully functional racetrack, with stands, garages, and a victory lane. But if you were to walk around on that set, you’d quickly realize that the structures were actually flat. Building a truly immersive 3D world requires complete, functional structures, with garages you can drive into, stands you can sit in, and a victory lane with a functional podium.
To achieve this, we’ve taken inspiration from state-of-the-art models trained on text tokens (or sets of characters) so they can predict the next token to form a sentence. Our innovation builds on the same core idea. We’ve built the ability to tokenize 3D objects and understand shapes as tokens and trained Cube 3D to predict the next shape token to build a complete 3D object. When we extend this to full scene generation, Cube 3D then predicts the layout and recursively predicts the shape to complete that layout.
Anyone can fine-tune, develop plug-ins for, or train Cube 3D on their own data to suit their needs. We believe that AI tools should be built on openness and transparency, which is why we are a committed partner in the open-source AI community. We released one of our AI safety models because we feel strongly that sharing advancements in AI safety helps the entire industry accelerate innovation and technical advancements. For this reason, we also helped found ROOST, a new nonprofit dedicated to tackling important areas in digital safety with open-source safety tools. In open-sourcing Cube 3D, our goal is to enable researchers, developers, and the broader AI community to learn, augment, and advance 3D generation industry-wide.
Cube 3D for Creation
We’ve spoken previously about how AI can accelerate the creation of 3D assets, accessories, and experiences. Ultimately AI will enable even more immersive and personalized play and connections. We invest in infrastructure to support AI at every stage of the creation cycle—for both the developers of these experiences and the users who spend time in them. We envision a future where developers will give their users new ways to create by enabling AI in their experiences. This puts the power of AI in the hands of more than 85 million daily active users as part of their gameplay.
In the past year, we’ve introduced several new features through our AI-powered Assistant within Roblox Studio to provide developers with the tools and capabilities they need to create and eliminate hours of manual work. With Cube, we intend to make 3D creation more efficient. With 3D mesh generation, developers can quickly explore new creative directions and increase their productivity by deciding rapidly which to move forward with.
Imagine building a racetrack game. Today, you could use the Mesh Generation API within Assistant by typing in a quick prompt, like “/generate a motorcycle” or “/generate orange safety cone.” Within seconds, the API would generate a mesh version of these objects. They could then be fleshed out with texture, color, etc. With this API, you can model props or design your space much faster—no need to spend hours modeling simple objects. It lets you focus on the fun stuff, like designing the track layout and fine-tuning the car handling. This API saves hours on each object created and gives you back that time to experiment with new ideas without worrying about spending too much time or effort. Longer term, we plan to enable more complex and functional objects, even scenes.
