GPU giant NVIDIA introduced a new AI method that transforms still photos into 3D objects that creators can modify with ease. The technique is dubbed 3D MoMa, which could give game studios a simple way to alter images and scenes, relying on time-consuming photogrammetry, which takes measurements from photos.
3D MoMa speeds up the task through inverse rendering. This process uses AI to estimate a scene’s physical attributes (from geometry to lighting) by analyzing still images. The pictures are then reconstructed in a realistic 3D form.
3D MoMa generates objects as triangle meshes, a format that is straightforward to edit with widely-used tools. The models are created within an hour on a single NVIDIA Tensor Core GPU. 3D MoMa remains under development, but it could enable game devs and other designers to quickly modify 3D objects, and then add them to any virtual scene.
Nvidia’s VP of graphics research David Luebke describes the technique as “a holy grail unifying computer vision and computer graphics.” Lubeke added, “By formulating every piece of the inverse rendering problem as a GPU-accelerated differentiable component, the NVIDIA 3D MoMa rendering pipeline uses the machinery of modern AI and the raw computational horsepower of NVIDIA GPUs to quickly produce 3D objects that creators can import, edit, and extend without limitation in existing tools.”
See What’s Next in Tech With the Fast Forward Newsletter
Tweets From @varindiamag
Nothing to see here - yet
When they Tweet, their Tweets will show up here.
