Edit this page

NA-MIC Project Weeks

Back to Projects List

Implement OpenUSD output into the OpenAnatomy Export extension

Key Investigators

Presenter location: In-person

Project Description

This project aims to implement the export of OpenUSD files in the OpenAnatomyExport 3DSlicer extension. OpenUSD files can be imported into NVIDIA Omniverse.

OpenUSD, or Universal Scene Description, is an advanced framework for representing and handling 3D scenes and animations. Developed initially by Pixar, OpenUSD addresses the complexities involved in creating computer graphics for films, games, industrial engineering, and scientific experimentation, which often require managing large amounts of 3D data.

NVIDIA Omniverse is a platform designed for real-time collaboration and physically accurate simulation in 3D workflows. Essentially, it’s a tool for creating and operating virtual worlds, offering a shared space for creators, designers, and engineers. Here are some key aspects of NVIDIA Omniverse:

Real-Time Collaboration: One of the main features of Omniverse is its ability to enable multiple users to collaborate in real-time on the same project. This is especially useful in fields like game development, architectural visualization, industrial design, and more.

Physically Accurate Simulation: The platform provides tools for accurate physical simulation of materials, lighting, and environments. This allows for incredibly realistic rendering and animation, useful in fields that require high-fidelity visualizations.

Compatibility and Interoperability: Omniverse is designed to be compatible with a wide range of software tools commonly used in 3D design and development. It supports a variety of file formats and has integrations with popular design software like Autodesk Maya, Adobe Photoshop, and others.

AI Integration: NVIDIA has integrated various AI capabilities into Omniverse, which can assist in tasks like object recognition, scene understanding, and even automated 3D asset generation.

Ray Tracing and Advanced Rendering: Powered by NVIDIA’s RTX technology, Omniverse offers advanced ray tracing capabilities, resulting in highly realistic lighting and reflections.

Use Cases and Applications: The platform is aimed at a range of industries, including animation and film, architecture, engineering, game development, and more. It can be used for creating virtual prototypes, digital twins, animated content, and interactive experiences.

Extension and Customization: Developers can extend the capabilities of Omniverse through custom plugins and extensions, allowing for tailored solutions for specific industry needs.

Cloud and Edge Computing: Omniverse can leverage cloud and edge computing, enabling large-scale simulations and collaboration across different geographical locations.

Objective

Implement OpenUSD export in 3D Slicer

Approach and Plan

We want to discuss, improve and then merge the pull request for OpenAnatomy.

Progress and Next Steps

Rudolf implemented the necessary code, changed the UI and created a Pull request

We ran into several problems realizing this, finding the right apps in OMNIVERSE and in the end we work with OMNIVERSE Create app. This loads a USDC file which can then be modified in Omniverse. There only needs to be one strong server driving OMNIVERSE (>RTX 3090 with 24 GB VRAM - thank you AWS for providing the server instance), underpowered clients can connect to the server via IP adress or even from the phone (install OMNIVERSE Sreaming app) We are in the process of testing that all out, expect updates to this page in the next weeks.

image

Taking apart a 3D Slicer lung andtumor segmentation and visualize it in Omniverse:

Illustrations

OpenAnatomy extension with new feature

image

NVIDIA Omniverse

image

Background and References