Start with a STEP file. Convert it into a shape Isaac Sim can open, then give the tabletop a collision shape so a cube can land on it. If you want to start with included code and data, use the workbench capstone. This guide shows the AIF and HOOPS route for a STEP file of your own.
What turns CAD geometry into a reusable simulation asset?
- InputA CAD file with known dimensions
cad_source/workbench.stepUse a tabletop with measured dimensions so you know whether the conversion kept its scale.
- ProcessConvert and check
AIF + HOOPS → workbench.usdcThe converter writes USD geometry. Verify size, up axis, and missing references before simulating.
- OutputReference it in a simulation
workbench_scene.usd · colliderKeep a separate simulation scene. Give the tabletop a collider and use it for camera or robot tasks.
Separate conversion from scene composition
STEP stores CAD shapes and assemblies. The HOOPS converter makes that geometry available in USD. Keep the converted workbench as a reference asset, and place it with its colliders and cameras in a separate simulation scene. Multiple experiments can share one asset and set their own lighting and robot poses. AIF Pipeline Samples · OpenUSD reference tutorial
| Stage | File | What to check |
|---|---|---|
| Measured input | workbench.step |
The tabletop measures 1,200 × 600 × 40 mm. |
| Reference asset | workbench.usdc |
Check units and the up axis. The dimensions are 1.2 × 0.6 × 0.04 in meters. |
| Simulation scene | workbench_scene.usd |
Check that the reference resolves and top collider aligns with the visible surface. |
The HOOPS route below and the CadQuery capstone use different converters. Both verify scale, axis, and contact before attaching a camera or adding a robot.
What you need
| Item | Start with |
|---|---|
| CAD input | One STEP file with known dimensions. To make your own, create a box measuring 1,200 × 600 × 40 mm in a CAD editor and export it as workbench.step. This is enough to represent the tabletop. |
| Conversion | AIF Pipeline Samples at revision 4103896, configured against a Kit/USD Composer installation with the HOOPS converter. Use the sample setup and record the Kit build it uses. |
| Simulation | Isaac Sim 6.1 documentation is the reference for this guide. Use the requirements and samples for your installed build. A supported Linux or Windows workstation with NVIDIA RTX is the starting point. |
| Additional input for pick-and-place | The URDF, gripper, and sample controller from the official manipulator tutorial. The tabletop is separate from the robot model. |
AIF setup · Isaac Sim requirements · Workstation installation
1. Convert and validate the USD
Open a terminal on the machine where you will run the converter. Clone the AIF sample and enter its folder. The version below matches the setup and Kit configuration.
git clone https://github.com/NVIDIA-Omniverse/aif-pipeline-samples.git
cd aif-pipeline-samples
git checkout 41038967ef0a2459b128a225161f8d59beb3b424
After the sample setup, stay in aif-pipeline-samples and place your STEP at cad_source/workbench.step. The converter reads that file and writes usd_converted/workbench.usdc. Validation puts a separate report in validation_reports. The bundled HOOPS preset selects the STEP conversion.
mkdir -p usd_converted validation_reports
uv run aif-pipeline config show
uv run aif-pipeline convert ./cad_source/workbench.step ./usd_converted/workbench.usdc \
--spec scripts/data/creo_spec.json
uv run aif-pipeline validate ./usd_converted/workbench.usdc ./validation_reports/
Open the converted asset and measure the tabletop against the CAD dimensions. For the example input, the expected physical extents are 1.2 × 0.6 × 0.04 m, regardless of the authored USD units. Check the up axis, prim hierarchy, and missing references in the validation report. Use the sample's optimization step if the assembly needs cleanup or unit and axis normalization. Recheck the measurements after any optimization. Official CAD-to-USD workflow · Asset Validator
2. Compose a reusable workbench scene
- In Isaac Sim, create a stage and reference the converted asset under a prim such as
/World/Workbench. Check the dimensions and up axis again after composition. Normalize the asset first or apply a corrective transform if its units or axis differ from the scene. Save a separateworkbench_scene.usdbeside the geometry so you can keep conversion output and simulation edits separate. - Give the tabletop a static collision shape. For a flat surface, a box collider sized to match the tabletop is enough. Add a small dynamic cube with a collider above it and play the simulation.
- Confirm that the cube settles on the tabletop rather than falling through, and that the tabletop stays fixed. Save the workbench scene in its initial state so each run starts from the same poses.
This applies SimReady principles to a small scene. Check the relevant SimReady profile separately when a downstream tool requires one. For a digital twin, the same USD reference can be composed into a larger layout with measured dimensions and clearances. OpenUSD linear units · Isaac Sim physics fundamentals · SimReady requirements
3A. Generate labeled camera data
- Run the official Replicator scene example with the bundled scene once. Then adapt the example's scene-loading step to reference the local workbench scene and place a camera with the cube in view. Keep the camera fixed for the first test.
- Give the cube a semantic class such as
partafter any cleanup of existing labels. Capture four frames withBasicWriterand enablergb,distance_to_image_plane(depth), andsemantic_segmentation. - Open one RGB frame with its corresponding depth and mask. Check that the mask covers the cube and maps to
part, and that the depth agrees with the camera placement. Only then vary the object pose or lighting.
Keep the USD scene, camera pose, writer configuration, and sample output. Official scene-based Replicator example
3B. Run a robot pick-and-place
- Follow the Isaac Sim manipulator tutorial from URDF import through its first successful pick-and-place with the tutorial's robot and scene.
- Reference the converted tabletop in a copy of the tutorial scene. Align its collider to the expected work surface and remove or disable the original support if it overlaps. Adjust the robot base, pick and place poses, and reach limits relative to the new surface.
- Reset and repeat with the same starting pose. Check that the gripper lifts the cube, avoids unintended contact with the bench, and releases the cube inside the marked target area. Record the starting poses and count successful runs.
Keep the task scene, robot and controller configuration, and a short result log. For camera-based perception or ROS 2 motion planning, build from the supported Isaac ROS reference workflow after the baseline works. Official URDF-to-pick-and-place tutorial · Isaac for Manipulation reference architecture
Related tools and verification
- OpenUSD composes the scene. OpenUSD Exchange SDK is useful for authoring or adapting an exchange pipeline. SimFoundry is a separate starting point when your input is a tabletop video.
- AIF sample code is MIT. The converter, Kit/Isaac Sim distribution, and any CAD, robot, or asset files have separate terms. AIF license · Isaac Sim license scope
- Verification status · Official examples and command references checked. The combined workbench recipe has yet to be run on a supported RTX workstation.