Apple may not have much use for NVIDIA, but that doesn’t mean NVIDIA has no use for Apple. Specifically, the Apple Vision Pro headset it uses to develop its humanoid robot. See how below:
The video is part of a campaign to promote NVIDIA’s work around robotics.
In the press release, Apple Vision Pro appears twice as an instrument for controlling NVIDIA’s robots in regards to the MimicGen NIM microservice:
Training foundation models for humanoid robots requires an incredible amount of data. One way of capturing human demonstration data is using teleoperation, but this is becoming an increasingly expensive and lengthy process.
An NVIDIA AI- and Omniverse-enabled teleoperation reference workflow, demonstrated at the SIGGRAPH computer graphics conference, allows researchers and AI developers to generate massive amounts of synthetic motion and perception data from a minimal amount of remotely captured human demonstrations.
First, developers use Apple Vision Pro to capture a small number of teleoperated demonstrations. Then, they simulate the recordings in NVIDIA Isaac Sim …