According to recent disclosures from the United States Patent and Trademark Office (USPTO), Apple Inc. has been granted two patents related to Vision Pro technology, enabling users to draw in virtual scenes even without tools like the Apple Pencil.
The first patent, titled "Input System for Head-Mounted Devices, Based on Touch Pen," reveals Apple's exploration of using a touch pen to interact with the virtual world.
The Apple Pencil is indeed a natural input device, but the patent also outlines a new device with an optical emitter (possibly infrared) that can track the position and orientation of the headset tracking device, enabling drawing. The second patent, titled "Techniques for Drawing in a Computer-Generated Reality Environment," tracks the user's hand, so the user only needs to make a gripping motion, and in an AR scene, you're holding a virtual pen on a drawing board, allowing you to draw.
The patent diagram from Pulsestacks includes an example where you can add hats to people in real-life scenes and draw birds in the sky, and then implement this in headsets like Vision Pro.
