i own a vision pro, and this makes no sense to me how this would work. you can’t do a selection gesture with a pencil in your hand

@mattyb Add a button to the pencil?

@JonathanMannhart it’s unclear what would be eye-based selection and what would be pencil-based selection. it’s solvable, but really not obvious that it would be a good user experience to me.

anyways. weird to bet yes when your solution involves updating hardware

@mattyb “anyways. weird to bet yes when your solution involves updating hardware“

Huh? Why is that weird?

Are you not assuming the pencil gets an update next week? Apple's invitation design graphic includes an Apple Pencil:

https://appleinsider.com/articles/24/04/28/apple-pencil-coming-on-may-7-could-buzz-users-with-haptic-feedback

The iPhone doesn’t have support yet, only modern iPads do. My understanding of how the pencil works is that it’s capturing tilt gestures of the pen by detecting contact with a screen.

It’d be incredible if they could retrofit existing pencils to work with the Vision Interface, such that you can draw on the air and see it captured perfect. But maybe they will, I guess we’ll find out.

For my money, I’d expect some new Pencil+ in the next few years with different sensors to let you draw anywhere.

@mattyb yeah I would certainly imagine a new pencil to facilitate it with precise localization tech but it is conceivable they could do it just with the spacial information from the vision pro. I would also expect it to be more likely in the coming years, maybe I'll make a multiple choice with years.