Apple’s Vision Pro to Enable Wheelchair Control via Eye Tracking
Article / iPhone

Apple’s Vision Pro to Enable Wheelchair Control via Eye Tracking

Apple's Vision Pro will soon allow users to control power wheelchairs with eye movements, showcasing new accessibility features powered by Apple Intelligence.

Apple is set to unveil a suite of new accessibility features, including a notable eye control capability for power wheelchairs via its Vision Pro headset, just in time for Global Accessibility Awareness Day on May 21. This initiative aims to enhance accessibility across devices using advanced AI technologies.

Eye Control for Wheelchairs

The standout feature allows users to operate compatible power wheelchairs using only their gaze. This functionality uses the precision eye-tracking technology embedded in the Vision Pro headset, providing a responsive input method that performs well in various lighting conditions. The feature is compatible with alternative drive systems like TOLT and LUCI and supports both Bluetooth and wired connections, ensuring broad compatibility.

Pat Dolan, a user with ALS and founder of GeoALS, highlighted the importance of this innovation, stating, "The option to control my power wheelchair on my own is gold to me." This reflects the life-changing potential of the technology for those facing mobility challenges.

Enhanced Accessibility Features

Beyond wheelchair control, Apple has introduced several other accessibility improvements powered by Apple Intelligence. For example, the VoiceOver feature now employs AI to provide detailed descriptions of images, including those without proper alt-text. Users can inquire about their camera viewfinder, receiving thorough answers that enhance their understanding of their surroundings.

Apple's Magnifier tool will also improve, offering high-contrast visual descriptions for users with low vision. The app can be controlled through voice commands, allowing simple requests like "zoom in" or "turn on the flashlight."

Natural Language Processing

Another significant addition is the integration of natural language capabilities into Apple's Voice Control function. Users can now describe on-screen buttons and controls more intuitively, eliminating the need to memorize specific labels. This feature aims to simplify navigation through apps like Apple Maps and Files. For instance, users can say, "tap the guide about best restaurants," instead of searching for exact button names.

Accessibility Reader and Subtitles

The Accessibility Reader is also receiving upgrades, enabling it to summarize complex materials such as scientific articles and documents with multiple columns. Built-in translation capabilities will allow users to read content in their preferred language while maintaining the original formatting.

Generated subtitles will enhance accessibility for personal videos and other media, automatically captioning un-captioned content across devices including the iPhone, iPad, Mac, Apple TV, and Vision Pro. This feature prioritizes user privacy by processing data on-device to generate captions.

Availability and Future Outlook

These new features are expected to roll out later this year, marking a significant step forward in Apple's ongoing commitment to accessibility. With a focus on privacy and user empowerment, the updates reflect Apple's dedication to creating truly inclusive technology.

As these developments unfold, Apple continues to position itself as a leader in accessibility innovation, striving to enhance the lives of individuals with disabilities. The introduction of eye control for wheelchairs not only represents a technological advancement but also a meaningful response to the needs of users seeking greater independence.

Quick answers

How does the wheelchair control feature work?

It uses the Vision Pro's eye-tracking technology to allow users to control compatible power wheelchairs simply by looking.

When will these accessibility features be available?

The new features are expected to roll out later this year.

What other devices will support the new features?

Features will be available on iPhone, iPad, Mac, Apple TV, and Vision Pro.

About the author

MJI Desk

MJI Desk covers consumer tech for MJI News.