Apple introduces new accessibility features powered by AI for the iPhone, Mac, and Vision Pro.
Apple has revealed significant accessibility updates for its devices, including the iPhone, iPad, Mac, Apple Vision Pro, and Apple TV, with many features enhanced by Apple Intelligence. The company states that these updates aim to improve the usability of its devices for individuals with visual, hearing, mobility, and learning disabilities, all while adhering to Apple’s commitment to privacy in AI.
These new accessibility features will be available later this year through Apple's upcoming software updates.
Apple is integrating AI into accessibility features
A key update focuses on the VoiceOver and Magnifier for users who are blind or have low vision. Apple has introduced a new “Image Explorer” feature in VoiceOver that provides more detailed descriptions of images, scanned documents, bills, and other visual information using Apple Intelligence. Users will also have the ability to ask follow-up questions regarding what the camera captures through the iPhone’s Action button.
The Magnifier tool is receiving AI-driven visual descriptions and voice commands. Users can give spoken instructions like “zoom in” or “turn on flashlight” while utilizing this feature.
Apple is also enhancing Voice Control with natural-language capabilities. Rather than having to memorize precise button labels, users can now articulate what they see on their screens with phrases such as “tap the purple folder” or “open the restaurant guide.” The company asserts that this will simplify app navigation for users with physical disabilities.
Auto-generated subtitles and enhanced reading features
Apple is also introducing a feature that automatically generates subtitles for videos lacking captions. This function employs on-device speech recognition to create subtitles privately for personal videos, streamed content, and clips from friends or family. The generated subtitles will be compatible with the iPhone, iPad, Mac, Apple TV, and Apple Vision Pro.
The Accessibility Reader is expanding to handle more intricate content, such as scientific articles.
Another update enhances Accessibility Reader, designed for users with dyslexia or low vision. It will now support more complex materials, including scientific articles that have columns, tables, and images. Additionally, the feature will include AI-generated summaries and built-in translation tools.
Apple Vision Pro will provide eye-controlled wheelchair support
One notable update pertains to Apple Vision Pro. The company announced that users with compatible alternative wheelchair drive systems will soon be able to operate power wheelchairs through Vision Pro’s eye-tracking technology. Initially, this feature will support Tolt and LUCI systems in the U.S.
Additionally, Apple announced further Vision Pro accessibility updates, such as face gesture recognition, enhanced Dwell Control, and tools to reduce motion sickness for users in moving vehicles.
The significance of these features
Accessibility has been an important focus for Apple, and the latest updates demonstrate how AI is becoming increasingly integrated into assistive technologies. Rather than limiting AI to productivity or chatbot applications, Apple is incorporating it into practical accessibility functionalities such as visual perception, navigation, reading support, and communication.
The company continues to prioritize on-device processing and privacy, particularly as AI features are being more widely adopted across consumer devices. Apple has stated that these new accessibility features will debut later this year across its ecosystem. More details are expected to be revealed during WWDC, where Apple will likely present how Apple Intelligence drives these advancements across iOS, iPadOS, macOS, and visionOS.
Other articles
Apple introduces new accessibility features powered by AI for the iPhone, Mac, and Vision Pro.
Apple has introduced new AI-driven accessibility features, which include enhanced VoiceOver tools, automatic subtitles, better reading assistance, and eye-controlled wheelchair support for Vision Pro.
