These earbuds with built-in cameras provide an exciting look at the future of AirPods.
These experimental earbuds demonstrate how AirPods could become significantly smarter.
Wireless earbuds have become a common wearable for many. Therefore, this new research is more intriguing than yet another demonstration of smart glasses. Researchers at the University of Washington have developed VueBuds, a prototype that integrates tiny cameras into standard wireless earbuds, allowing users to ask an AI model about what they see in their surroundings.
How does it function?
In a scenario provided by the university, an individual can read a Korean food label and request a translation, receiving the answer through the earbuds. VueBuds captures low-resolution black-and-white still images and transmits them via Bluetooth to a nearby phone or device. A small AI model processes these images locally and responds to questions within approximately one second. This local processing is a significant aspect of the project, as the researchers aim to sidestep the privacy issues often associated with smart glasses and continuous cloud-based vision systems.
The earbuds feature a recording light, allow users to delete images immediately, and maintain on-device processing. The hardware limitations lend credibility to the entire concept. The cameras are about the size of a grain of rice, and the team opted for low-power, low-resolution grayscale imaging to prevent excessive battery drain and to remain within Bluetooth's capabilities.
The researchers discovered that positioning each camera outward by 5 to 10 degrees provided a functional 98-108 degree field of view, and merging the images from both earbuds reduced response time to around one second instead of two.
Why this represents a glimpse into the future of AirPods
According to senior author Shyam Gollakota, the team sought to investigate visual intelligence in earbuds partly because smart glasses and VR headsets have not achieved widespread mainstream acceptance and often raise stronger privacy concerns. There are also reports of Apple developing AirPods with integrated cameras.
This concept aligns with recent discussions about future AirPods. Apple is said to be looking into incorporating tiny infrared cameras or sensors into future AirPods to enhance spatial awareness and introduce new AI-supported features without significantly altering the earbuds' appearance or price. While VueBuds may not be a direct preview of Appleās exact plans, it certainly makes the broader concept seem much more plausible.
Other articles
These earbuds with built-in cameras provide an exciting look at the future of AirPods.
A new prototype from the University of Washington incorporates small cameras into seemingly regular wireless earbuds, giving a surprisingly realistic glimpse into how future AirPods might function.
