Apple Releases Developer Preview: AI Listening Feature and New Health App Launched

Apple has taken a major step in deeply embedding artificial intelligence into daily life, but this has also triggered privacy controversies.

On Tuesday, Apple officially released the first developer beta versions of iOS 27.3 and watchOS 27.3, featuring an always-on AI audio listening tool and a completely revamped health app. The full versions are expected to be officially launched to users in December.

The AI audio feature was first unveiled at the product launch in September, utilizing the device’s microphone to monitor and analyze nearby conversations in real time, then summarizing key content.

This technology potentially runs up against eavesdropping laws in several US states and once again raises privacy concerns regarding tech devices collecting data from daily life.

On Tuesday, Apple shares closed down 1.9%.

In this beta version, the AI audio feature is the most eye-catching and also the most controversial new addition. It is currently only supported on Series 12 and Ultra 4 Apple Watch models.

There are two specific features:

• Siri Recap automatically organizes key topics from nearby conversations into a list of bullet points, functioning similarly to third-party transcription apps like Granola and Otter;
• Live Rewind can backtrack and display a text transcript of the past 15 seconds of conversation. Apple gives an example scenario: when speaking with a waiter at a restaurant, you no longer need to ask the person to repeat themselves.

However, the legal risks of such features cannot be ignored. In the US, eavesdropping laws in some states require all parties to a conversation to consent to recording. There is a potential conflict between Apple's “environment listening” mode and these requirements.

At the same time, as Meta Platforms and other tech companies have rolled out AI devices capable of recording audio and video, public concern about tech products encroaching on everyday privacy continues to rise, and Apple’s latest move is certain to intensify this debate.

In response to these controversies, Apple has emphasized several privacy protections:

• When users activate Live Rewind, the device emits an audible alert;
• Audio processing is completed locally on the device, not transmitted over the internet;
• Underlying audio data is neither recorded nor stored;
• The system does not attribute conversation content to specific individuals, and summaries automatically filter out sensitive information such as financial or personal identities.

These features currently support only English and remain in the testing stage.

This update also brings a redesigned health app in iOS 27.3, with noticeably expanded functionality.

The new version introduces an “Insights” tab to monitor fitness metrics such as heart rate, vital signs, and steps. The “Longevity” tab provides more detailed information about heart, hearing, exercise, metabolism, and mental health. Additionally, the new “Health Age” feature can estimate a user’s physiological age based on their health data.

Apple notes that many of these features were already available on competing platforms like Whoop and Oura. Integrating them into the native app is aimed at strengthening Apple’s competitiveness in health management within its ecosystem.

The test version currently released is available to developers, and Apple typically offers a public beta to general consumers later on.

In addition to iPhone and Apple Watch systems, Apple has also released the first beta versions of macOS 27.3, tvOS 27.3, visionOS 27.3, and iPadOS 27.3. The official versions across all platforms are scheduled for release in December.