Apple has taken a significant step toward deeply integrating artificial intelligence into daily life, but this has also sparked privacy concerns.
On Tuesday, Apple officially released the first beta versions of iOS 27.3 and watchOS 27.3 to developers, featuring an always-on AI audio listening tool and a completely redesigned Health app. The full release is expected to roll out to users in December.
The AI audio feature was unveiled at the product launch in September and can use your device's microphone to track and analyze surrounding conversations in real time, summarizing key points.
This technology potentially violates wiretapping laws in multiple U.S. states and reignites public concerns about the privacy implications of tech devices collecting everyday data.
On Tuesday, Apple closed down 1.9%.
Audio AI Features: Balancing Convenience and Privacy
In this beta release, the AI audio feature is the most anticipated and also the most controversial new feature, currently supported only on the Apple Watch Series 12 and Ultra 4.
The specific features include two items:
- Siri Recap automatically organizes key topics from nearby conversations into bullet-point lists, functioning similarly to third-party transcription apps like Granola and Otter.
- Live Rewind allows you to review and display a text transcript of the past 15 seconds of conversation; Apple's example use case is speaking with a server at a restaurant, eliminating the need to ask them to repeat themselves.
However, the legal risks associated with such features cannot be ignored. In the United States, eavesdropping laws in some states require all parties to a conversation to consent to recording, creating a potential conflict with Apple’s “ambient listening” mode.
Meanwhile, as Meta Platforms and other tech companies roll out AI devices with recording and video capabilities, public concerns about privacy intrusion by tech products into daily life continue to grow, and Apple’s move is certain to further intensify this debate.
In response to the above controversy, Apple emphasized several privacy-preserving design features:
- When the user invokes Live Rewind, the device emits an audible alert;
- Audio processing is completed on the local device and is not transmitted over the internet;
- The underlying audio data will not be recorded or stored;
- The system will not attribute conversation content to any specific individual, and summaries automatically filter out sensitive information such as financial data and personal identification details.
The above feature currently supports only English and is still in testing.
The health app has been fully upgraded, directly competing with products like Whoop and Oura.
This update also brings the redesigned Health app from iOS 27.3, with significantly expanded functionality.
The new app version adds an "Insights" tab to monitor fitness metrics such as heart rate, vital signs, and step count; the "Longevity" tab provides more detailed information on heart, hearing, exercise, metabolism, and mental health. Additionally, the newly introduced "Health Age" feature estimates your physiological age based on your health data.
Apple noted that many of these features were previously available on competing platforms such as Whoop and Oura, and their integration into native apps aims to strengthen Apple's competitive edge in health management within its ecosystem.
The current released beta is open to developers; Apple typically follows up with a public beta for general consumers.
In addition to iOS and watchOS, Apple has also released the first beta versions of macOS 27.3, tvOS 27.3, visionOS 27.3, and iPadOS 27.3. The full releases for all platforms are planned for December.