Abstract:
Apple announced to further expand the boundaries of Siri AI capabilities. With the release of the developer preview version of iOS 27.3, the company officially opened the Siri AI integration interface to third-party developers, allowing various applications to access the capabilities of a new generation of smart assistants, enabling them to understand natural language instructions, combine the user's personal context, and use the screen content awareness function to perform more complex tasks.
According to information released by Apple, developers can now introduce new features of Siri AI into their own applications. Through these capabilities, Siri can not only understand the user's daily expressions, but also complete the request based on the current interface status and personal usage habits, thereby reducing the user's steps of switching back and forth between multiple applications and manual operations.
A major focus of this update is the introduction of a new functional framework called "App Skills". With this mechanism, developers can integrate multiple operations that originally need to be completed separately into one instruction execution. Users only need to issue a natural language command, and Siri AI can automatically coordinate multiple steps and complete the entire process in the background.
Apple said that when users are using an app, viewing real-time activity information for the app, or already having a conversation with Siri about the app, they do not need to mention the app name repeatedly. The system automatically understands the current context. For example, after the user completes the ride-hailing application, he or she can directly say to Siri "Change my pick-up location to a new address", and the system will identify the relevant services and perform the operation.
In addition to operations within a single application, Siri AI also gains cross-application collaboration capabilities. It can search for content in one application and then pass the results to another application to complete the subsequent task. For example, users can ask Siri to find favorites in a shopping app and send them to designated contacts directly through the messaging app.
Apple also opens up more flexible content and operation interfaces to developers. Developers can decide which data is allowed to be accessed by Siri and which functions can be called. Relevant capabilities are implemented based on the App Intents framework and can be used without applying for additional special permissions or joining a new developer plan.
In order to improve AI's ability to understand application content, developers can also incorporate entity data in the application into the Spotlight semantic index, and help Siri understand user expressions more accurately through descriptions, attributes, and intent definitions. When users make requests using natural language, the system can combine this information to identify target content and generate more precise responses.
At the same time, Apple is also extending these enhanced capabilities to its own ecological applications, including calendar, documents, finder, journal, mail, map, messages, music, memos, photos, preview, reminders, Safari, shortcut commands, weather and other applications. In the future, users can directly ask Siri to find the coffee shop they visited last week, or automatically organize files that have not been opened for a long time without manual search and management.
It is worth noting that this means that Siri AI is gradually transforming from a traditional voice assistant to a truly intelligent agent. In addition to understanding questions and providing answers, it begins to have the ability to coordinate resources between applications, invoke functions, and complete practical tasks.
Currently, these new features are open to developers for testing through the iOS 27.3 developer preview. Apple is expected to further expand the scope of support in the future and continue to improve the deep integration capabilities between third-party applications and Siri AI to bring users a more unified and intelligent software experience.
Comments