Google is bringing a slew of new features to AI mode, positioning the update as a way to help students prepare for exams or learn more. today,The company announced, now users can upload images to the desktop AI mode and ask questions about what they see, whether it’s a math problem for homework or a plant they want to learn more about.
In May of this year, Google built an AI model into its search service in the United States, which can search the web and summarize search results for users. Users can also ask follow-up questions and interact with the tool. Google rolled out the ability to upload images to AI Mode during testing in April; adding it to the desktop version could make it easier for students to get help with ongoing projects or assignments.
Other changes coming soon include a live camera sharing test in AI mode, which builds on its existing Search Live feature. Now, users can not only have a voice conversation with a customized version of Gemini in AI mode, but they can also point the camera at anything they have questions about and ask questions out loud. This feature will be available soon to U.S. mobile users who opt in to the AI Patterns Labs experiment.
Additionally, Google is trying to make it easier for users to access Lens in Chrome by showing a new "Ask Google for this page" option when they click on the Chrome address bar. When the user selects this option, the tool will allow the user to select what to search for on the page and then generate an AI overview directly in the browser sidebar. Google also plans to allow users to ask additional questions about Lens responses by selecting "AI Mode" at the top of Lens results or "Drill Down" at the bottom of the AI overview.
Chrome will soon show a "Ask Google for this page" option in the address bar.
Additionally, Google will start allowing users to upload PDFs to AI Mode and extract files from Google Drive. The company is also testing Canvas in AI mode on the desktop.
Google first launched Canvas in Gemini in March this year as a workspace where users can request help from Gemini to improve their writing, develop apps, create games, generate interactive quizzes, and more. Bringing Canvas into AI mode can help students create study guides by integrating information from the Canvas sidebar and allow them to adjust their output in real time by adding additional questions, the company's announcement said.
Canvas can help students create study guides and more.
Canvas in AI mode will be available to U.S. desktop users experimenting through Search Labs in the coming weeks.