Meta AI can now understand and edit your photos
Meta AI is starting to close the gap with Google in AI-driven photo editing. During the Meta Connect 2024
Meta AI is starting to close the gap with Google in AI-driven photo editing. During the Meta Connect 2024 event on Wednesday, the company revealed new capabilities that allow Meta AI to assist with photo editing and provide answers related to the images you upload.
These enhancements are due to Meta AI's new multimodal capabilities, powered by the Llama 3.2 models. This advancement allows users to share photos, not just text, in their chats—similar to what Google Gemini and OpenAI’s ChatGPT offer.
When you share a photo, Meta AI can recognize its content and respond to questions about it. For example, you could upload a picture of a flower and ask the AI to identify it, or share a photo of a meal and inquire about the recipe. The accuracy of Meta AI’s responses, however, remains to be fully tested and evaluated.
Another major feature with the new photo support is the ability to edit images using AI.
Once you send a photo to Meta AI, you can request various changes—such as adding or removing an object from the foreground, changing your outfit, or altering the background. For instance, you could ask it to add a rainbow to the sky or make other creative adjustments.
Meta AI can also be utilized on Instagram when you reshare a photo from your feed to your Instagram Stories. In this case, the AI analyzes the image, understands its content, and can generate a complementary background to enhance your Story.
Beyond photo edits, Meta is also testing translation tools for Facebook and Instagram Reels that include automatic dubbing and lip-syncing. These tests will initially be run in small groups in the U.S. and Latin America in both English and Spanish.
Beyond photo edits, Meta is also testing translation tools for Facebook and Instagram Reels that include automatic dubbing and lip-syncing. These tests will initially be run in small groups in the U.S. and Latin America in both English and Spanish.
Meta AI can also be utilized on Instagram when you reshare a photo from your feed to your Instagram Stories. In this case, the AI analyzes the image, understands its content, and can generate a complementary background to enhance your Story.
Other features of Meta AI related to photo capabilities include an expansion of its generative AI functionalities and the initiation of tests for Meta AI images shared on Facebook and Instagram feeds, encouraging users to explore this feature.
During the demonstration, it was highlighted that the editing capabilities will first be available in English in the U.S.
Meta CEO Mark Zuckerberg emphasized at the event, “Meta AI sets itself apart in this arena by not only providing advanced AI models but also offering unlimited free access to these models, seamlessly integrated into our various products and applications. As a result, Meta AI is on track to become the most widely used AI assistant globally by the end of this year. In fact, we might already be there, with nearly 500 million monthly active users, even before launching in some of the larger countries.”
Recent Post
Instagram has introduced a new option to add music tracks to Notes.
Meta has rolled out new updates for EU advertisers to comply with evolving regulations.
Meta and Microsoft have joined a new framework focused on the responsible use of AI.
