Apple's New AI Tool Edits Photos Just By Talking to It

Word count: 752 Estimated reading time: 3 minutes

Apple recently introduced a AI tool called MGIE that enables photo editing through simple conversation. Lets delve into the workings of this image editor and explore its implications for the future.

Introducing MGIE. The AI Photo Assistant

MGIE stands for "MLLM Guided Image Editing," with MLLM representing " language model." These systems encompass AI capabilities to comprehend and generate text, images, audio and more.

With the help of an MLLM brain MGIE processes instructions and applies them to edit photos. For instance by saying "enhance the blue in the sky " it will adjust the picture accordingly. Quite impressive isn't it?

Origin and Development of MGIE

Apple collaborated with researchers, from the University of California to develop MGIE. They showcased this AI photo editor at ICLR a conference focused on cutting edge advancements in intelligence.

The demonstration of MGIE exemplifies Apples commitment to advancing their work, in intelligence. The company intends to integrate features into their future products.

Understanding and Editing Photos; How does MGIE do it?

One of MGIEs abilities lies in its proficiency in comprehending natural language instructions accurately.

When you provide editing instructions the AI breaks them down into steps. For example if you say "make the sky more blue " the AI understands that it needs to adjust the saturation of the sky area by 20%. This process allows for seamless photo editing.

If you want to try MGIE yourself Apple has made it available, as an open source tool on GitHub. You can access the code. Start using it for your projects.

Additionally there is a demo on Hugging Face Spaces where you can experiment with editing photos using text commands. It's a way to see MGIE in action!

Looking ahead MGIE provides us with a glimpse of how AI could revolutionize image editing. Of relying on menus and controls we may be able to simply describe the changes we want in plain English.

Imagine how this could make photo editing more accessible, to an audience. Classrooms could teach image editing skills through voice commands and even individuals who struggle with apps could edit images using instructions.

There have been some rumors going around that suggest Apple might include MGIE in their iOS 18 update. The fact that they are releasing it hints at Apples commitment, to integrating AI into their products. We'll just have to wait and see!

Apples Strengths in AI

The introduction of MGIE demonstrates Apples growing expertise in intelligence. In addition to publishing AI research Apple has been recruiting experts from labs worldwide.

With breakthroughs like MGIE Apple is solidifying its position as a pioneer in leveraging AI technology. They used to lag behind competitors when it came to technology. Now they're proving they can lead the way. Exciting times lie ahead!

The Wider Implications

At its core MGIE represents an advancement in AI capabilities. By mastering language and image processing this tool has the potential to make complex photo editing accessible to all. The possibilities for enhancing creativity through AI are now wide open.

Course there is always room for improvement. MGIE still makes errors when interpreting instructions and applying edits. However Apples commitment to openly sharing its research will drive progress.

What are your thoughts on using speech, for AI based image editing? I'd love to hear your perspective! Feel free to ask me any questions.

Sources:

[1] https://www.macrumors.com/2024/02/07/apple-ai-model-edits-images-natural-language/ 

[2] https://www.patentlyapple.com/2024/02/apple-has-released-mgie-a-revolutionary-ai-model-for-instruction-based-image-editing.html 

[3] https://bgr.com/tech/apples-first-public-ai-release-ahead-of-ios-18-is-a-ground-breaking-image-editing-model/ 

[4] https://www.theverge.com/2024/2/7/24065125/apple-generative-ai-image-editing-mgie-open-source-model

[5] https://venturebeat.com/ai/apple-releases-mgie-a-revolutionary-ai-model-for-instruction-based-image-editing/

[6] https://appleworld.today/apple-releases-mgie-an-ai-model-for-instruction-based-image-editing/

[7] https://indianexpress.com/article/technology/artificial-intelligence/apple-mgie-image-editing-model-release-9151106/

[8] https://www.engadget.com/apple-releases-an-ai-model-that-can-edit-images-based-on-text-based-commands-081646262.html?_guc_consent_skip=1707428061 

[9] https://www.tomsguide.com/ai/look-out-photoshop-apple-releases-image-editing-ai-model

[10] https://apple.slashdot.org/story/24/02/07/1536238/apple-releases-mgie-an-ai-model-for-instruction-based-image-editing 

[11] https://macdailynews.com/2024/02/07/apple-and-university-of-california-release-mgie-ai-based-image-editing-tool/

[12] https://tech.hindustantimes.com/how-to/apple-introduces-mgie-ai-model-for-image-editing-know-how-to-use-it-and-what-it-can-do-71707366592841.html 

[13] https://www.smartprix.com/bytes/apple-rolls-out-ai-based-image-editing-tool-mgie/ [14] https://au.news.yahoo.com/apple-releases-an-ai-model-that-can-edit-images-based-on-text-based-commands-081646262.html

AI Insight | AI Quick Takes | RoboReports | TutorialBots | RoboRoundup | GadgetGear

This site contains product affiliate links. We may receive a commission if you make a purchase after clicking on one of these links.