Apple Introduces AI-Powered Photo Clean-Up Tool in iOS 18.1 Beta

iOS 18.1 adds new Apple Intelligence 'Clean Up' tool: 3 things it can do for your photos

Apple dropped the iOS 18.1 beta 3 for developers -- and it added a new Apple Intelligence feature to the mix: the AI-powered Clean Up tool. We've all been there. You take a photo, you're excited to share it with friends or post it on social media, but there's just one little obstruction that diminishes the photo's visual appeal. Maybe it's an awkward photobomber -- or perhaps there's an unsightly thingamajig that's stealing the spotlight. In these situations, Apple Intelligence is here to swoop in and save the day. The iOS 18 Clean Up tool, similar to Google's Magic Eraser feature, is designed to help get rid of unwanted objects in your photo to enhance the overall quality of the image. Here are three things it can do: Users can use the Clean Up tool in the Photos app. Once you spot an undesirable object in an image, you can tap or circle it, prompting the AI to detect it, so you can remove it. You can also zoom in on photos to finely retouch tiny blemishes. One other Apple Intelligence feature the Cupertino-based tech giant added to the new iOS 18.1 update is notification summaries. Before, notification summaries only supported the Mail and Messages app. Now, it can summarize notifications from all of your apps. Check out some of the other AI-powered features in our Apple Intelligence roundup. Just keep in mind that this is a beta, so it's expected to be a little rough-around-the-edges. Make sure that you have an iPhone backup before installing iOS 18.1 beta 3. The official version of iOS 18 is expected to roll out later this year after Apple announces the iPhone 16 at its "Glowtime" Sept. 9 event.

Apple Intelligence's Photo Clean Up feature arrives in iOS 18.1 betas

The latest developer beta of iOS 18.1 brings with it Clean Up for Photos, an Apple Intelligence feature that can remove unwanted elements from photographs. One of the main features of Apple Intelligence at the time of its announcement was the ability to use AI to remove items from photos. On Wednesday, it finally became something developer beta testers could try out. Included in the developer betas of iOS 18.1 and iPadOS 18., the Photos feature is available within the Photos app. It appears as a new option when you go to edit a photograph, with the name Clean Up. The function takes advantage of the generative AI capabilities of Apple Intelligence. After selecting an object, the feature then fills up the now-empty pixels in an image to match the rest of the scene. On first usage, you're advised to with tap, brush, or circle the item you want to remove from the image. It also has to download the Clean Up function to the iPhone or iPad before it works. Depending on the technique, you can achieve different results with Clean Up. If you use your finger to brush over the image and surrounding elements, it will handle the specifically-drawn area completely. While you can go over the edges of the object and those elements will be removed, you could also brush over part of the object for the tool to partially hide a subject. Going for the looping technique engages the object detection elements of the feature, with it singling out what it thinks you've circled for removal. In initial testing of the feature by AppleInsider, it has been shown to accurately detect the unwanted elements from the scene. Filling the void also works well, though it can be tripped by things like shadows. Clean Up can also automatically highlight objects in a scene that you may want to remove. In those cases, a simple tap will eradicate them from the scene. As with all edits in Photos, the changes can all be reverted back to a previous state, without damaging the original image. While Apple will be introducing the iPhone 16 on September 9, buyers won't be able to try out the Clean Up function in Photos right away. Aside from enrolling in the developer beta, users may have to wait until the iOS 18.1 update before they can get rid of photobombers and other unwanted imaging artifacts.

iOS 18.1 Beta 3 Brings AI-Powered 'Clean Up' Tool in Photos App

Apple released the third developer betas for iOS 18.1, iPadOS 18.1, and macOS 15.1 Sequoia. The update brings one of the much-awaited Apple Intelligence features to the Photos app. The AI-powered 'Clean Up' tool can identify and remove distracting objects from a photo while keeping the subject intact. The Clean Up tool appears as a new option (eraser-style icon in the bottom toolbar) when you edit an image in the Photos app. Apple says Clean Up uses advanced detection and multiple machine learning models to identify distractions, locate the edges of unwanted objects, and seamlessly replace them. The Clean Up tool can intelligently detect unwanted objects in an image and remove them without affecting the overall picture. You can also tap, brush, or circle, over an unwanted object to remove it. This feature uses AI to generate a complementing background when you remove an object from a picture. Apple said that the Clean Up tool identifies even shadows or reflections of an object and takes care of it while filling in the background. You can also zoom in on an image and use your finger as a brush to remove smaller blemishes and fix other minute details of the image. The tool is intelligent enough that it won't remove part of a person or the main subject even if you've selected it. It's worth knowing that the Apple Intelligence Clean Up tool works on all images in the Photos app, including older images and pictures captured by another phone or a DSLR camera. Apple's Clean-Up tool is similar to Google's Magic Eraser feature that's available for free to all Google Photos users. The AI-powered Clean Up tool is available in the third beta of iOS 18.1, iPadOS 18.1, and macOS 15.1 Sequoia, which is now available for developers. If you've got an Apple Intelligence-supported device, You can get your hands on this tool once Apple rolls out the stable, public version of its OSes. If you wish to try this feature right now, here's how to install iOS 18 developer beta and macOS Sequoia developer beta. Besides the Clean Up tool, the new iOS 18.1 developer beta brings Apple Intelligence-powered notification summaries for additional apps beyond Mail and Messages.

Apple introduces AI-powered object removal in photos with the latest iOS update | TechCrunch

Apple released the new developer betas for iOS 18.1, iPadOS 18.1, and macOS 15.1 Sequoia. With this update, the company is launching new Apple Intelligence features including the ability to remove objects from photos. The feature, called Clean Up, lets users identify and remove an object from the photo without effecting the picture. The system uses AI to generate background when you remove an object from an image. Apple said that the system understands even shadow or reflection of an object and handles it while filling in the background. Users can select an object using the smart detection feature to remove it with just one tap. People can also circle or brush over any unwanted objects to delete them from the image. Apple's rival Google made a similar feature called Magic Eraser available to all Google Photos users for free earlier this year. In July, Apple rolled out the first set of Apple Intelligence features with iOS 18.1 dev beta. These features included writing tools, notification summaries for SMS and Mail, natural language search and memory creation in Photos, transcription for calls and voice recordings in notes, and summaries and smart replies feature in Mail. Apple Intelligence is only available to users in English with their region set to the U.S.

iOS 18.1 beta adds photo 'Clean Up' AI tool and notification summaries - how they work

If you have access to Apple's IOS 18.1 developer beta, you can now try out Clean Up, a new feature that removes unwanted people, places, and other objects from your photos. Also: Why you shouldn't buy the iPhone 16 for Apple Intelligence Available in the third beta rolled out on Wednesday, the new photo clean-up tool takes a page from Google's Magic Eraser by letting you eliminate an unwanted element from a photo just by wiping it away. The editing feature is part of Apple Intelligence, the company's on-device artificial intelligence (AI) technology that the company is gradually adding to the iPhone, iPad, and Mac. Clean Up uses AI to analyze an object and its surrounding area. The challenge is to remove the unwanted item and fill that empty area with the adjacent pixels. Though it sounds great, this type of trickery can be hit or miss. The success depends on the edges around the object. If the outline is distinct and easy to separate, then the odds are good that the results will look seamless. If not, you could end up with remnants of the erased object, such as a floating head without a body. Also: Why Claude's Artifacts is the coolest feature I've seen in generative AI so far In a post on X, Bloomberg writer and Apple expert Mark Gurman said he was unimpressed with the clean-up tool, noting that so far it feels a bit "raw and underwhelming" and "not very good". However, some X users who responded to Gurman's post were pleased with the results, especially for a tool still in early beta mode. Beyond the clean-up option, the latest iOS 18.1 beta taps into AI to provide summaries of your notifications. Initially available only for the Mail and Messages app, this feature can now summarize notifications from all your apps, according to MacRumors. A new Apple Intelligence setup that takes you through some of the new features helps you with the settings for the notification summaries. Also: I tested the viral 'tangle-free' USB-C cable, and it's my new travel backpack essential You can choose to get the summaries for all apps or just certain ones. Your device then displays the key details of your summaries so that you don't have to read them all. As the Settings app explains: "Summarize content in direct messages and groups of notifications, making them more succinct and easier to read. Summary accuracy may vary based on content." At this point, developers with access to iOS 18.1, iPadOS 18.1, and MacOS Sequoia 15.1 can opt into the new Apple Intelligence features or remain on the standard developer beta track. However, you'll need the right type of device to access the developer beta. For iOS, that means an iPhone 15 Pro or 15 Pro Max. For iPadOS or macOS, that means a device with an M-series chip. Also: Why the NSA advises you to turn off your phone once a week Apple's next iPhone event is slated for September 9, which means iOS 18 and other OS updates will likely launch by the end of the following week. However, with so much riding on the new AI capabilities, the company has also been testing iOS 18.1 with built-in Apple Intelligence. Reports say that version 18.1 should roll out sometime in October. But even then, Apple will continue to add new features to its AI technology into 2025.

See the Apple Intelligence Photos App 'Clean Up' Tool in Action

Apple today provided developers with the third beta of iOS 18.1, and it adds Clean Up, a new Apple Intelligence tool created for the Photos app. With Clean Up, you can remove unwanted objects from your photos, but its performance is hit or miss right now. You can tap on the highlighted object to remove it, and it works like magic. If there isn't something automatically highlighted, don't worry, you can circle or scribble on any object in the photo to use Clean Up on it. With the automatically highlighted objects, Clean Up works well. Apple has already done all the work in the background to find depth information and to calculate the fill the object should be replaced with. When you're selecting your own objects, it can be a little more difficult to get a clean look. Clean Up works best when there's a clear, uncluttered background behind the object that you want to remove, and the smaller the object the better. Trying to remove a whole person from the foreground of image (such as in a group shot) with a lot going on in the background doesn't work super well, but it's really more designed for small, unwanted objects in the background of images anyway. You can go through multiple iterations of Clean Up to try to get it to look better, and to remove small areas, just zoom in and then circle. Clean Up can't be used on Live Photos, and when you use Clean Up, it turns off Live Photos. You can turn Live Photos back on, but then you lose the Clean Up edit. You also can't use Clean Up on videos, but it does work on all other kinds of images, including screenshots, old photos, and photos you didn't take with your iPhone. For quick edits on an iPhone, Clean Up works well. It's not on par with some other desktop tools at this time, but Apple will undoubtedly make improvements going forward. Also, when you use Clean Up, a note is added to the metadata that lets you know that an AI edit has been made, so people will be able to see that it's been modified. All Clean Up edits are reversible, so if you want to get back to your original image, you can revert at any time. Along with Cleanup, iOS 18.1 beta 3 adds a couple of other features. The notification summary feature that was previously working for Mail and Messages now works for all of your apps, so you can see summaries of both multiple incoming messages and single notifications, giving you more information at a glance. Also, in the Messages app, you can now use third-party stickers in-line like emoji. This was a feature in prior betas, but it only worked with stickers from Apple apps and stickers you created from photos.

iOS 18.1 Adds Photo Clean Up & More Apple Intelligence

Apple's latest developer beta, iOS 18.1, is set to transform the way you interact with your photos and notifications. This new beta brings a range of new features, with a particular emphasis on advanced photo cleanup capabilities and enhanced Apple Intelligence summaries. These tools aim to streamline your digital life, making it easier to manage your images and stay on top of important information. The video below from Stephen Robles gives us a look at the new Photo Clean Up feature and also more information on Apple Intelligence in iOS 18.1. Unleashing the Power of Photo Cleanup The crown jewel of iOS 18.1 is undoubtedly the innovative photo cleanup tool. This feature empowers you to effortlessly remove unwanted subjects from your photos with just a few taps, brushes, or circles. By harnessing the power of innovative photo AI technology, the tool intelligently fills in the background where subjects have been removed, creating a seamless and natural-looking image. While the photo cleanup tool excels at handling photos with a limited number of subjects, it may encounter some challenges when dealing with larger groups. Nevertheless, this feature represents a significant leap forward in mobile photo editing, providing you with unprecedented control over your images. Streamlining Notifications with Apple Intelligence Summaries In addition to the photo cleanup tool, iOS 18.1 introduces enhanced Apple Intelligence summaries. This feature provides you with concise and informative summaries for text messages, emails, and notifications from various apps. By allowing these summaries in the notification settings for all apps, you can stay informed without feeling overwhelmed by a constant barrage of notifications. Apple Intelligence summaries are particularly useful for apps like Slack and Microsoft Teams, which often generate a high volume of notifications. With these summaries, you can quickly grasp the essential information without having to read through entire threads or messages, saving you valuable time and mental energy. Enhancing Your Podcast Experience iOS 18.1 also brings improvements to the Apple Podcasts app, introducing enhanced chapter markers that provide both visual and haptic feedback. This feature allows you to easily navigate through your favorite podcasts, making it simpler to find specific segments or moments within an episode. Availability and Release It is important to note that the photo cleanup feature and Apple Intelligence summaries are currently part of the iOS 18.1 Developer Beta 3. These features are expected to be made available to the general public later in the year, giving developers ample time to test and refine them before the official release. iOS 18.1 represents a significant step forward in mobile operating systems, focusing on enhancing your user experience through improved photo editing capabilities and more efficient notification management. By leveraging advanced AI technologies and intuitive design, Apple aims to simplify and streamline your digital life, allowing you to focus on what matters most.

iOS 18.1 Beta Update Brings Apple's AI 'Magic Editor' Feature To Clean Up Photos - News18

iOS 18.1 will bring the Apple Intelligence features to select iPhone models and the new iPhone 16 series later this year. Apple is planning to bring its Artificial Intelligence (AI) features with the iOS 18.1 version in the coming months and with the beta version already out, people are getting a closer look at what it offers. Apple has introduced its own version of Google's Magic Editor AI feature that helps with photo editing in a new avatar and it is called Clean Up. You can use this feature to remove unwanted items or subjects from an image after clicking it. Apple is also bringing the AI feature into its Photos app for iPhone users iOS 18.1 beta gives you a clear look at the new AI editing feature that promises to remove distractions. For instance, if you have a pole or an unwanted person in a photo, use the Photos app and Clean Up will get the job done. To remove the object you just have to click on the Clean Up icon and then circle the subject that you want the AI feature to remove and make sure the clean up is nice and tidy and you don't notice any editing done to the image. The Clean Up feature is available to iOS 18.1 beta 3 version but only for those with the iPhone 15 Pro or higher models in the US for now. You can also try out with the macOS beta and iPadOS beta versions running on the M1 Macs or iPads. Google introduced the Magic Editor with the Pixel series a few years back and this year's Pixel 9 series gets more Gemini AI-powered features that take it closer to the upcoming iPhone 16 lineup that will support AI features with the iOS 18.1 update coming out in October.

iOS 18 developer beta 3 brings one of the best Pixel features to iPhone -- here's how to try it out

Apple just launched a new set of Apple Intelligence features on August 28 via the iOS 18.1 developer beta 3 release. And one of these new features, in particular, may sound familiar to Pixel users. I'm talking about the new 'Clean Up' feature in Apple Photos, which very closely resembles Magic Eraser in Google Photos. Both features are available to use directly in the phone's photos app and can remove unwanted people or objects from a photo. When using Clean Up on a photo, your iPhone will try to auto-detect what you may want to remove first, but those testing the feature out say it's easy to undo and redo edits or manually select objects, people, or areas you want AI to edit. Although this is yet another case of "Apple brings this feature Android users already have," at least it's only a few months later, not years. Pixel users have had the Magic Eraser tool since 2021, but Android users, in general, have only had the feature starting this year. Although Apple Intelligence is only available on the iPhone 15 Pro and 15 Pro Max currently, but that's sure to change on September 9. In addition to the Clean Up tool in Apple Photos, the iOS 18.1 developer beta 3 also includes notification summaries for more apps than just Mail and Messages, calling out key details for specific apps on your lock screen. Although the iOS 18.1 developer beta 3 is meant to target developers specifically, anyone who registers with Apple's developer website can download the beta for free -- here's how. It's possible to download the iOS 18.1 developer beta 3 as a non-developer as long as you have an iPhone 15 Pro or iPhone 15 Pro Max and you've registered with Apple's developer website. However, it's not recommended to do so if you're an end user and the iPhone 15 Pro or Pro Max you're using is your sole iPhone. If you meet the requirements mentioned above, here's how to download the iOS 18.1 beta 3: If you only have a single iPhone 15 Pro or Pro Max for personal use, consider downloading and installing the newly released iOS 18 public beta 6 instead, which Apple made available at the same time as the iOS 18.1 dev beta 3. You can sign up for Apple's Beta Software Program for free to access the iOS 18 public beta 6. Make sure you're signed in with the same Apple ID you signed up for the Beta Software Program with, and then head to Settings > General > Software Update. Enable Beta updates, and then select the iOS 18 Public Beta. Or, you can wait a little while longer for iOS 18 to officially debut its final release version at (or shortly after) Apple's September event. If you're curious to see what iOS 18 looked like earlier this month, check out our hands-on with iOS 18 public beta 3.

iOS 18.1 labels images edited with Clean Up in the Photos app

Apple on Wednesday released the third beta of iOS 18.1 with Apple Intelligence, and this one added the Clean Up feature to the Photos app. For those unfamiliar, Clean Up lets users delete objects and people from a photo using AI. To avoid controversy, the system will label photos edited with Clean Up - but most users probably won't even know about it. Unlike other AI tools for editing images, Apple's Clean Up can only be used to remove people or objects from photos. There's no way to add new elements or modify things like a person's appearance. Still, removing someone from a photo can be enough to change its meaning, and we've seen a lot of controversy recently when it comes to AI-generated images. As promised by Apple's VP of software engineering Craig Federighi, iOS 18 will label images generated or edited by Apple Intelligence - and this applies to the Clean Up feature. Those running the latest beta of iOS 18.1 will notice the new label in the additional information shown by the Photos app. When you see a photo that has been edited with Clean Up, the app shows that it has been "Modified with Clean Up." This is certainly a way of letting users know about a modified image, but it's also super easy to miss the label. First, only Apple devices running iOS 18.1 beta 3 or macOS 15.1 beta 3 currently show the Clean Up label in the Photos app. The photo's EXIF data does indeed include the label "Apple Photos Clean Up," but this requires using a computer or special software to find this information. Sending the photo via AirDrop or iMessage will keep the Clean Up label in the EXIF data, but sending it via apps like WhatsApp and Telegram won't. Of course, this is the first beta with Clean Up, and Apple still has some time to make this information more visible to users. More importantly, the company should provide a way for third-party apps to detect and keep this tag on photos.