In the ever-evolving world of photography and image editing, Apple's latest iOS update brings an intriguing twist with its Photos app. The introduction of generative AI tools, such as the Extend feature, showcases Apple's commitment to enhancing the creative process for photographers. But is it a game-changer, or just a clever gimmick?
The Power of AI in Photography
Apple's Clean Up tool, which has been around since iOS 18, paved the way for a new era of image editing. It allows users to remove unwanted elements and fill in the gaps intelligently, a feature that has now evolved into the Spatial Reframe tool. With Extend, Apple takes this concept further, generating elements beyond the original frame.
Extending Creativity
The Extend tool offers photographers a unique way to alter the composition of their shots. It's not just about cropping; it's about expanding the image's narrative. By analyzing surrounding pixels and the image's context, Apple Intelligence generates content to fill the void, creating a seamless extension of the original scene.
For instance, in a test image of a cat on a windowsill, Extend added more curtain and plants, even creating condensation on the window. While the window frame detail was incorrect, the overall effect was aesthetically pleasing.
The Fine Line Between Reality and Imagination
The main goal of Extend is to create visually appealing additions to the image, not to replicate reality perfectly. It must guess what could be in the extended space and generate something plausible. This is where the tool's strength lies—in its ability to enhance, not replicate.
In a test with a street corner and castle scene, Extend added bollards and poles, mostly fitting the scene. However, a road sign's back and a pole's placement seemed off, highlighting the tool's occasional missteps.
Hallucinations and Real-World Comparisons
When testing Extend with a real-world scene—an Apple Store staircase in Rome—the tool added more stairs and glass, looking appropriate. In reality, there were doors and no extra steps, but Extend's guesswork was close enough to be convincing.
However, in a shot of an airport in Rome, Extend's hallucination of a floating truck revealed its limitations. Upon closer inspection, the truck turned out to be a movable conveyor for luggage, a detail the AI couldn't accurately interpret from the small fragment of the vehicle in the original image.
The Future of AI-Assisted Photography
Extend is a logical progression from Apple's previous AI tools, offering a reasonably good performance. While it can go awry, especially if unusual elements are present in the original shot, it generally delivers on its promise of enhancing images. As long as users don't expect perfection and are content with 'good enough' additions, Extend is a welcome addition to the photographer's toolkit.
In my opinion, Apple's foray into generative AI for photography is an exciting development. It opens up new creative possibilities and challenges traditional image editing norms. While it may not be perfect, it certainly adds an element of fun and experimentation to the photography process. Personally, I think it's a step in the right direction, pushing the boundaries of what's possible with AI-assisted creativity.
