At its Max conference, Adobe showcased experimental AI tools that offer a new approach to editing photos, videos, and audio. Known as ‘sneaks,’ these tools demonstrate remarkable capabilities, such as editing entire videos with changes made to just one frame.
One standout project, Frame Forward, eliminates the need for manual masking in video editing, enabling swift object removal and replacement across an entire video. This tool leverages AI to identify objects, seamlessly remove them, and replace them with background elements, similar to Photoshop’s advanced features.
Additionally, users can now insert objects into videos by sketching their desired locations and providing simple AI instructions. The AI ensures these additions blend seamlessly into the video context, as demonstrated by a dynamically generated puddle that accurately reflects the movements within the scene.
Another innovation, Project Light Touch, redefines lighting manipulation in photos. Using generative AI, this tool empowers users to alter light sources, create realistic lighting effects, and even transform day scenes into night settings. The AI-driven control over light diffusion and color adjustments opens up a realm of creative possibilities for photographers and editors.
Overall, Adobe’s experimental AI tools showcase the potential of AI in revolutionizing the editing process, making complex tasks simpler and offering creative enhancements beyond traditional capabilities.
Source: The Verge