New technology will allow iPhone 11 users to take video and automatically remove the background using AI-based depth analysis.
It was developed by Spektral, a Danish company that has managed to analyze video at 60 frames per second using machine learning and computer vision. According to Spektral, the tech “combines deep neural networks and spectral graph theory with the computing power of modern GPUs [which] can process images and video from the camera in real-time directly on the device.”
Now, a new iOS 13 beta has confirmed that this AI background removal tool will be coming inside the operating system. This will allow apps like Instagram, Snapchat, and Apple’s own camera app to swap backgrounds and play with 3D elements that could go in front or behind a subject in real time… Other camera upgrades include an expected three lenses on the iPhone 11 Pro models, and that ultra-wide camera will let you shoot three pictures at once in order to create the ideal shot.
MacDailyNews Take: Check out the video below from Spektral, which Apple acquired in December 2017 and about which we wrote, “Yes, Apple’s interest in augmented reality remains high. We’d guess that the tech would be/already is useful in the Camera app’s Portrait Mode, iMovie, Clips, etc.”
Over two years of advancements has been made since this video was released on May 31, 2017:
iPhone 11 is going to be all about the camera(s) and that’s going to sell a lot of units to people who thought they might be waiting until next year’s 5G iPhone.
Smart Frame is going to be a tent pole feature. Expect this batch of iPhones, the last one prior to the start of the iPhone 5G super cycle in late 2020, to focus on the triple camera array, Smart Frame, and other camera-related features as the main selling point. — MacDailyNews, August 12, 2019