• The Deep View
  • Posts
  • Why iPhone photography is Apple's biggest AI win

Why iPhone photography is Apple's biggest AI win

Welcome back. AI agents are giving hackers a major speed boost, with Google’s latest threat report showing autonomous systems already scanning infrastructure, harvesting credentials, and compressing attacks into hours. Meanwhile, Arm is trying to bring more order to robotics and physical AI with a shared framework that could solve fragmentation and help the industry scale. And ahead of this week’s new iPhone unveiling, I look back at Apple’s strongest AI success story: photography. For a decade, Apple has used AI and ML to quietly improve the camera, offering a blueprint for how it could lead in AI. Jason Hiner

IN TODAY’S NEWSLETTER

1. Why iPhone photography is Apple's AI blueprint

2. Arm wants to make robots speak one language

3. Google threat report flashes ominous security signs

CONSUMER

Why iPhone photography is Apple's AI blueprint

Nothing has transformed iPhone photography more over the past decade than machine learning and artificial intelligence. 

The combined power of software and Apple silicon has enabled tiny photography lenses and minuscule camera sensors to take photos that defy the laws of physics. While early iPhone cameras were good for wide-angle shots of nearby subjects in full daylight, over the years Apple has advanced the cameras to take more and more shots traditionally reserved for professional DSLRs and mirrorless cameras: from low-light night shots to zoom photography to macros to full-bokeh portraits. And nearly all of it is due to ML and AI. 

In fact, iPhone photography is arguably Apple's greatest AI success story, and it's a clue for how Apple will likely continue to implement AI in the future: by quietly making features you use every day a lot better. 

As we prepare for the unveiling of the next iPhone this week, here's a quick recap of the AI and ML features that have launched on the iPhone throughout the years:

  • 2016: iPhone 7 Plus, iOS 10, Photos app - Portrait Mode with ML-powered subject separation; AI-powered people, object, and scene recognition as Memories in the Photos app

  • 2017: iPhone X (2017) - Portrait Lighting, ML-powered front-camera Portrait Mode

  • 2018: iPhone XS (2018) - Smart HDR, ML depth segmentation, adjustable Depth Control

  • 2019: iPhone 11 (2019) - Night mode, Deep Fusion, ML-powered Smart HDR

  • 2020: iPhone 12 Pro (2020) - Smart HDR 3, expanded Deep Fusion and Night mode

  • 2021: iPhone 13, iOS 15, Photos app (2021) - Photographic Styles, Smart HDR 4, Cinematic mode, Live Text, Visual Look Up

  • 2022: iPhone 14, iOS 16, Photos app (2022) - Photonic Engine, subject lifting from photos

  • 2023: iPhone 15 (2023) - Automatic portrait detection, next-gen Smart HDR

  • 2024: iPhone 16, iOS 18, Photos app (2024) - Next-generation Photographic Styles, Clean Up, natural-language search, create your own movies in Memories from prompts

  • 2025: iPhone 17 - AI-powered Center Stage to automatically reframe group selfies, updated Photonic Engine that uses ML to improve detail, noise, and color

It's important to note that Apple approaches AI and ML from a different lens than competitors like Samsung, Google, and Chinese manufacturers like Huawei. While competitors use generative AI more broadly to add things to an image, such as adding yourself to a group shot, putting a different sky in the image, or making a partially eaten cupcake look uneaten, Apple is more of a purist when it comes to what is or isn't in the photo. 

Apple's VP of camera software engineering, Jon McCormack, has stated in multiple interviews over the years that Apple sees a photograph as a celebration of a moment that happened, and that it deserves our respect as such. 

This year, in iOS 27 with Spatial Reframing, which lets you shift the perspective that a photo was taken from, and Extend, which can use generative AI to expand the content on the edges of a photo, Apple is pushing the boundaries of that definition. Also, the upgraded version of Clean Up lets you remove larger objects, using AI-generated capabilities to fill in the scene. Apple still views all of these features as coherent with the idea of enhancing the shot you took, versus remixing it to create something that might be more akin to a work of art than a photograph.

Apple could still learn from some of its Android rivals on a few AI and ML features. Some basic AI photo-editing features could align with Apple's view of preserving the integrity of the shot you took while enhancing it to focus on the elements most important to you (similar to Clean Up). For example, I recently took a 10x zoom of a mountain lion at the zoo and then uploaded it to ChatGPT and asked it to "remove the fence in the foreground," which was a major distraction. The result was terrific, and I could see parents wanting to do something similar when taking photos of their kids at a soccer or baseball game and having to shoot a photo through a fence. That's the kind of super-smart AI feature that doesn't have to make a big deal about being AI but can simply make things better. Apple's flagship AI feature of 2026, the new Siri AI, is important. But it's also just keeping pace with the industry. Where Apple can be a leader in AI is by doing more things like what it has done in photography: using AI to make great features and experiences that don't need to shout from the rooftops that they're AI.

Jason Hiner, Editor-in-Chief

TOGETHER WITH BLITZY

Hyperscale Remediation: Autonomously Secure Your Software Estate

Security teams don’t need another list of alerts. They need to know which vulnerabilities are reachable, exposed, and safe to fix.

Blitzy understands your entire software estate and through Proactive Insights surfaces known and previously undiscovered vulnerabilities in the enterprise codebase and remediates them autonomously. It traces each finding through execution paths, identifies dependencies, and validates remediation.

Blitzy then turns prioritized risks into batches of tested pull requests for engineers to review.

The result: less alert noise, faster remediation, and confidence that each fix is safe.

HARDWARE

Arm wants to make robots speak one language

Arm is looking to grow its foothold in AI's next frontier: physical AI. 

On Monday at Arm Everywhere China, the company's flagship conference, Arm announced several expansions to its physical AI ecosystem, with the goals of reducing fragmentation in the robotics industry and lowering the barriers to adoption to make the tech easier to scale. 

In a briefing with the press, Drew Henry, executive vice president of Arm's physical AI unit, said that while the current market sits at roughly $25 billion, "we view [it] as growing and becoming one of the largest [total addressable markets] in the history of computing as this market shifts over time." 

Arm announced two new initiatives to plant its flag in the ground on robotics:

  • The company is expanding Arm Total Design, its ecosystem initiative aimed at simplifying chip development, into physical AI. The expansion encompasses more than 80 companies in AI hardware, software, sensors, and robotics, including firms like AWS, Hugging Face, and Unitree. The goal is to enable more streamlined development of physical AI and reduce complexity. 

  • As part of this expansion, Arm unveiled the Robotics Capability Framework, inviting industry experts from across the field to help create a standardized vocabulary around robotics and define "levels of increasing sophistication for robotic systems." This is comparable to the self-driving industry's levels of automation that range from Level 0 to Level 5. 

Arm targeting the robotics industry isn't random. Henry said the company has already carved a place in the market and has shipped two billion units into physical AI use cases in the past 12 months, ranging from microcontrollers and sensors all the way up to compute platforms for autonomous vehicles and robotics. 

"We've been in this marketplace for a very long time, but this market is poised now as AI embeds itself into physical devices, to get some really exponential growth," said Henry. 

It's also not the first time the physical AI industry has called for broader coordination. Luma, a video AI and world model startup aimed at creating "multimodal AGI," unveiled the Open Physical AI Lab in June, a collaborative initiative to solve generalization by bringing together the best minds in robotics rather than siloing them in individual companies.

A lot of teams are betting on physical AI right now, with some speculating that the market could eventually overtake conventional AI and language models and may be the only path to the elusive concept of artificial general intelligence. With so much on the line, initiatives like this may be an attempt to prevent the dichotomy that currently exists between proprietary US-based AI models and open-source Chinese models from playing out in the physical AI realm. Especially when you consider that a large majority of physical AI hardware, particularly humanoid robots, is manufactured in China, the physical AI industry can't afford to be divided. Starting with something as simple as a shared vocabulary could be a first step to making the industry play nice. 

Nat Rubio-Licht

TOGETHER WITH QUIQ

7 AI agents, one seamless journey

Most companies still think of AI as a chatbot for support questions. But 72% of buyers now expect a personalized experience at every touchpoint, and companies deploying agentic AI across the full customer journey are seeing up to a 30% increase in conversion rates, according to McKinsey research.

In Quiq’s new guide, “The Clock Is Ticking: 7 AI Agents Every Leader Needs,” we break down the seven essential agents, from the conversational ad that first engages a customer to the AI analyst that catches churn risk after every interaction, and where each one fits across the journey.

GOVERNANCE

How agents supercharged the hacker playbook

Agents have turned AI from a tool into a digital coworker. Now, they're doing the same thing for hackers. 

On Tuesday, Google's Threat Intelligence Group released its third-quarter threat tracking report, revealing that AI-enabled cyberattacks have evolved from assistance to automation as agents become a growing part of the process. The report finds that "human-in-the-loop latency" has dramatically decreased, cutting the time it takes to carry out and defend against cyberattacks. 

According to the research, Google's threat team observed multiple instances of adversaries deploying multi-agent frameworks and autonomously carrying out parts of attacks, including scanning pipelines and harvesting credentials. In one instance, threat actors compromised a cloud, then planned, built and executed a mass-credential harvesting attack in just under six hours using agents. 

The attack marks a shift from "passive, endpoint-focused infostealers to offensive agentic harvesting," the report notes, as threat actors leverage autonomous AI to research vulnerabilities, scan infrastructure and perform exploits. 

"Like everyone else, we’re concerned about the vulnerability problem, but AI is being applied to several other areas, and it will be especially challenging as it is applied agentically, creating a scaled, faster adversary," John Hultquist, chief analyst of the Google Threat Intelligence Group, said in a statement. 

Agents aside, the report points to a number of concerning trends: 

  • AI-coding tools and open-source software, while accelerating software development cycles, have also increased operational risks by widening the attack surface. 

  • Adversaries are also targeting proprietary AI IP, including code, prompts, research and the models themselves. 

  • AI is being used across the attack lifecycle, including targeting reconnaissance, social engineering, custom malware obfuscation and scaling information operation campaigns. 

  • Bad actors are also stealing developer credentials, purchasing compromised AI accounts and breaking into cloud infrastructure to get around AI access costs.

Google's threat report cements into reality the thing that has the AI industry on edge in the wake of OpenAI's accidental breach of Hugging Face: autonomous, agent-driven cyberattacks are here. Though many fear what agents could do if they go rogue, Google's report paints a potentially more nerve-racking picture: bad actors are harnessing powerful AI tools to systematically do damage. This means that the approach to fighting these attacks has to be two-pronged. The obvious one is fighting fire with fire. Using AI agents to automatically detect and deflect cyberattacks is no longer novel, but a necessity. This, however, could be more effective when done in tandem with more creative means of defense, such as Cloudflare's recently announced tech that stalls cyberattacks by making attacks more expensive. What cyber defenders may need most is confidence that they have the tools and partners to defend against AI-enabled attacks, which is what CrowdStrike emphasized at its annual event last week.

Nat Rubio-Licht

LINKS

GAMES

Which image is real?

Login or Subscribe to participate in polls.

A QUICK POLL BEFORE YOU GO

Do you think your organization is prepared for agentic cyberattacks?

Login or Subscribe to participate in polls.

The Deep View is written by Nat Rubio-Licht, Sabrina Ortiz, Jason Hiner, Faris Kojok and The Deep View crew. Please reply with any feedback.

Thanks for reading today’s edition of The Deep View! We’ll see you in the next one.

“The numberplate, the roof-rack, the dark object in the car, snow-chains.”


“Chains on the rear tires and the even wear on the body of the automobile, and the interior has reinforced drivers seat for the environment. AI would miss these details.”


“No snow on the hood because the engine has been running.”

“What skier in their right mind would transport their skis sticking out sideways so they could be clipped by a passing truck? ”


“The snowfall pattern below the wipers overlooked.”


“Clarity, white background, and the "AI" look.”


“[This image] looked AI beige.”

If you want to get in front of an audience of 750,000+ developers, business leaders and tech enthusiasts, get in touch with us here.