The iPhone 17 runs a 3 billion parameter language model on-device at 30 tokens per second. Obviously, the average consumer has no idea what that sentence means, and Apple hasn’t figured out how to make them care.
I believe that’s about to change. Apple now has complete access to Google’s Gemini model in its own data centers, with the ability to distill it into smaller models built for iPhones and iPads. Knowledge distillation works like this: you take a large model, have it perform tasks with detailed reasoning, then feed those reasoning traces to a smaller model until the student learns to mimic the teacher. The smaller model ends up far more capable than if you’d trained it from scratch on the same data. Apple can now do this with the full Gemini, not just their own in-house models, and the distilled output runs locally. No internet required.
Smartphones haven’t had a real upgrade story in years. The camera is great. The screen is great. The processor was fast enough three generations ago. Battery life has overtaken price as the top purchase driver for the first time. The global replacement cycle has stretched to 3.5 years. People hold onto their phones because nothing about the new one feels different enough. Deloitte’s 2025 TMT Predictions report frames on-device generative AI as the feature that could break this cycle, if the experience delivers on the promise. On-device AI might become the next reason.
The spec
In the late 1990s it was megahertz: Intel and AMD raced clock speeds past the point where consumers could distinguish real-world performance differences, but the number on the box still drove purchases. Then it was megapixels. Samsung shipped a 200 MP camera sensor knowing that most phones use 16-to-1 pixel binning to output a 12.5 MP image by default.
Parameters could be next. The iPhone 17’s standard A19 chip has 8GB of RAM. The Pro gets 12GB with faster memory bandwidth, which determines how large a model the phone can run and how quickly. Samsung’s 2026 flagships with the Exynos 2600 hit 80 TOPS on a 2nm process, more than double the prior generation. These are already the numbers in press releases. It’s not hard to imagine an Apple keynote where someone says, with rehearsed enthusiasm, that the iPhone 18 Pro runs a 7 billion parameter model while the standard model is limited to 3 billion.
The difference from previous spec wars is that this one might actually correlate with user experience. Megahertz past a certain threshold didn’t make Word open faster. Megapixels past 12 MP didn’t make photos look better on a phone screen. But a 7 billion parameter model running locally outperforms a 3 billion one on nearly every task. It handles longer documents, follows more complex instructions, holds better conversational context.
Breaking the stalemate
Gartner projects GenAI smartphone spending will reach $393 billion in 2026, up 32% from $298 billion in 2025. IDC reports GenAI smartphone shipments growing 73% year over year. Samsung has publicly committed to 800 million AI-enabled devices by end of 2026, doubling its 2025 footprint. Morgan Stanley’s latest survey found iPhone upgrade intentions at 37%, an all-time high, with FY26 shipment forecasts of 260 million units sitting 3% above Street consensus.
On-device AI creates hard hardware requirements in a way that camera improvements and screen upgrades never did. You cannot run a 3 billion parameter model on an iPhone 14. The Neural Engine isn’t powerful enough and the memory bandwidth isn’t there. Apple Intelligence requires an A17 Pro or later, which means the feature itself creates an upgrade floor. Every year that floor rises. When Apple ships distilled Gemini models that need the A19 Pro’s 12GB of RAM, every phone older than 2025 is locked out.
The Gemini deal matters for the hardware cycle because of the distillation pipeline. Apple doesn’t need to build frontier-scale models from scratch. They can take Gemini’s best capabilities, run them through distillation, and compress the results into models sized for their hardware tiers. A 3 billion parameter model for the standard iPhone. A 5 billion version for the Pro. Maybe a 10 billion model for a future iPad Pro with enough memory and thermal headroom.
Google is playing a similar game from the other side. The original Gemini Nano shipped at 1.8 billion parameters; the updated Nano-2 rose to 3.25 billion. Samsung’s Galaxy S26 ships with on-device Gemini running on NPUs that are 39% faster than the prior generation. On-device models get larger every hardware generation. Each generation’s models don’t run well on older hardware. You see where this goes.
I find it plausible that within two product cycles, on-device model capability becomes the primary differentiator between phone tiers and between generations. The data isn’t there yet: only 17% of Americans say AI is a major purchase influence today, Apple Intelligence ranked seventh globally as a reason to upgrade in Morgan Stanley’s survey, and over 40% of users have privacy concerns about smartphone AI, with half unwilling to pay extra for it. But you can’t tell the difference between a 48 MP photo and a 12 MP photo on your phone screen. You can absolutely tell the difference between an AI assistant that understands your question and one that doesn’t. The feedback loop is immediate and personal. If the bigger model actually works better, and if the distillation pipeline from Gemini delivers real capability gains, the upgrade incentive is self-reinforcing. People will upgrade not because the spec sheet says they should, but because they tried their friend’s phone and the AI was better.
Whether this arrives with iOS 27 this fall or takes another generation to mature, I don’t know. But the next reason to buy a new phone will much more likely be the model than the camera.