WWDC 24: Running Mistral 7B with Core ML

Apple's move to bring Mistral 7B, a powerful open-source AI model, directly onto iPhones through Core ML represents a quiet but significant shift in the smartphone wars—one where processing artificial intelligence locally, without routing data to distant servers, could become the defining advantage. The capability raises urgent questions about which company will win the race to put genuinely useful AI in users' pockets while keeping their personal information off the cloud. For Apple, it's a chance to differentiate from competitors relying on cloud-dependent AI, but it also means the company must prove these on-device models are powerful enough to actually replace the assistant features users have grown accustomed to.

Hugging Face·Jul 22