by poszlem 19 hours ago

Genuine question, not trying to throw a shade or anything, but are those cores actually useful with the state of apple intelligence being what it is?

rahkiin 19 hours ago | [-2 more]

They are also used by ML models that are deeply integrated in macos and ios without you knowing. Like object and text detection in images.

geerlingguy 18 hours ago | [-0 more]

And help in Photos, Final Cut Pro, and other apps.

willis936 17 hours ago | [-0 more]

I wish they would (or wouldn't if they are) hook it up to the ios keyboard.

dagmx 18 hours ago | [-3 more]

If you strip away the branding, Apple has and continues to ship a ton of algorithms that likely use the ANE and end users can use CoreML to do the same.

Just some things that people will likely take for granted that IIRC Apple have said use the ANE or at least would likely benefit from it: object recognition, subject extraction from images and video, content analysis, ARKit, spam detection, audio transcription.

sroussey 17 hours ago | [-2 more]

Don’t forget FaceID and many of the image manipulation.

And while everyone else went to more powerful giant LLMs, Apple moved most of Siri from the cloud to your device. Though they do use both (which you can see when Siri corrects itself during transcription—you get the local Siri version corrected later by the cloud version).

mschuster91 9 hours ago | [-1 more]

IIRC, FaceID has been a thing before ML entered the picture.

dagmx 2 hours ago | [-0 more]

FaceID was introduced along side the ANE. It was its reason d’être when introduced.

stetrain 18 hours ago | [-0 more]

Apple's OSes run a lot of local ML models for many tasks that aren't branded as Apple Intelligence, and they have done so for many years now.

llm_nerd 19 hours ago | [-1 more]
malshe 15 hours ago | [-0 more]

This is a nice article. Thanks for sharing.

esafak 19 hours ago | [-4 more]

You can convert your own ML models to MLX to use them; Apple Intelligence is not the only application.

nullstyle 18 hours ago | [-3 more]

MLX does not run on NPUs AFAIK; just gpu and cpu. You have to use CoreML to officially run code on the neural engine.

mirsadm 18 hours ago | [-2 more]

Even then there is no transparency on how it decides what runs on the ANE/GPU etc

sroussey 17 hours ago | [-1 more]

Correct. OS level stuff get first priority, so you can’t count on using it.

znagengast 15 hours ago | [-0 more]

Turns out third party actually gets priority for ANE