… It seems the iPhone maker had only licensed Google's technology for model distillation purposes. Apple also takes pains to note that it conducted its own pre-training and post-training operations on the AFM 3 Cloud Pro. …
… Point Lemonade to the ROCm build by setting the environment variable: export LEMONADE LLAMACPP ROCM BIN=/path/to/llama-server Start Lemonade and load the Gemma 4 model via the API: lemonade-server serve curl http://localhost:8000/api/v1/pull \ -H "Content-Type: application/json" \ -d '{"model name"… …
… Bear in mind that distillation is a machine learning technique where a compact "student" model is trained to mimic a larger, complex "teacher" model. …
… Meanwhile, Apple is also training a host of smaller on-device models via a technique called distillation, which imbues these student models with some of the same capabilities as those possessed by their teacher model, which in this case is the licensed Google Gemini model. …
… Today, The Information has revealed that "Apple is using a version of Google’s large Gemini model to train a smaller version of the model that can run locally on Apple devices, a process known as distillation." Interestingly, Apple is also apparently mulling acquiring companies that can help it in … …