Advances in private training for production on-device language models
… In 2020, a DP mechanism that clips and adds noise to model updates was used to prevent memorization for training the Spanish LM in Spain, which satisfies finite DP guarantees Tier 3 described in “ How to DP-fy ML“ guide . …