In this talk, I will discuss the following connections between private optimization and statistical physics in the context of the low-rank matrix approximation problem: