Lin Xiao | PIMS - Pacific Institute for the Mathematical Sciences

Facebook AI Research

Lin Xiao is a Research Scientist Manager on the Fundamental AI Research (FAIR) team at Meta. He received his Ph.D. from Stanford University in 2004, spent two years as a postdoctoral fellow at California Institute of Technology, and then worked at Microsoft Research until 2020 before joining Meta. His current research focuses on optimization theory and algorithms for deep learning and reinforcement learning.

We consider the problem of minimizing the average of a large number of smooth but possibly non-convex functions. For machine learning applications, the loss functions are mostly non-negative and thus can be written as the composition of the square...