Gaussian processes (GPs) are a Bayesian regression technique with big upside for machine learning interatomic potentials. Unlike black-box methods like neural networks, GPs are interpretable, uncertainty-aware, and allow for the integration of physics-informed behavior through the use of carefully designed Bayesian priors.