The PHP include_path config didn’t have the path where sendmail lives on my VPS. No wonder PHP couldn’t send email.