In this paper, we study second-order differentiability properties of probability functions. We present conditions under which probability functions involving nonlinear systems and Gaussian (or Student) multi-variate random vectors are twice continuously differentiable. We provide an expression for their Hessian that can be useful in numerical methods for solving probabilistic constrained optimization problems.