We analyze the stability of geodynamic simulations with a free surface. We show how existing stabilization schemes work in this framework. We describe an alternative stabilization scheme based on nonstandard finite differences. We describe the implementation of a free surface in the open source soft-ware ASPECT.