An observer based control for tracking desired trajectories for a fixed wing unmanned aerial vehicle is proposed. This approach is robust under parametric uncertainties and external disturbances via an extended state observer. Extended observers are used to estimate the state vector and external perturbations. The adaptive second order sliding mode controller ensures finite time convergence and requires less control effort. Stability analysis for the observer based control is given.