A unified sampling framework UHG is proposed for multi-structure model fitting. UHG combines the merits of a global search strategy and a local search strategy. The global search strategy is guided by the conventional sampling strategy. The local search strategy is guided by using the results of model selection. Experimental results show the effectiveness of UHG on public datasets.