Over the last years, ensemble learning has been the focus of much attention. We apply two different designs of ensemble learning on the feature selection process. Homogeneous ensemble distributes the dataset on different nodes. Heterogeneous ensemble combines the result of different feature selection methods. We reduce the training time and release the user to choose a feature selection method.