A neural generalization of the Bag-of-Features (BoF) model is introduced. The proposed model supports the discriminant weighting of the feature space. Two incremental algorithms (for training and classification) are proposed. A method for providing visual attention information for the BoF model is introduced. The proposed method is evaluated using four datasets from different domains.