We adopt the EnKF based scheme to optimize hyper-parameters and features.
We build the EnKF based framework for parameter optimization.
Multiple ensemble and ensemble evolution are proposed to enhance effects.
Householder method is proposed to optimize the EnKF analysis computation.
The EnKF scheme outperforms three current Bayesian optimization methods.