We give a primer on cross-validation to measure decoders predictive power. We assess on many datasets its practical use for decoding selection and tuning. Cross-validation displays large confidence intervals, in particular leave one out. Default parameters on standard decoders can outperform parameter tuning.