A methodology for designing viscoelastically damped structures is presented. Viscoelastic responses of the structures are obtained by time-domain finite element analysis. Topology optimization of multi-material structures is presented. The optimized designs have both high damping and desired stiffness.