Not always. If the colored clothes have already been washed several times and no longer release dye, drying them together is usually fine. However, if you're unsure, separating whites and colors is still the safest approach to avoid any risk of transfer.