Yes, it can be bad. Towels tend to shed lint during washing, which can stick to other garments, especially darker clothes. They also often require different wash settings than everyday clothing. Washing towels separately usually leads to better cleaning results for both loads.