I like strong and cheerful colors (favorite colors: bright red, orange, turquoise, magenta) but most men I know will go for the more toned down colors: beige, grey, dark blue, black.
I can understand that those men don't go for a colorful outfit but what's wrong with a splash of color: a line on a sweather, a scarf,...
I once bought my brother a scarf with white and black stripes on it which I figured was quite toned down but it was still too bright. So, I bought him what I called a "grandpa" scarf: boring beige. He loved that scarf.
I don't quite understand why it's more accepted for women to wear colors than for men. The most daft theory I can come up with while being low on cafeine this morning is that deep down, men are still hunters, hence the preference for camouflage, thus, toned down colors.