If I have different layers I'll probably process each one separately. That sometimes makes it sound as though a particular area of the spectrum has more distortion. I won't apply distortion to an EQ band of a single sound though. I'll either distort the whole thing or none of it.
That's not to say it can't be done or that it won't sound good though.