Looking for Opinions

So after Psycho, Hitchcock was criticized for manipulating his audience with sound. Basically, critics were saying that, without the score, Psycho wouldn't have been as scary. In turn, he mad The Birds without a single note. In fact, the only thing like a score is the sound of the birds and the children singing in the playground.

Was this a good move? He didn't want to be the "sound guy" so he responded by making a movie without sound. But do we really need to address the nitpicks of critics? I'm feeling like I'm heading towards being a "something guy" like that. Should I purposely change it up, or let the change come naturally, if at all?