I think HaKatan should clarify that point, since my impression is that he intended to be referring to the beliefs not necessarily to the religious believers (as far as carrying the personal status as heretics.) As you both pointed out, that one comment seemed to against the grain of most of his other comments.
DY: Vayoel Moshe, to take the most prominent example, was certainly directed at other than just his own followers.