Derech – Pachad Yitzchok (R”H 7) discusses this paradox in depth, in its basic application – the middah of Yiras Cheit.
About your point – the feeling may be right, but what was being questioned here was whether this is the natural outgrowth of such feelings, or so far out as to be unrealistic and therefore indicate instability.