far east – the point is very simply, that if calling someone a gadol is subjective, you agree that another may not view him as such, and so there is no point in telling someone not to call him a clown “because he is a gadol”.
I do know the Rabbi in question, and I am 100% convinced that if he were to hear you calling him a gadol he would burst out laughing.