both sides are being silly
yes middos and behavior are what counts, of course, and i dont believe anyone has said elsewise.
and yes clothes are a powerful tool. they CAN both express and affect, and identify the person.
and no you cant always judge a person by his clothes but yes they do often suggest certain ideas that the person probably has.
its not always black or white
(although sometimes it is black AND white)