We should not consider ourselves able to call stupid what rishonim called stupid.
Moreover, when the rishonim called it stupid, it had not been a minhag already for several hundreds of years. Which is why you may notice that no modern day ashkenazi posek calls it stupid, or suggests you can be meikel with it in any way.
Charlie is stupid.