????? ???? ??? applies here too. If it was not for a lack of effort on your part and you are happier and learning better, growing more and working harder to peel away your own layers to get to the real self with the newer Rebbi, then you have made the right decision But if it out of any sort of laziness, or lack of desire to be honest with self, then you need to reconsider. It is not just about being happy. It is about doing and growing in Torah and avodas Hashem.
BTW, did you try to have a heartfelt conversation during a quiet time and place to give him a sane moment to contemplate and explain?