Sam2
There are things that shouldnt be done because they dont conform to the letter of the law, other things because they dont conform to the spirit of the law. There are things that shouldnt be done due to sensitivity to the spirit of the law.
I dont know why you shake off “inyanim” “chassidus” and kaballa. Halacha is the nigleh of kaballah. Whether you like it or not when we wave a lulav and esrog it keeps away the bad ruchois. That is a fact that isnt halachic but you must know that the halacha is just the outside but theres a lot more going on than what meets the eye. Maybe take the time to learn some nistar and get in touch with pnimius hatorah.