Even in cases where there’s no technical issur of arayos, it’s still assur.
Harming someone is assur under the klal of v’ohavta l’reiacha, and probably knows d’vorim (which, correct me if I’m wrong, is not limited to literal verbal abuse).
The worse the harm, the worse the aveirah, so it’s a really bad one.