It depends on the school. In some schools, a degree is a prerequisite for any teaching position, in others only for general studies (but not for Judaics), and in others not at all.
There is also the question of whether your degree needs to be in education, or at least in the subject that you teach. In some schools a teacher license will suffice.