Attacking Arabs who did not participate in the attacks just makes more enemies. Whereas the goal of the Arabs (and Muslims, in general) is to get rid of Israel, the goal of Israel (whether according to the zionists or the hareidim) is to live at peace with the local goyim, and in all fairness, defeating the Muslims and turning the “nation of Islam” back to the Christians, Zoroastrians and Hindus (as it was before the Muslims conquered the region) isn’t realistic or even desirable (remember we generally hailed the Arab Muslims as liberators 14 centuries ago).
Most Palestinians want to live at peace with Israel, and so the goal of the Israelis should be to isolate those who favor war and genocide from those open to peaceful co-existence, and attacking random Palestinians is therefore counterproductive.