If there was a place with a historic church (I know of churches from the revolutionary war for example) and that area became more frum and the frum people wanted to remove the church.
Would it be anti-semitism for those who oppose the removal of this church