Actually the worst anti-religious were the Zionists. Especially the inventor of Ivrit, Eliezer Ben-Yehuda.
Yiddish, on the other hand, is spoken as a living language by hundreds of thousands and is learnt in as a primary Torah setting in many Yeshivas.