They did not speak Yiddish in Germany. At some point around 1800 or so German Jews stopped speaking Yiddish and spoke German. Before then they spoke a different Yiddish which has been lost.
There was a large population in the Netherlands who were majority Sephardim (The Spanish and Portguest Synangouge in Amsterdam is one of the largest shuls in the world)