While there are less Chasidm than non Casidishe frum people, 1. Chareidi/Chasidic and 2.Chareidi/Litvish are not tied. There are far more Chasidim.
Lakewood and Flatbush are the only two large places where Chareidi/Litvish outnumber Chareidi/Chasidic. And even there plenty of Chasidim live. Then you have to add Boro Park, Williamsburg, Monsey, New Square, Kiryos Yoel etc. where the Chasidim are by far the majority.
Based on a (Torah Umesorah?) graph I once sawIn the 1980’s there were more bochrim learning in Litvish Yeshivos. In the 1990’s it flipped to more bochurim learning in Chasidshe yeshivos.And even in the 1980’s Chasidim learned in Litivishe yeshivos whereas litviseh bochurim don’t learn in Chasdishe yeshivoa