Is it historically accurate to say that Lubavitch were the first in America to do a lot of kiruv
Yes.
and all the other groups were Johnny come lately’s who merely followed in Lubavitch’s way, and wouldn’t have gone where they did if not for Lubavitch?
That’s pure conjecture. The reason others didn’t do it as soon is because they didn’t feel they were ready.