From Wikipedia: The first chalav Yisrael dairy farm on the East Coast of the United States, and possibly in the entire United States, was started by Isaac Balsam in 1903, and remained in business until 1955.
It might have been a small operation, though.