Far more poor, unknown immigrant Jews, faced with the edict of if you don’t come in on Saturday, don’t come in on Monday gave in to their poverty and went off the derech.
It wasnt just in America, in fact it was also in Europe there was a mass exodus to the cities where people were not religious anymore. In Poland alone about 2/3’s were not relgious.