Some reliable googling:
Most states consider jaywalking a petty misdemeanor, the most lenient type of misdemeanor. Generally if not ignored, it is punished with a fine around or less than $100. But a violator is subject to arrest and sentencing up to six months in jail and a substantial fine.
It is not a felony but it is technically a crime. You’re right people don’t think of it in the sense of being a criminal act. But it is, under the law. Wasn’t that the basis of Joseph’s point.