“They are more of a casual pants-people wear them to garden and paint and not they way to portray themselves in public and before Hakoadosh baruch Hu.”
Well, since one is tending his garden in front of Hakadosh Baruch Hu, it would follow that for garden work, it is appropriate to wear jeans. I suppose you might argue it is inappropriate to do garden work.