Yoshi, I totally understand. You have to choose the right time of day to go and wear layers, with the bottom layer being a mositure absorbing shirt like Ashreinu said. A wind/running jacket will also give warmth without the bulkiness.
Or like I said earlier – the dreaded treadmill.