Ujm, the gaon once met a person who was a mechalel shabbos and asked him “what’s going to be with bitul torah?”, The man answered…rabbi, do you think i have to worry about bitul torah?? I’m not keeping anything…. The gaon answered him after they punish you for chilul shabbos and neveilos, they’ll give you petch for bitul torah too!!”
Same thing here