So anyone who disagrees with your pshat is only following their yetzer hara? Ok.
I would recommend seeing Igros Moshe yoreh deah chelek daled siman lamed vov, sif tes zayin, last paragraph where he discusses bochurim who have a cheshek to learn shaar chochmeyes during bein hasedorim. He doesn’t mention this Rema or anything but it’s interesting because he seems to be allowing for a set time (bein hasedorim) to learn these things if not done with heavy iyun.