I’m not saying no one should drink, just that the halacha is not to drink if it will cause you to neglect any mitzvos, and that if in one’s experience that has happened, that seems like a clear reason not to drink. Of course one should ask their Rav is there is a doubt about what to do.
Is there a halacha that one should not stay up all night on Shavuos if it would cause you to neglect a mitzvah the next day? I wasn’t aware of that. On second thought, I suppose kavanah in davening is not a big enough issue, since for most people it probably varies so much anyway — perhaps I shouldn’t have put that in my list.