It is an incontestable fact that numerous Gedolei Acharonim knowingly and deliberately explain Pesukim in ways that are irreconcilably different from Chazal. I don’t know what you mean by “[not] arguing fully.”
Rav Hirsch wrote an extensive explanation of his position on this issue, which is published in Volume IX of his Collected Writings.
I acknowledge that there are those who disagree, but it appears that the mainstream, majority opinion among both Rishonim and Acharonim is that Aggados Chazal (including, but not limited to, Midrashic explanations of Pesukim) are not Torah M’Sinai, and we are free to reject them (It scarcely needs to be said that we do so at our own peril, and we are well advised to exercise extreme caution in this regard).
I know this is not what we were taught in Yeshiva. That doesn’t change the facts.
I would love to see this Abarbanel; can you provide the reference? I am rather skeptical that there is any sort of “consensus of Achronim” reading the Ramban that way; the annotated Mosad HaRav Kook (it’s been a while, but I think it was from MHK) version does not provide many such references. If you would, I would greatly appreciate it.