Toras – “Why would somebody ever be מוסר נפש to go to the Kosel? That wouldn’t be permitted. Which Rishonim are you referring to?”
See Ramban in the Kesavim D’rush Rosh haShana (I think at the end), where he clearly writes what he went through to go to EY.