Based on ‘??? ???? ?”?, ? the poskim are mattir (at least b’dieved, depending on the specific situation) a male doctor dealing with female patients.
The idea is that the issur is based on the concern that there will be improper thoughts, which is reduced by his mental involvement in the job he is doing.
This obviously has nothing to do with Shabbos.