IN ADDITION
If you’re looking for a more source-based answer, here is what I got from a good friend of mine (who is much more knowledgeable than I am – I got this answer within minutes of me asking him…):
If you look in Shemos Rabbah – and the Halacha is like the Midrash in this case – in שמו”ר פ’ ג, ו it actually explains exactly the opposite of the way it’s described here
– if it means anything to you, the Rebbe has an in depth sicha on this Midrash – likkutei sichos 11 Parshas shemos, sicha 1.
Furthermore, there’s an iggeres (a letter) by the Rebbe on the topic on the matter – Igros Kodesh 1, ieggeres 85
I don’ thave access to my books right now or I’d gladly quote from there at least the sources…