I always understood this on a more psychological level. The Jews began their collective destiny as slaves, the ultimate punishment is not only going back to where you started, not only the knowledge that you accomplished nothing in life, but they won’t even want you as slaves. Your life went completely backwards. You end off even more degraded and worthless than you started.
FWIW, That is the way I have always understood it as well.
The Wolf