Lilmod,
I knew you meant midrashei aggada and not all midrashim. I was responding that even things you might call midrashei aggada are sometimes meant literally to explain parts of the Torah. If you don’t like the Ur Kasdim example, another example would be the midrash that the 70th person to go down to Mitzrayim was Yocheved who was born in the gates. This is a midrash meant to explain the calculations of people in the pesukim. It isn’t about some deeper meaning about Yocheved or Levi.