“I don’t like you grouping them separate from books you take seriously.”
I take them seriously. Just not necessarily literally.
Rambam famously treated parts of the Torah in a non-literal matter. Are you going to accuse him of treating, say, the talking snake or the talking donkey less than seriously??? Kal v’chomer midrash aggadata.