Various theories have been advanced as to why Hashem would choose to conduct the world in such a manner.
For one, otherwise there would be virtually no such thing as moral freedom (what we call Koach Habechira) – we would be coerced to follow Ratzon Hashem by the clarity of our perception that He is the One Who runs the world (along the lines of what Rav Moshe Feinstein said about the Koach Habechira of Malachim – ע’ דרש משה פרשת בראשית).
Additionally, a world which operates on a logical system of action-reaction (cause and effect) helps us to understand and internalize the concept of Midah K’neged Midah, so that we can use our experiences as guides in our Avodas Hashem.
What’s more, as the Pasuk says, מלך במשפט יעמיד ארץ, the king establishes his government on the basis of justice (in somewhat more modern parlance, Law and Order). The fact that the world operates in a perfectly consistent way that is regulated by Laws which can not be violated is an expression of Hashem’s Majesty.
There is plenty more out there, but these are the three which resonate most strongly for me.