Haleivi- actully according to “our perception of space” we couldn’t live in part of it.
What you are essentially saying now is that there is no such concept as infinity. If you can’t point to any single area of the infinite object then there’s nothing of which to discuss.When the Sefarim try to prove that time is finite they do not use your argument to say that since there is a day time can’t be infinite. There is a fundamental mistake here.
When you read an argument in a Sefer it has to make sense to you to the degree that you can argue the theory itself without saying, well such and such Sefer says so. I don’t think you can do that in this case.