Gadol, it was tongue in cheek somewhat, as we refer here to the “field”. Field differs from the yard, I recall, as it is where someone business (literally) grows, so it is subject to “ayn hara”. I don’t know whether this applies to profits from selling stadium seats.
as to the stam wall between 2 properties, things are opposite to what you are saying: if you live above/opposite me, I can force YOU to build a wall to not look at me.
your Rav seem to be concerned with the real issue here – not hezek reya, but benefiting for free from viewing the game. At Chafetz Chaim level who would tear a stamp when sending a letter outside of official mail, he should pay for whatever he would otherwise spent on tickets. If I were there, I would certainly be allowed to watch – as I don’t care at all and the stadium owner is not losing money by me watching it. More likely, I’ll force him to put the wall back to prevent noise and hezek reya from stadium into my home.