The Chinuch in mitzvah ??”? and the Rambam in ‘??’ ????? ????? ?’ ? both say that someone who is mefursom in Torah and maasim tovim that does something that the ????? look down on that is chilul Hashem.
As opposed to this they say if someone is oiver an aveirah in front of ten members of the klal then this is also a chilul Hashem.
So we see a difference between what is called a chilul Hashem in front of the klal and what is chilul Hashem in front of anyone.
I would opine that the world does look up to all of us baalei maasim tovim and that this can be an issue.
However, the Rambam doesn’t bring any cases of where a person has the oppotunity to do a mitzvah but he will be looked down upon for doing it. It seems to me that in the case of a mitzvah if a person can do it without chilul Hashem this is preferable, but if it comes down to it, it is better for him to do the mitzvah rather than abstain.