The fellow already comes to daven. The question, it seems, is not whether to accept him, but rather whether to throw him out.
ZD’s cases are much different, because there is a safety issue. One shul I know of deals with such situations by closely monitoring the fellow, and without overtly offending him (his guilt unproven) not making him feel too comfortable.