Frankly, in nearly two decades in the business world I have yet to ever encounter someone who wasn’t entirely understanding of it.
Yes, sometimes a person will respond with some questions, but that’s ok.
Lying to them by using some excuse about germs or wives is ridiculous. People are not stupid and they will see that you are not being genuine. If not immediately, soon enough.
In this day and age there is no reason not to be honest about your beliefs. A person will be less insulted if you are honest and up front.