Just invite people over. If they say no, then be understanding of their concerns/customs. That’s all.
Don’t worry about being branded as “off the derech” for showing kindness and sociability. Or, look at it this way… if they would be so judgemental as to brand you as “off the derech” for inviting you over, then you’re probably better off without them anyway.
The Wolf