Yaako Avinu taught us.
Im Lavan Garti ves Taryag mitzvos shmarti
Keep the mitzvos follow whats written in shulchun aruch and you will be fine.
If You want to work on elevating yourself achieving a level of separating yourself from that which is mutar. go for it dont worry about others.
IF you are lookign for suggestions, avoid the coffee room, is a great starting point