In this case it doesn’t seem that there was any workplace issue. Anyone who has a boss that isn’t frum could feel the same way: “my boss doesn’t wear a yarmulka and is therefore hostile to frumkeit.”
Why does it affect your work? In other words: how is it in any way relevant that this guy is your boss?