Yes restrictions because people may inadvertently do something. My rav respectfully disagrees with the conclusion that one may not wear a hat with yarmulke underneath at least as it relates to his kehilla, because the wearing of a hat is just as common as a yarmulke and if it blows off people are very aware not to pick up and carry it. Just like yarmulke.
