From the CDC: Masks should NOT be worn by children under age 2 or anyone who has trouble breathing.
The person who I mentioned was told by his doctor that he cannot wear a mask for long periods.
(It was physical. If it were psychological it probably would have bolstered my point even more)