The OP said “someone frummer than you”. Just because you may keep a chumrah that I don’t doesn’t make you more frum than me.
The term “frummer” is used, whether with a positive or negative connotation, to refer to keeping a more stringent halachic standard. By this commonly used definition, keeping extra chumros is synonymous with being “frummer”.