Joseph, all you need to do is declare those who do not follow your chumras as been lax in an area of Halacha, and suddenly they do not count towards determining Minhag Hamakom.
Since the fall of 2004 the evolution of chumros in the right wing has been breath taking in speed.
New chumros about womens stockings are taught as if they are Halacha LeMoshe M’Sinai.
Our daughters recall that their pious grandmothers did not abide by such chumros, and suddenly they will not listen to anything about Tznius.
One Baal Toseif can uproot the whole Torah (r’l).
Now I understand why one error posuls an entire Sefer Torah.