“militia”, by definition, consisted of all FREE (as opposed to slaves, serfs, indentured servants, Jews and in some years other religious dissenters) MALES, who could be called to defend the kingdom, put down rebellions, etc. The right to bear arms goes along with being FREE. Those who couldn’t bear arms, were un-free.
One could argue that the 2nd amendment protects the rights of all citizens to be in the militia (cf. the Asher Levy case), butr that issue has never been litigated