BP Totty- You are rationalizing your bigotry. Of course, it may be par for the course in most frum circles to think of “us” as thinking people and “them” as grunt work people, but it is bigotry nonetheless.
Instead of drawing the line between “us” thinkers and “them” muscleheads, you could draw the line between “thinkers” and “muscleheads”. You could argue that highly intelligent people of avergage physique are wasted in combat roles and such roles should only be filled by those with above average physique and unremarkeable intelligence. That wouldn’t go over well with recruiters, but it would be an unbigoted position. And it would be a very different line from the one you describe, despite what you may think.