Wiktionary:
polite society (uncountable)
The elite or upper crust of society.
1803, Maria Edgeworth, “The Manufacturers”:
[H]e had been brought up in an extravagant family, who considered tradesmen and manufacturers as a caste disgraceful to polite society.