And the passengers ARE party to the contract. The bus company has a responsibility to enforce the laws of its contract on its buses. By using a publicly operated bus, passengers are tacitly agreeing to comply with any laws entailed in riding it. So by extension, the contract applies to them as well.
So, in this specific case, segregation is illegal al kol panim.