I think Yisro argued this. He said that if Moshe’s children were exposed to all the A”Z they would also reject them and come to serve Hashem. According to the explanations I read, Moshe Rabbeinu agreed since he saw it would never happen, that Yisro would not permit his grandchildren to ever serve A”Z.
As usual, I agree with PBA’s perspective on things.