It depends on whether there is a constructive purpose to their conversation and all the other factors relevant to toeles.
they certainly shouldnt be talking about their boys in front of you
and you shouldnt be listening.
the fact that it is with each other does not not make it Loshon Ha Rah unless they are not careful with the conditions of toeles