Daas Torah and the concept of listening to Gedolim does not mean that gedolim are infallible. It only means that even in the unlikely event that they are wrong, (After all, they are human with flesh and blood judgment, and bechira as well) we should listen anyway.
Even if they say on yemin shehu smol.