I think its a Medrash that says Adam was wrong. This is not his own chiddush.
It does say you are not supposed to verve from the torah left or RIGHT. Everyone realized there are dangers by allowing to many makels, there needs to be a realization that there are dangers by adding too many chumras as well