One thing is worse than not putting the sefer back.
And it leads to much more bittul Torah.
That is returning it to the wrong place on the shelves!
Because nobody looks there for it.
You will look on tables or shtenders but cannot start checking all the shelves.