1. It is not a one time occurrence.
Amazing! You get so many easy mitzvos!
2. Driver is talking on the phone which when on car speakers can disturb people sleeping in house.
Thats unacceptable. tell him to hang up or leave.
Also you need better insulation it isnt normal to hear conversations in a driveway in your home, you probably will save on heating bils to.
But again that in no way absolves him from the responsibility to keep it down
3.when driver is backing out (street is busy) can cause a lot of honking which can disturb people sleeping.
That sounds like a reach of an excuse to aoid an easy mitzvah. Its the yetzer harah talking, it doesnt seem real.
4. Streets are busy with cars and pedestrian traffic so it will take the driver sometime to back out. Which means I need to wait some time to get out of my driveway (if in hurry can be a big deal).
how long? 10 seconds? 30 tops?
A bit clearer? Totally!
There is no good reason to stop him.
Though I still dont understand why he doesnt do the more typical blocking of driveway (while staying in car)