I found this interesting article from the OU, that posits that it wasn’t the Kamtza and Bar Kamtza story alone that caused the destruction of the Bais Hamikdash to be destroyed.
http://www.ou.org/torah/article/tzarich_iyun_destruction_of_the_beit_hamikdash#.UNIP8HNetQY