“I cannot accept that He would deliberately “torment” you to answer for those sins when He knows that you cannot because you weren’t even there.”
I can’t speak with any knowledge on this, but I’m not clear that “answer for” means “tell Me why was the sin done”. In the Olam Ho’emes nothing is hidden, so the need to “answer for” is not easily understood in that sense. It is quite possible that the intent is that the ba’al loshon harah takes the consequences of the trasferred sins.
The best would be to find the actual wording in the sefer and try to understand that instead of trying to interpret the paraphrasing that was likely done with randomness.