You’re certainly no worse than a mamzer, who is not blamed for his status and is surely not considered a rasha.
The Chofetz Chaim disagrees with you. He clearly states that I am wicked.
And, of course, the sword is double-edged. If I agree with him, I’m a rasha by his statement. If I disagree, then I’m a rasha for daring to disagree with the Chofetz Chaim.
The Wolf