Is it fare that when you desecrate Shabbos or eat leaven on Pesach, that the bullock who never sinned should have to die and not the human being A.K.A. the Shabbos desecrator? Is it fare that the goat should be hurled from the mountain on Yom Kippur albeit the goat has never committed a sin instead of some guilty human sinners?
In haShem’s infinite wisdom, haShem has deemed human life far superior to animal life, and this is just the way haShem wishes/wills it.