The rama (128:44) says birkas kohanim is only said my mussaf on yom tov because the simchah is greater then, before everyone heads for the s’udah.
The rama says birkas kohanim is said by n’ilah and brings differing customs regarding shach’ris. (The reason it was stopped by n’ilah is probably because it usually extends until after sh’kiah.)