i would have-without disturbing my tefillah by talking to him-walked to a better location & continue davening thus not talking in between & still being one tefilla
in the future in colleges its best to remain low profile & not attract any attention of judaism to yourself & C”V not cause any anti-semitism