The only thing you could have done differently is to avoid answering in a Shtickier way. You could laugh as a response, which diffuses tension and sounds like, of course, while hinting that after all you don’t want to get into it.
But like Popa said, talking it out won’t help. It won’t change his mind and it won’t change yours.