"I am not having this conversation with you. (nothing personal, John, not with anyone else either)"
I can seem confrontational, but in this case I do want to understand. I don't think I can really claim an opinion unless I can argue both sides completely. If you change your mind, there's always email.