A stray remark hits a raw nerve. Only you can judge its truth. Keep in mind that even if it is, you’re not under oath to admit it.