Should I or Shouldn't I?

Just have fun with your wife and take it as a joke. If you lose smile and take her to a dinner out. I don't think she'll lose respect just because of arm wrestling.