"You're a Racist!"

Ever had the experience in which you or your addressee have replied, "You're a racist!" or something to that extent? What happened? Was it due to something surprising, unexpected or offensive? Are you still friends today? Can this mean something else? Can it be expressed in other ways?