It's more the idea that the rude person is the one who refuses touch rather than the one who forces it on others.

OFFERING a handshake is a different thing, but that's not how it works.