A lot of the time it's because the body language of the person who doesn't like animals is actually more appeasing than thus attractive.

Also, love the story about the St. Bernard.