Monkeys are pretty smart. It's entirely feasible that if only the women chased them away from the garden they'd learn the difference...