Most of the big cathedrals were built in existing towns. The unskilled laborers were more likely to be townspeople than peasants per se. Not saying you don't have a point. (Also, they WERE paid, we have solid records of that. Of course, it was also dangerous, and they talked people into it by saying what an honor it was to have your hand in a tangible monument to God's glory that would stand for centuries).