Loitering laws are never going to work. What "loitering" is is too subjective, too open to interpretation, and then it absolutely leads to "Walking while Trans" or, of course, "Walking while Black."

Unless somebody is heckling or harassing others, let them be, and even then the correct response is to ask them to knock it off.