Verbal Abuse in the Red Light District

Not once, but twice I got a good telling off for nosing around the red light district in Amsterdam.
The first time, I'd asked a shopkeeper (cool looking guy) where the red light district actually was. We got the map out & pointed to the two streets that bordered the district. But he said I should go down the side alleys cause that's where all the action is.
So, I did. After I found the two main streets, I was about to head down a particularly red looking street (in daytime this is, mind you), when this big black Caribbean guy shouts out at me. I turned around & he yelled out "you don't go there, that there's not for women", & grabbing his crotch he continued "that's only for real men, so you stay away".
Of course, I pleaded ignorance at first, not really wanting to see this guy mad, & said I was heading to Dam Square. He said I needed to go another way. But then, my courage returned, & I said "& what's it to you anyway where I go, it's really none of your business". With this, he walked away. I went down another alley that day.
But two days later, I found myself in the same vicinity, & thought I'd have a look see. So I walked down this very in-your-face alley, & this other short black dude with a big baseball cap on walked past me & said "stupid f%$#^&* bitches stay out of this place".
I didn't wander past again.