It goes both ways. My black spouse is constantly getting us white people confused. He can't tell the difference.
I was a member of a volunteer group that worked on different types of projects. Every year we had to choose a few people to be recognized. There were a series of Americans that we worked with on different projects. I suggested someone thanks to whom a water project was carried out, and everyone voted and he was approved.
A couple of months later, at an event in another city, I presented a button to this person in public. After that, I noticed that the people from my group who attended seemed upset, but they wouldn?t say anything.
Finally, one of them approached me and asked, "Hey, who was that guy?" And I'm like, "what? but you?ve met him!". I had to explain him when and how they had met and remind him that he had also voted for him, just like the rest of the group. To this, he replied "Well, you know, all those gringos look the same."