This country was founded by white men, and built by enslaved black people. The white supremacy was baked right in from the beginning. Black Americans didn't gain full civil rights until the 1960s (when my parents were in college.) The legacy of that white supremacy remains to this day, both from existing power structures and ways of thinking, and due generational wealth differences.
It is not racist to point that out.
The article says that the specific people they're featuring have been ostracized from the gay community. I wish the article was longer, because there's a remarkable lack of self-awareness on display in the few quotes it includes.