*snort*
Listen. Birmingham is a majority Black city. Whether or not it's done naively or purposefully now, people have spent decades talking **** about the city simply for that reason. It has nothing to do with a silly football rivalry.
So, again, whether it's intended to be or not, when you say things like that, it's racist.
Where I live in my neighborhood, I have the highest number of neighbors who are not white compared to other parts of the neighborhood. I routinely receive feedback to the effect of "loved the house, didn't care for the location in the neighborhood." For additional context, I live in what is arguably the most desirable neighborhood in the city at present.
I don't expect most of you to choose to understand this, but it is what it is.