Facts are facts, yes. But they can also be biased. And if you have a bias against a specific race, you can use facts to hurt that race.
An example would be a media outlet only reports facts that are negative against a certain race. That media outlet ONLY says things like African Americans have the highest % of any race in prison, theres a high % of crime in AA communities, highest % of any race on welfare, etc. Those are all facts, but if they only report the negatives about a race, to me that’s a form of racism.
Or on a smaller example, a white guy gets in a fender bender, sees the other driver is black and says “learn how to drive you black son of a bitch”