It's not a "logical" conclusion at all.
The White House was named after a color, not a person. Colors don't own slaves. People do.
Mr. Freeman dismantled his own reputation by advocating eugenics, a racist and unscientific doctrine also adopted by the Nazis to justify their treatment of Jews, disabled people, and other minority groups.
But you already know that.
I'm starting to understand how so much of the right-wing got bamboozled by Trump and why they continue to support a guy and a party that tried to overthrow the legally elected government of the United States.