Hank never hated Khan for the color of his skin, but because the guy was a jackass. With the conflict being that Hank wasn’t actually allowed to be the slightest bit disrespectful to him because Khan was the one non-white guy on the block.