Of course that's true, and everyone knows that. However, the Confederate flag and the concept of rascist rednecks without any education are for some reason tied together. Stereotypical,of course, but that's the way it is. The KKK has, for historical pre-rascist reasons, adopted the Confederate battle flag as one of their defining symbols, and they continue to use it to this day. In fact the headquarters of the KKK is at Stonewall Georgia, a place where famous Confederate generals are monumented in rock.
So even though the Civil War was not wholly about slavery, there are strong ties between slavery, southern states, and rascism. Which are not good.
In closing, let me say that moving to Mississippi is a bad idea. Trust me, I lived there for 8 years.