Open racists are marginalized by a society who rejects their ideals and philosophies, and as they are pushed to the fringes they become irrelevant. An isolated incident of violence, while tragic, isn't a societal danger because it impacts so few people.
Soft racism of low expectations is far more dangerous to minority groups and society as a whole because it has broad and far reaching impacts across the entire population, and has a high probability of becoming systemic.