Another good-faith argument is based on values. We all, hopefully, agree that on balance supremacist values are contemptible. The protesters mainly oppose supremacists, removal of statues is just a battle field that happen to be selected by supremacists. The end goal of protesters isn't to remove statues, but to oppose supremacists. It is these supremacists who happened to make these historical statues a battleground and issue today, therefore it isn't historical context but today's context that should matter. Unmistakably, today's context is largely defined by supremacists and their values unmistakably make it racist.
However, going full retard and calling Derid a racists provides for better entertainment value.