I think part of the issue is that there is a subset of the left that thinks being right-wing is unacceptable.

But they can't say that, so they try to stretch terms like "white supremacy", which can be attacked, to cover their targets.