Misalignment in cancers and antibiotic resitant bacteria, and selecting against is not enough
@niplav I think I don't know what misalignment means in this context.
@Paradox you're right
Okay
Adversarial selection pressure against something can worsen the badness of the thing, monotonic in the strength of the pressure
This might also apply to misaligned AI systems selected by search
@niplav Ok I imagine adversarial selection pressure means that you're just telling the AI to not do X, and the more you punish that, the worse a thing gets, but I don't know why it would do that.
@Paradox good Q! Best option I know is kill on the first try
Otherwise 🤷
@niplav Ohhh yeah.
Cuz when you use antibiotics too much, it gives them the resources to figure out how to resist it. That's kinda just evolution. If you don't get rid of a thing entirely, it will eventually become harder to do so. So what's the alternative here?