The simplest case for why voluntary lie-detection technology ("Cognitive Veracity Meters") is essential for the longterm morality of earth-originating life is this:
A) Most of our prosocial motivation develops as a consequence of being rewarded for making other people like us. (Indirect reciprocity.)
B) That incentive cannot reach the deepest parts of our decision-making algorithm, unless our intentions are transparent / cheaply verifiable.
C) CGM makes our intentions cheaply verifiable.
Follow
This incidentally is also why a high level of interpretative charity is so important for cultivating good intentions in a community. Whenever you socially reward/punish weak proxies for good/bad intentions, you invite Goodhart into the reward function.
