Follow

The simplest case for why voluntary lie-detection technology ("Cognitive Veracity Meters") is essential for the longterm morality of earth-originating life is this:

A) Most of our prosocial motivation develops as a consequence of being rewarded for making other people like us. (Indirect reciprocity.)

B) That incentive cannot reach the deepest parts of our decision-making algorithm, unless our intentions are transparent / cheaply verifiable.

C) CGM makes our intentions cheaply verifiable.

This incidentally is also why a high level of interpretative charity is so important for cultivating good intentions in a community. Whenever you socially reward/punish weak proxies for good/bad intentions, you invite Goodhart into the reward function.

Sign in to participate in the conversation
Mastodon

a Schelling point for those who seek one