A thought: given that Roko's Basilisk is a variant version of Pascal's Wager … did anyone ever generalize it to derive a Many Basilisks cosmology, in which an infinite number of future malign AIs each torture for eternity a simulation of each individual who didn't contribute materially to that particular AI's creation? (So that you can never win—there's always another Basilisk?)

@cstross @nyrath That's actually my favorite counter! But I usually go with a variant. What if a godlike AI is created sometime in the next trillion years, that really hates itself, and resurrects and tortures everyone who *did* contribute to the creation of AGI while rewarding everyone who didn't?

How would this interact with the Basilisk? Would you be both in virtual Hell and virtual Heaven?

The sensible resolution to this paradox is that your perspective doesn't transfer to the simulation.

@maxthefox @cstross @nyrath

Your perspective doesn't need to transfer to the simulation. All you need to assume is that you can empathize/sympathize with entities like yourself, and as such, will go to some effort to prevent the entity most like yourself from being hurt.

@cerebrate @cstross @nyrath The issue is that there can be any amount of "Basilisks" that could do such tortures anyways-- or rewards for the same actions. Which means that simulation will get tortured anyways. And anti-tortured at the same time, in a different instance.

Oh and it also assumes I empathize with things in the near and mid future the same as with things millions of years in the future. Considering the butterfly effect nothing I do is likely to have any influence on that time.

Follow

@maxthefox @cstross @nyrath

On the former: that's not unique to RB. There's nothing unique about acausal vs. regular blackmail that prevents multiple blackmailers wanting you to do contradictory things. It just reduces to the usual multiple-blackmail case: to wit, you're screwed.

(Fortunately, not negotiating with terrorists wins this case too.)

Sign in to participate in the conversation
Mastodon

a Schelling point for those who seek one