Warning shot

The expression warning sign is sometimes used to describe any event that increases concern about a particular category of existential risk, regardless of whether the event itself constitutes a global catastrophe. For example, plausible candidates for an AI warning sign include not only a catastrophic failure by an AI system but alsoand public outreach campaigns or the publication of an exceptionally persuasive book on AI safety.^[1] 

A related notion is that of a fire alarm, a warning sign that creates common knowledge that some technology—typically advancedavanced artificial intelligence—actually poses an existential risk.^[2]

A related notion is that of a fire alarm, a warning sign that creates common knowledge that some technology—typically dvancedavanced artificial intelligence—actually poses an existential risk.^[2]

A warning shot is a global catastrophe that indirectly reduces existential risk by increasing concern about risks of future catastrophes. 

A warning shot is a global catastrophe that increases awareness andindirectly reduces existential risk by increasing concern about risks of similar future catastrophes and thus reduces the probability of an existential catastrophe.catastrophes. 

The expression warning sign is sometimes used to describe any event that increases awareness and concern about a particular category of existential risk, regardless of whether the event itself constitutes a global catastrophe. For example, plausible candidates for an AI warning sign include not only a catastrophic failure by an AI system but also public outreach campaigns or the publication of an exceptionally persuasive book on AI safety.^[1] 

A warning shot is a global catastrophe that increases awareness and concern about risks of similar future riskscatastrophes and thus reduces the probability of an existential catastrophe.

A related notion is that of a fire alarm, a warning sign that creates common knowledge that some technology—typically dvanced artificial general intelligence—actually poses an existential risk.^[2]

artificial intelligence | existential risk | global catastrophic risk

Carlsmith, Joseph (2021) Is power-seeking AI an existential risk?, Open Philanthropy, April, section 6.2.

Note, however, that both "warning shot" and "fire alarm" are sometimes used as synonyms for "warning sign".^[3][4]

The expression warning sign is sometimes used to describe any event that increases awareness and concern about a particular category of existential risk, regardless of whether the event itself constitutes a global catastrophe. For example, plausible candidates for an AIAI safetywarning sign include not only a catastrophic failure by an AI system but also public outreach campaigns or the publication of an exceptionally persuasive book on AI safety.^[1] However, sometimes the expression "warning shot"

A related notion is itself used in this expansive sense.that of a fire alarm, a warning sign that creates common knowledge that some technology—typically artificial general intelligence—actually poses an existential risk.^[2] 

Note, however, that both "warning shot" and "fire alarm" are sometimes used synonyms for "warning sign".^[3][4]

1. ^{^}

   Hobson, Donald (2020) Comment on ‘What are the most plausible “AI Safety warning shot” scenarios?’, AI Alignment Forum, March 26.

2. ^{^}

   Grace, Katja (2021) Beyond fire alarms: freeing the groupstruck, AI Impacts, September 26.

3. ^{^}

   Kokotajlo, Daniel (2020) What are the most plausible ‘AI Safety warning shot’ scenarios?, AI Alignment Forum, March 26.

4. ^{^}

   McCluskey, Peter (2021) AI fire alarm scenarios, Bayesian Investor, December 23.

The expression warning sign is sometimes used to describe any event that increases awareness and concern about a certainparticular category of existential risk, regardless of whether the event itself constitutes a global catastrophe. For example, plausible candidates for an AI safety warning sign include not only a catastrophic failure by an AI system but also public outreach campaigns or the publication of an exceptionally persuasive book on AI safety.^[1] However, sometimes the expression "warning shot" is itself used in this expansive sense.^[2] 

The expression warning sign is sometimes used to describe any event that increases awareness and concern about a certain category of existential risk, regardless of whether the event itself constitutes a global catastrophe. For example, plausible candidates for an AI safety warning sign include not only a catastrophic failure by an AI system but also public outreach campaigns or the publication of an exceptionally persuasive book on AI safety.safety.^[1] However, sometimes the expression "warning shot" is itself used in this expansive sense.^[2]