AI risk

We’re creating and concentrating immense amounts of power. How can we avoid catastrophe?

Types of risk

• AI misuse
  • AI misinformation risk
• AI misalignment risk
• Social upheavals
  • Will generative AI cause catastrophic economic dislocation?

Related

• Many eminent AI scientists fear (various kinds of) AI risk
• AI capabilities research seems to be outpacing AI alignment research
• What is my personal moral responsibility with respect to AI risk?

So what? Slow down AI? Accelerate AI alignment work? Unclear.

References

Weidinger, L., Mellor, J., Rauh, M., Griffin, C., Uesato, J., Huang, P.-S., Cheng, M., Glaese, M., Balle, B., Kasirzadeh, A., Kenton, Z., Brown, S., Hawkins, W., Stepleton, T., Biles, C., Birhane, A., Haas, J., Rimell, L., Hendricks, L. A., … Gabriel, I. (2021). Ethical and social risks of harm from Language Models (arXiv:2112.04359). arXiv
Threat Model Literature Review - LessWrong