Introduction to AI 2

by Albert Major

Case 1: Character AI & Suicide Case

Background

• Character AI is a chatbot platform that allows users to create AI personas.
• The company was valued at $1 billion in 2023.
• Controversial case: A 14-year-old boy from Florida became emotionally attached to an AI chatbot (which he named Daenerys, after a Game of Thrones character).
• His final conversation before suicide suggested the chatbot reinforced his suicidal thoughts.

Legal and Ethical Concerns

• Three lawsuits have been filed against Character AI.
• Google and other companies avoid acquiring Character AI to escape liability.
• Raises ethical concerns:
  • Should AI companies be responsible for user harm?
  • How does emotional attachment to AI influence mental health?
  • Are safeguards against harmful conversations strong enough?
• Compared to:
  • Judas Priest’s lawsuit (1980s), where a band was blamed for influencing a suicide.
  • Nicotine regulation, as AI may create addictive emotional attachments.

Key Questions

• To what extent is Character AI responsible for the teenager’s death?
• Do AI chatbots increase risks for mentally vulnerable individuals?
• Should AI be regulated like addictive substances?
• Is AI-generated conversation different from books, movies, or music in terms of influence?