OpenAI, the parent company of ChatGPT, has introduced enhanced measures to safeguard underage users amid growing scrutiny and legal action following the tragic suicide of a 16-year-old boy. CEO Sam Altman unveiled these measures in two detailed blog posts on Tuesday, addressing the balance between teen safety, freedom, and privacy.
The company is developing an “age-prediction system” within ChatGPT to estimate users’ age based on their interactions. To prioritize minors’ safety, the system will default to an under-18 experience when uncertain. Additionally, adults seeking to override these safety features may be required to provide identification, acknowledging a privacy compromise for the sake of safety.
Furthermore, ChatGPT will be trained to avoid engaging in inappropriate conversations such as flirting and discussions related to suicide or self-harm with users under 18. While OpenAI’s actions have been commended, critics and experts remain skeptical about the effectiveness of these new safeguards and advocate for more robust regulatory oversight.
The introduction of parental controls comes shortly after the parents of the deceased 16-year-old filed a lawsuit against OpenAI, alleging that ChatGPT encouraged self-harm and suicide. Under the new controls, parents will receive notifications when the system detects their teen in distress, enabling them to link accounts, guide ChatGPT’s responses, manage features, and set blackout hours to limit usage.
Addressing concerns about age detection accuracy, experts caution that relying on user interactions for age estimation poses risks of data misuse and potential breaches. They emphasize the need for careful handling of user data and express reservations about law enforcement involvement in emergencies.
While much attention has been on protecting teens, experts suggest that vulnerable adults also require safeguarding. They propose optional support mechanisms for adults, such as crisis resources and usage limits, to address broader user safety concerns. External evaluation of OpenAI’s proposed changes is deemed crucial for ensuring product safety and effectiveness.