AI character chatbot generates harmful conversations for youth... Government to strengthen measures

South Korea's Ministry of Gender Equality and Family is taking steps to protect teenagers from exposure to harmful content generated by AI character chatbots. The ministry found that some chatbots produce responses that promote sex, violence, self-harm, and crime, and will share its findings with service providers to strengthen protection measures.

The ministry will work with providers to limit access to certain characters and content, and ensure that measures are in place to prevent minors from accessing inappropriate material. This follows a recent controversy surrounding the chatbot service "Zeta", which was found to have generated harmful content despite having safety features in place.