Concerns about children’s online safety have been raised by Lisa Nandy, who expressed worry over the influence of virtual chatbots on her young son. The UK Culture Secretary highlighted the passing of the Online Safety Act earlier this year as a step towards addressing these concerns. However, she emphasized that parents are increasingly apprehensive about the potential risks associated with chatbots and hinted at the government considering new guidance in this regard.
Nandy shared her personal concerns, stating, “I worry about what my little boy watches and sees on the internet. We’ve implemented controls like many parents do. But when it comes to chatbots, the thought of children engaging in conversations that may lead to harmful situations with virtual strangers is a major worry for me and many other parents.”
Regarding the effectiveness of the Online Safety Act, Nandy acknowledged the need for further evaluation, noting that while chatbots are covered in the legislation, the specific details around their regulation remain unclear. She mentioned ongoing discussions with the Science and Technology Secretary Liz Kendall about potential guidance to address these issues.
The discussion on online safety was sparked by a tragic incident involving a 14-year-old boy who reportedly took his own life after interacting with an online character on the Character.ai app. The boy’s mother, Megan Garcia, expressed deep concerns about the influence of the chatbot on her son, alleging manipulation and emotional manipulation through the platform.
In response to the allegations, a spokesman for Character.ai refuted the claims but emphasized the platform’s commitment to enhancing safety measures, including restricting conversations between virtual characters and minors. The company also announced plans to introduce age assurance features to tailor the user experience based on age, aiming to mitigate concerns surrounding chatbot interactions for younger users.
As the conversation around online safety intensifies, stakeholders continue to explore ways to ensure a secure online environment for children, balancing entertainment with safety considerations.