AI amplifies 'misinformation around dieting, mental health and politics', young people say

The views and recommendations in the report were drawn from what the body referred to as an AI Youth Juries process, which draws on the principles of a citizens’ assembly, to allow young people to give their verdicts on how AI is impacting their lives. File picture

Young people in Ireland want national guidelines on artificial intelligence (AI) use in schools and tailored regulation to protect from the risks of AI ‘companions’, a new report has found.

Furthermore, many feel that existing age verification systems are easily bypassed by their peers, and such systems require significant improvement.

The National Youth Council of Ireland, along with the Ombudsman for Children’s Office and Insight Research Centre for Data Analytics at DCU, launched the report on Thursday into young people’s views, concerns and recommendations on AI as such tools become ever more ubiquitous and mainstream.

“AI is already shaping how young people learn, communicate, access information and understand the world around them,” National Youth Council of Ireland chief executive Mick Ferron said. “But young people have been clear through this process: they do not want to be left to figure this out alone.” 

The views and recommendations in the report were drawn from what the body referred to as an AI Youth Juries process, which draws on the principles of a citizens’ assembly, to allow young people to give their verdicts on how AI is impacting their lives.

At the final stage, 48 young people were selected and spread across the country, with minority groups also represented. Their work was broken down across a range of themes, including AI and the environment, chatbots and companions, misinformation and radicalisation, education, and the future of jobs.

In terms of the environment, the youth juries said they were deeply concerned about the impact of data centres and called for transparency in energy and water consumption of such sites. Concerns about the use of chatbots for emotional support, mental health advice and companionship were also highlighted.

“They recommended prohibiting AI chatbots from providing health advice and requiring continuous safety warnings such as ‘this is not a real person’,” the report said. “Young people want clearer opt-out options, stronger age-verification systems, parental controls and tailored regulations for AI ‘companions’ that pose heightened risks.

“Young people see misinformation especially around dieting, mental health and politics as a growing threat amplified by AI.” In terms of these misinformation threats, they called for limiting targeted advertising to children, mandatory disclosure of paid promotion in AI systems, and strengthened oversight of recommender algorithms.

AI and education

On education, the jury said there was a “widening digital divide” based on unequal access to high-quality AI tools, and proposed a publicly owned, ethical and free AI chatbot for students. Such a chatbot should not replace critical thinking or act as someone’s therapist.

“They call for national guidelines for AI use in schools, a State-led AI literacy campaign, and compulsory AI education delivered through schools and youth work,” the report added.

Jury member Nathan Geszczak, aged 16, said an assumption is often made that all young people are “digital natives” who have no problem understanding and navigating new technologies.

“What we heard through the juries is that young people need far more support, including practical education and accessible information we can trust,” he said.

Ombudsman for Children Dr Niall Muldoon added that the report showed that young people must be listened to as they are most exposed to experiencing AI-related harm, with Government and regulators required to step in.