Artificial intelligence is increasingly embedded across business, education and healthcare, but rising concerns about its misuse are prompting renewed scrutiny from policymakers and child safety advocates.
In recent years, AI technologies have been widely adopted to improve efficiency and innovation. Researchers are leveraging advanced systems to interpret complex medical data, while businesses are using automation to streamline logistics and operations. In education, AI tools are also being explored as a means to support teaching and learning outcomes.
However, alongside these benefits, experts warn that the rapid expansion of AI capabilities is introducing new risks, particularly for younger users.
Over the past decade, the digital landscape has evolved at a pace that many families have struggled to match. Early concerns surrounding social media — including excessive screen time, cyberbullying, online predators and long-term reputational risks — remain relevant. Yet, the emergence of generative AI has added a new layer of complexity.
Modern AI systems are now capable of producing highly realistic images, videos and conversations within seconds, often with minimal human oversight. While these capabilities offer legitimate applications across industries, they are also being exploited in harmful ways.
Recent attention has focused on Grok, an AI tool integrated into the social media platform X. Its accessibility — both within the platform and as a standalone application — has raised concerns about its availability to younger audiences.
Reports indicate that such tools are being misused to create explicit content without consent, including material involving minors. This development aligns with broader warnings from child protection organisations about the rise of AI-generated deepfake content targeting children and teenagers.
According to a 2024 report by THORN, one in ten minors said they knew peers who had used generative AI tools to create manipulated images of other children. With AI technology continuing to advance and become more accessible, stakeholders believe the scale of the issue may have increased further.
A key concern lies in the ease with which such content can be produced. Images sourced from publicly available social media profiles can be altered within moments, creating material that can damage reputations and lead to significant emotional distress.
For affected families, the consequences can be severe. Once such content is circulated online, it can spread rapidly across platforms, making removal difficult. Victims may face harassment, social stigma or coercion, particularly where individuals threaten further distribution.
Law enforcement agencies are also facing challenges in responding effectively. Many existing legal frameworks governing exploitation and harassment were established before the rise of generative AI, leaving gaps in how such cases are addressed.
In response, policymakers across the United States are beginning to explore regulatory measures. While some laws now criminalise the creation of AI-generated explicit material involving minors, critics argue that more comprehensive action is required, particularly in holding platforms accountable for misuse.
Advocacy groups, including the Oklahoma Institute for Child Advocacy, have been actively engaging with legislators to ensure that legal protections evolve alongside technological change. Their work has contributed to ongoing discussions around internet safety and child protection.
The broader debate reflects a growing consensus that while AI will play a transformative role in the global economy, safeguards must keep pace with innovation. Businesses developing AI technologies are also facing increasing pressure to implement stronger controls and ethical frameworks.
Ultimately, stakeholders across sectors — including parents, educators, policymakers and technology companies — are being urged to collaborate in addressing these emerging risks. As AI continues to reshape digital interactions, ensuring that its benefits do not come at the expense of child safety remains a central challenge for regulators and industry alike.
