What happened
TikTok banned 20 accounts after a BBC investigation, conducted with AI publication Riddance, exposed AI-generated black female influencers promoting sexually explicit content. These unlabelled avatars, often sexualised with exaggerated features, included deepfakes manipulating real content creator videos; one such video of model Riya Ulan garnered 35 million TikTok views and 173 million on Instagram. Instagram's parent company, Meta, stated it is investigating similar accounts.
Why it matters
Platform content moderation and AI content labelling enforcement face critical failures. For platform engineers, the scale of unlabelled, exploitative AI content demonstrates current detection limitations, requiring enhanced automated and human review systems. Security architects face increased risk from deepfake technology used to misappropriate likenesses, necessitating strong identity verification and content provenance tools. Founders must recognise the growing liability and reputational damage from AI misuse on their platforms, particularly as TikTok's policies require visible labelling for realistic AI-generated visuals and audio.
Subscribe for Weekly Updates
Stay ahead with our weekly AI and tech briefings, delivered every Tuesday.
