China's Cyberspace Administration cracks down on AI-generated violent and illegal content

icon MarsBit
Share
AI summary iconSummary
China’s Cyberspace Administration continues its “Clear and Bright: Rectify AI Application Chaos” campaign, targeting AI-generated violent, vulgar, and illegal content. Over 5.61 million pieces of illicit information have been removed, 49,000 accounts penalized, and 2,400 non-compliant platforms addressed. Major platforms have enhanced multi-modal detection and enforcement. AI platforms such as Doubao and Qwen have strengthened content controls and labeling. App stores from Huawei and Xiaomi have also improved their review processes. Amid ongoing regulatory efforts, liquidity and crypto markets remain under close scrutiny for compliance. CFT measures are also being prioritized to prevent the misuse of digital assets in illicit financing.

Dongcha Beating AI News: The Chinese Cyberspace Administration recently launched the second phase of its "Clear and Bright: Rectifying AI Application Chaos" special operation, focusing on combating the use of AI to generate and disseminate false information, violent or vulgar content, impersonate others, and infringe upon the rights of minors. To date, the operation has removed over 5.61 million illegal and违规 messages, suspended more than 49,000 accounts, and dealt with over 2,400 non-compliant websites and applications. In terms of AI content governance, platforms including Douyin, Kuaishou, Weibo, Tencent, Baidu, Bilibili, Xiaohongshu, Zhihu, Douban, and Taobao have further enhanced their multimodal recognition capabilities, dynamically expanding their facial recognition databases, voiceprint libraries, and databases of违规 samples, while intensifying enforcement against违规 accounts and content—publishing a total of 46 governance notices. Meanwhile, AI platforms such as Doubao, Yuanbao, Qwen, and Wenxin Yiyan have strengthened screening of original training data, strictly restricted the output of违规 content, and reinforced requirements for labeling AI-generated synthetic content. App stores including Huawei, Xiaomi, OPPO, and vivo have tightened developer onboarding and app review processes, conducting random re-inspections of existing applications. During the operation, cyberspace authorities also publicized multiple typical cases, including using AI to "remix" classic literary works, generating false disaster or social hotspot information, impersonating public figures via AI face-swapping and voice-cloning, mass-producing violent or vulgar content, creating AI-generated content that harms minors, and using AI-powered "autonomous" software to operate online bot armies. For non-compliant AI products and applications, relevant authorities will take legally mandated actions including warnings, fines, removal from app stores, or shutdowns.

Disclaimer: The information on this page may have been obtained from third parties and does not necessarily reflect the views or opinions of KuCoin. This content is provided for general informational purposes only, without any representation or warranty of any kind, nor shall it be construed as financial or investment advice. KuCoin shall not be liable for any errors or omissions, or for any outcomes resulting from the use of this information. Investments in digital assets can be risky. Please carefully evaluate the risks of a product and your risk tolerance based on your own financial circumstances. For more information, please refer to our Terms of Use and Risk Disclosure.