China Is Abusing AI - The Atlantic

Listen−1.0x+<br>Seek<br>0:008:05

China’s release of yet another impressive open-source AI model has lately raised urgent questions in Silicon Valley about which country will dominate the AI market. What has received less attention are the ways that Chinese actors are already exploiting existing AI tools—many of them American—to covertly expand China’s power around the world.<br>OpenAI claimed last month that a propagandistic English-language comic posted on X about the expensive energy needs of AI data centers was actually part of a covert campaign by the Chinese government to turn Americans against the build-out of AI infrastructure. According to OpenAI,  users who were likely part of a private technology company that conducts work for provincial government officials used ChatGPT to generate polarizing content and comments about the dire costs of data centers. Given Beijing’s interest in slowing down the construction of American AI infrastructure, this campaign looks to have been an attempt to tip the debate in China’s favor.<br>OpenAI banned the suspect accounts, and the data-center campaign seems to have gained little traction. A Chinese-embassy spokesperson in Washington, D.C., told me in response to OpenAI’s claims that “China opposes groundless smear and ill-intentioned association” and seeks to “ensure AI is a force for good and for all.” Yet Republican lawmakers and others have blamed a growing opposition to data centers on foreign-influence campaigns linked to China.<br>This incident highlights an uncomfortable truth about the world’s most influential emerging technology: AI can be a stealthy and effective weapon of propaganda, because it can create the illusion of widespread support. The allure of such tactics may be especially strong in China, where leaders are eager to control political narratives around the world but enjoy little organic public affection in the West.<br>Read: The race for global domination in AI<br>The Communist Party has always moved quickly to adopt new technologies to expand its influence. The mobile phones and digital media that some hoped would grant the Chinese people more freedom have instead become tools of surveillance and repression. Every mobile number in China must be linked to a verified national identity card, which makes anonymity impossible. Even before pro-party AI ruses were possible, the Chinese government and its supporters flooded social media with pro-China propaganda and vicious attacks on critics.<br>Now, with AI, China’s government is able to create more credible propaganda campaigns, target susceptible groups with greater precision, and better analyze the results—all in the service of promoting Beijing’s interests domestically and overseas. “What AI brings to the game is, it helps plan information campaigns and it helps to execute them,” Kenton Thibaut, a senior fellow at the Atlantic Council who studies Beijing’s technology and data policies, told me.<br>OpenAI’s disclosures shed some light on how Chinese operatives are using existing AI models. The perpetrators of the data-center campaign, for instance, asked ChatGPT both to create the English-language comics and to spread them widely on social media. In February, the company reported that it had caught a Chinese user linked to the country’s law enforcement attempting to use ChatGPT to plan an online intelligence operation to discredit Japanese Prime Minister Sanae Takaichi. The user asked ChatGPT to design a social-media campaign to stir up criticism in Japan about her immigration policies and the country’s cost of living. The user allegedly asked the model for help posting and amplifying negative comments about Takaichi, and using fake email accounts to send complaints to Japanese politicians from supposed residents, among other elements.<br>OpenAI noted that ChatGPT had refused to cooperate in this Japan campaign but that the user’s activities revealed a “large-scale, resource-intensive and sustained” covert operation—involving “at least hundreds of staff” and “thousands of fake accounts across scores of platforms”—to suppress dissent both in and outside of China. Most targets were critics of China, and the tactics included creating fake social-media accounts and swamping platforms with pro-Beijing posts, spreading false information about dissidents, and forging documents. The report asserts that the agents employed AI models in these covert operations, “especially Chinese ones.”<br>The Communist Party’s use of AI to tighten its grip can already be felt inside China. Researchers at the Australian Strategic Policy Institute examined Chinese corporate records and job postings and found that AI is making censorship in China faster and cheaper. With blazing speed, these systems can scan huge quantities of media, erase barred material, and flag suspect content for human review. This has made the state’s control over information “far more pervasive, granular and reflexive to the censorship needs of...