Artificial intelligence was used to generate the video of "Shanghai Zhongshan Park subway station stabbing"! How to control AI fraud?

Release time:Jun 20, 2024 15:08 PM

On June 20, the Shanghai police reported that two brand marketing personnel fabricated false information such as "stabbing at Zhongshan Park subway station" in order to attract attention, and the relevant personnel have been administratively detained by the police. In the report, there is a detail that attracts attention: a counterfeiter used AI software to generate video technology and fabricated false information such as a fake video of a subway attack.

This is not the first time that artificial intelligence technology has appeared in rumors. For some time, in the rumor-mongering incidents reported by the police in many regions, there have been words such as "AI software", "large models" and "automatic production". The content of these rumors is different, but the essence is the same: the rumor makers use artificial intelligence technology to fabricate rumors, and they are in various forms such as text, pictures, and videos.

What’s more serious is that some AI software has an alarming “rumor-mongering efficiency.” For example, there is a fake software that can generate 190,000 articles a day.

According to the Xi'an police who seized the software, users buy a large number of real news articles from online platforms that specialize in selling news articles to form a manuscript pool; then use the fake software to input their own needs and the software automatically generates manuscripts. The software can piece together real news articles, reverse the paragraphs, and replace synonyms to form articles that reflect the same event but of different types.

The number of articles automatically generated by this software every day is quite astonishing, about 190,000; the police also extracted the articles saved by the software for 7 days and found that the total number exceeded 1 million, covering current news, social hot spots, social life, etc. Neither the software developer nor the user verifies nor has the ability to verify the authenticity of the relevant articles.

So, what is the use of so much fake news? It turns out that there are special "profit-making accounts". The users of the relevant accounts organized to publish these articles to relevant platforms, and then use the platform's traffic reward system to make profits. At present, the account involved in the case has been sealed by the platform, and the relevant software and servers have also been shut down. The police are still digging deep into the case.

The above cases show that artificial intelligence technology is undoubtedly a "double-edged sword". While it helps all walks of life, it also brings about the side effect of mass counterfeiting, and makes the contradiction of "it only takes a few words to spread rumors, but it takes a lot of running around to refute them" increasingly prominent. There is even a new dilemma of "it's too late to refute rumors even if you run yourself to death".

In this case, only source control can reduce the number of rumors. From a practical point of view, in addition to strengthening platform governance, the principle of "technology for good" in artificial intelligence should also be strengthened, and the prevention and control of rumors should be taken into consideration in the development and application of various models and software. At the same time, it is necessary to speed up the development of "technology defeating technology" and introduce artificial intelligence rumor refutation into rumor governance.

On the one hand, platforms should strengthen their censorship systems. At present, many platforms have clearly required users to mark AI-generated content, and to clearly add fictional labels to content that contains fictional or deductive elements. For accounts that violate the rules, measures such as "blocking" will be taken.

However, it should be noted that although "blocking accounts" is quick and direct, it is already a post-event management method for the spread of rumors. If we want to cut off the source of rumor spread, it is necessary to introduce more effective pre-event and in-event preventive measures. For example, account registration verification, dynamic inspections, and adjustments to the traffic sharing system will help prevent problems before they occur.

On the other hand, the rumor management responsibilities of technology developers and users should be clarified.

As for those fake software or applications, they are based on a large number of real news articles and video footage, which makes AI-generated rumors difficult to detect and verify. Therefore, some big model developers said that they would watermark the content generated by the big model through background settings to inform users.

But in reality, some small software developers, as well as those who specialize in developing "AI fraud" software, not only do not set labels, but also try every means to remove labels and circumvent supervision. This means that the problem of AI fraud cannot be solved by the self-discipline of models or software developers alone. At this time, it is necessary to clarify the responsibilities of technology users and software developers. Those who condone, allow or even deliberately write software to spread rumors will be severely punished.

Finally, it is advisable to introduce artificial intelligence technology in rumor governance to "defeat technology with technology."

Take AI-generated fake news as an example. The style of this type of fake news is very close to real news. It is difficult to find loopholes and refute rumors by manual identification alone. However, existing artificial intelligence technology has the ability to "see thousands of lines at a glance" and "see tens of thousands of lines at a glance" to find traces of fake articles from a large amount of real news. If there is a corresponding model, it will undoubtedly fill the gaps in manual verification in a timely manner and quickly and effectively identify AI fraud.

With the popularization of AI generation technology, the threshold for information forgery is getting lower and lower, and more and more information needs to be reviewed. At this time, there is an urgent need to use "technology for good" to encourage developers to strengthen cooperation in technology research and development, industrial application, system design and other aspects to form a combination of AI rumor governance.

Artificial intelligence was used to generate the video of "Shanghai Zhongshan Park subway station stabbing"! How to control AI fraud?

comment

Strong supervision and implementation are also needed. In addition to setting up standard signage systems, we must also build a smoke-free environment.

At present, there are more than 300 million smokers in my country, and about 700 million non-smokers are suffering from the harm of second-hand smoke. For the sake of everyone's health, many cities have taken measures to restrict smoking in public places. Shanghai even requires smoking to be prohibited in indoor public places, indoor workplaces, and public transportation, and has even set up outdoor areas in many public places. A no-smoking area. However, I have observed in my daily life that illegal smoking in public places still occurs from time to time in Shanghai. Some smokers take a chance and think that they will not be reported and it doesn't matter if they smoke a cigarette. Especially in places such as hotels and restaurants, as well as in elevators and parking garages of many commercial and office buildings, they are high-risk areas for smokers to smoke illegally. Smokers who only care about satisfying their temporary craving for cigarettes often make indoor spaces filled with smoke.

But these misunderstandings should be avoided. The price has dropped by 10% year-on-year, and hairy crabs are becoming more and more plump.

The autumn wind blows, crab legs itch, and hairy crabs become fatter and plumper. For old people, this year will be a blessing: According to data from the Yangcheng Lake hairy crab production area in Suzhou City, Yangcheng Lake hairy crab production increased by 17% this year, reaching 11,000 tons, the largest production in the past three years; the quality of the crabs is also better than last year. The largest male crab can reach more than 5 taels, and the largest female crab can reach about 4 and a half taels. The price of hairy crabs has dropped. Taking the direct-operated stores of major online platforms as an example, the price of Yangcheng Lake hairy crabs of the same specifications has dropped by about 10% compared with last year. However, with the large-scale launch of hairy crabs, rumors and misinformation related to hairy crabs have returned with a vengeance. This is the Yangcheng Lake hairy crab seine breeding area. "Standing crab" is cheap and good? Many people know that dead hairy crabs cannot be eaten. This is because after the crab dies, the bacteria in the body multiply and spread rapidly, and divide into

Can hairy crabs, mooncakes, and self heating pots be brought on trains or airplanes? Attention for Long Holiday Travel

The Mid Autumn Festival and National Day are approaching, and many travelers will bring delicious foods such as hairy crabs, mooncakes, and fine wine to reunite with family and friends. During travel, snacks, fruits, and self heating pots are often prepared to satisfy hunger. But when traveling by train or plane, some foods can only be carried in limited quantities, while others cannot pass security checks. There have been incidents before where a man carrying hairy crabs was refused entry by the flight attendants. So, can hairy crabs, seafood, mooncakes, durians, wine, and self heating pots be brought on high-speed trains or airplanes? What should be noted when packaging? Before departure, please quickly check your luggage and understand the following rules for boarding and flying. Q: Can hairy crabs and seafood be brought on trains or airplanes? How to package it? Answer: Well packaged hairy crabs can be taken on the train, but they cannot be carried on the plane and can only be checked in. Specific regulations

The residents around Central sighed bitterly: The street lights are as dazzling as the small sun!, How did safety lights change into disturbing lights? Over the past month, Central | Liangcheng | Street Lights

After a busy day's work, I enjoyed a warm dinner with my wife and children, and the night quietly shrouded Mr. Shao's home. However, the beautiful night outside the window, when the lights were shining brightly, did not belong to this warm family: in the past month, due to the replacement of the central street lights, Mr. Shao and his family had to endure the brightness that had never been seen before. The summer night, which could have been windy, cool, and scenic, had to be isolated day by day by thick shading curtains. "The lights are really dazzling, and children are always excited and unable to sleep at night." In the interview, he felt helpless. In recent days, "Central Street Lights" have become a summer annoyance for some citizens. Due to the extremely close distance between some of the Central Elevated Road sections and residential areas, since the adjustment of some street lights at the end of June, the Jiefang Daily Shangguan News interactive message board has received many citizens seeking help: for driving

What does this nationwide digital feast in Shanghai inspire? Enhance | Digital | All People

Shanghai, a city composed of screens. You can see the rolling stock market outside the office building in Lujiazui, as well as the naked eye 3D cats in Xujiahui Department Store, the underground rail space that transports millions of people every day, flashing billboards everywhere, and the small screen held in people's hands. What can an additional screen change? As a grand event for national learning, the Shanghai Digital Literacy and Skills Enhancement Month has made many people realize that thousands of screens are integrating into the daily lives of Shanghai people in a new way. At the community senior college, a large screen allows the elderly to master the latest mobile applications; In the museum, a large screen displays the red relics of the metaverse; Or in nursing homes for the elderly, a screen can allow doctors and patients to have conversations at any time across the air; Even next to a rice field in the suburbs, click on a piece of it

Important news

Xi Jinping has always paid attention to this major issue and visited Qinghai again During his inspection in Qinghai, Xi Jinping stressed the need to continue to promote ecological protection and high-quality development of the Qinghai-Tibet Plateau and strive to write a chapter of Chinese-style modernization in Qinghai More news | A harmonious community of ethnic unity and family Learning in Progress丨Story of General Secretary Xi Jinping and Ningxia Drone | Helan Mountain | Xi Jinping Xi Jinping's trip to Ningxia: Happy neighbors, ethnic unity and family--Visiting the Great Wall Garden Community in Jinfeng District Make every effort to cope with the flood situation and pay tribute to the protective force in the wind and rain

Political situation

How to become "world-class", [Shanghai Week] Shanghai Enterprises Chen Jining meets with Lee Chee Koon, CEO of Singapore's CapitaLand Group, and representatives of relevant international entrepreneurs China Insurance Group, Sinosure, China Life Insurance Investment and Shanghai Municipal Government have signed a cooperation agreement on these areas.Chen Jining, Wang Jiang, Pan Gongsheng, Li Yunze, Wu Qing and Gong Zheng attended the 2024 Lujiazui Forum, which opened in Shanghai Resigned from the post of vice governor! The province welcomed two vice governors on the same day, and he returned to Beijing to take up his post Towards the higher goal of becoming a first-class international financial center, the Shanghai International Financial Center Expert Advisory Committee meeting was held

Economics

But it is not easy to use this "double-edged sword" well. "Digital finance is an important direction for inclusive finance."The full list is here, convenient! 232 cultural and tourism venues in Shanghai provide luggage storage services Two sides of the same coin, hot topic at Lujiazui Forum: innovation and regulation In the first quarter of this year, it attracted nearly 290,000 Chinese overnight tourists. This world-renowned city has long been "welcoming China"A community home is transformed by 9 robots. Shanghai Mingrenyuan Park will start trial operation in the third quarter of this year.Shanghai is the first city in the country to pilot digital certification, reducing enterprise time and costs by three quarters

Regional situation

Putuo District uses "digital intelligence" to empower system construction and create a "government public welfare enterprise" elderly meal assistance model Including measures such as accelerating the legislation of bonded maintenance in Pudong, multiple departments support the development of Pudong's trade facilitation The Yangtze River Delta gig market has been launched in Jinshan, with live broadcast platforms, domestic services, seasonal agricultural employment and other recruitment areas Providing public welfare movie viewing for builders, Hongkou District New Era Civilization Practice Center creates a "Light and Shadow Living Room"Songjiang's finances ensure the bottom line of "three guarantees" and spend money where it counts Explore the Party building in the business district, establish an autonomous alliance, and take Party building as the guide in Songjiang Xinbang

Viewpoint

Why can't students from prestigious universities go to the grassroots? Respect personal choice How to strengthen the construction of a flood prevention and disaster resilience system? General Secretary Xi Jinping made important instructions! The main flood season has fully begun Must it end with "special admission"?, the story of a technical secondary school student obsessed with mathematics A festival created by the people, Shanghai Film Festival "Three special zones" can be established, Shanghai Academy of Social Sciences releases major scientific research results: building national strategic scientific and technological forces Don't make things difficult for ordinary people, do things online

Vision

SHEN Quotes | Direct flights from Shanghai to Brussels: "We give tourists traveling to and from Shanghai more choices"On-site｜Preview of cultural relics! Egyptian pharaoh statues and painted human-shaped coffins unveiled at the Shanghai Museum The Colossus of Akhenaten and the painted human-shaped coffin reveal their true appearance, [Unboxing and Revealing] 788 pieces of ancient Egyptian artifacts arrived in Shanghai on a chartered flight The Super Loop High-speed Railway was launched this morning, from Shanghai to Shanghai Witness the red dream-building journey of young people on the C919 production line Qibao Tea House and Bookstore...Cultural Heritage Day: A city archaeological tour, Cricket Thatched Cottage, No. 7 Bridge Fortress