The disturbing trend of state media use of deepfakes
Social media has been awash with fake images of a stylish Pope Francis, Elon Musk protesting in New York and Donald Trump resisting arrest.
- Social media has been awash with fake images of a stylish Pope Francis, Elon Musk protesting in New York and Donald Trump resisting arrest.
- Such AI-generated images and videos, or deepfakes, have become increasingly accessible due to advances in artificial intelligence.
- As more sophisticated fabricated images spread, it will become increasingly difficult for users to differentiate the real from the fake.
Fake news anchor
- Leading the way, China’s state media has experimented with an AI news anchors, named Ren Xiaorong.
- Ren, although not the first AI news anchor developed by in China, illustrates both the commitment to the technology and the incremental increases in realism.
- When looking at these anchors, we might object that only the most naive viewer would mistake them for real humans, such as Russia’s first robotic news anchor.
Fabricated news
- China’s transparency in using AI-generated news anchors stands in contrast to Venezuela’s fabricated news coverage.
- However, the stories and anchors are fabricated.
- Fabricated videos of Ukraine President Volodymyr Zelenskyy discussing surrender to Russia were also circulated during the ongoing Russia-Ukraine conflict.
Disinformation and believable fakes
- The spread of disinformation requires that we understand how ideas, innovation or behaviour spread within a social network, referred to as social contagion.
- Disinformation has the appearance of information, except uncertainty is reduced at the expense of accuracy.
- Observations that disinformation spreads faster that facts likely stems from the fact that when a message is simple, it increases our confidence.
- It must appear close enough to the “truth” that it is believable.
Social networks and contagion
- While we look for credible source of information — experts or peers — our memory stores information separately from its source.
- Over time, this failure of source monitoring results in our retrieval of information from memory with understanding its origin.
Legal, social and moral issues
- The accusation of “fake news” has become a tactic used to discredit any argument.
- Social media users have already falsely claimed that real videos of U.S. President Joe Biden and former U.S. president Donald Trump are fake.
- The time required for verification — especially if left to the user — allows disinformation to propagate.
- The only way to combat harmful forms of artificial intelligence is to cultivate human intelligence.