Fake videos and doctored photographs, often based on events such as the Moon landing and supposed UFO appearances, have been the subject of fascination for decades.
Such imagery is often deep fake content, called so because it uses deep learning associated with neural networks and digital image processing.
The company proposed it would warn users about deep fake content by flagging tweets with â€œsynthetic or manipulated mediaâ€. Twitter says media may be removed in cases where it could lead to serious harm, but has stopped short of enforcing a strict removal stance. Users have until November 27 to provide feedback.
In adopting this warning-only approach towards deep fakes, the social media giant has shown poor judgement.
Videos of former Saturday Night Live comedian Bill Hadar discretely morphing into Tom Cruise and Seth Rogen during an interview have been doing the rounds on the internet. While it looks like another tale of internet magic, it points to something darker stirring in the internet's depths. The video exists thanks to deepfake technology and while its realism is still in its infancy, itâ€™s fast becoming one of the most terrifying developments in technology. To better understand how it works and what it means the future, we peeked under the covers.Read more
Why deep fakes are dangerous
With advances in computer science, deep fakes are becoming an increasingly powerful tool to deceive people using social media.
Deep fake clips of celebrities and politicians are realistic enough to trick users into making financial, political and personal decisions based on the fake testimony of others.
Whether itâ€™s a David Koch erectile dysfunction cream scam, an announcement by Donald Trump that AIDs has been eradicated, or a fake interview with Andrew Forrest leading to a finance scam, deep fakes present a serious risk to our ability to trust what we view online.
Social media companies have so far taken a sloppy approach to this threat. They have even promoted the use of photo algorithms letting users experiment with animated face masks, and provided tutorials on how to use editing programs.
Twitterâ€™s latest draft policy on deep fakes sets a dangerous precedent. It allows social media platforms to handball away their responsibility to protect customers from manipulated videos and imagery.
Twitter should be just as accountable as television
Itâ€™s time social media giants such as Twitter started seeing themselves as the 21st century version of free-to-air television. With TV, there are clear guidelines about what cannot be broadcast.
Since 1992, Australians have been protected by the 1992 Broadcasting Services Act, ensuring what is shows in â€œfair and accurate coverageâ€. The act protects viewers in regards to the origin and authenticity of television content.
The same principles should apply to social media. Americans now spend more time on social media than they do watching television, and Australia isnâ€™t far behind.
By suggesting they only need to flag tweets with deep fake content, Twitterâ€™s proposed policy downplays the seriousness of the threat.
Sending the wrong message
Twitterâ€™s draft policy is dangerous on two fronts.
Firstly, it suggests the company is somehow doing its part in protecting its users. In reality, Twitterâ€™s decision is akin to watching a child struggle to swim in heavy surf, while nearby authorities wave a sign saying: â€œsome waves may be hard to judgeâ€ – instead of actually helping.
The second reason Twitterâ€™s proposition is dangerous is because social media trolls and sock puppet armies enjoy surprising online audiences. Sock puppets are specialists in deceiving users into believing theyâ€™re a single fake person (or multiple fake perople) by means of false posts and online identities.
Basically, content that has been signposted as deep fake will be exploited by people wanting to amplify its spread. Itâ€™s unrealistic to suppose this wonâ€™t happen.
If Twitter flags posts that are fake, yet leaves them up, the likely outcome will be a popularity surge in this content. As per social media algorithms, this means a greater number of fake videos and images will be â€œpromotedâ€ rather than retracted.
Twitter has an opportunity to take a leadership role in preventing the spread of deep fake content, by identifying and removing deep fakes from its platform. All major social media platforms have the responsibility to present a unified approach to the prevention and removal of manipulated and fake imagery.
The circulation of a Nancy Pelosi deep fake video earlier this year revealed social mediaâ€™s inconsistency in the handling of deceitful imagery. YouTube removed the clip from its platform, Facebook flagged it as false, and Twitter let it remain.
Twitter is in the business of helping users repost links and content as many times as possible. It creates profit by generating repeated referrals, commentary, and the acceptance of its content through promoted trends.
If deep fakes arenâ€™t removed from Twitter, their growth will be exponential.
A looming threat
Early versions of such spurious content were relatively easy to spot. People in the first deep fake clips appeared unrealistic. Their eyes wouldâ€™t blink and their facial gestures wouldnâ€™t sync with the words being spoken.
There are also examples of harmless image manipulation. These include web apps on Snapchat and Facebook that let users alter their photos (usually selfies) to add backgrounds, or resemble characters such as cute animals.
However, this new generation of altered imagery is often hard to distinguish from reality. And as criminals and pranksters improve their production of deep fakes, the other side of this double-edged sword could swing at any time.