Legislation aimed at stopping deepfakes is a bad idea
The latest disinformation buzzword on everyone’s lips is “deepfake,” a term used to refer to videos that have been manipulated using computer imaging. (The word is a combination of “deep learning” and “fake.”) Using relatively inexpensive software, almost anyone can create a video whose subject appears to say or do something they never said or did. In one of the most recent examples, a Slovakian video artist named Ctrl Shift Face modified a video clip of comedian Bill Hader imitating Al Pacino and Arnold Schwarzenegger, so that Hader’s face morphs into that of the actors while he is imitating them. In another, a pair of artists created a deepfake of Facebook co-founder and CEO Mark Zuckerberg making sinister comments about his plans for the social network.
Technologists have been warning about the potential dangers of deepfakes for some time now; Nick Diakopolous, an assistant professor at Northwestern University, wrote a report called “Reporting in a Machine Reality” last year about the phenomenon. As the US inches closer to the 2020 election campaign, concerns have grown. The recent release of a doctored video of House Speaker Nancy Pelosi—slowed down to make her appear drunk—also fueled those concerns, although the Pelosi video was what some people have called a “cheapfake” or “shallowfake,” since it was obvious it had been manipulated. At a conference in Aspen this week, Mark Zuckerberg defended the fact the social network didn’t remove the Pelosi video, although he admitted it should not have taken so long to add a disclaimer and “down rank” the video so it wasn’t promoted by the News Feed algorithm.
US legislators, riding a wave of concern about this phenomenon, say they want to stop deepfakes at the source. So they have introduced something called the DEEPFAKES Accountability Act. (in a classic Congressional move, the word “deepfakes” is capitalized because it is an acronym—the full name of the act is the Defending Each and Every Person from False Appearances by Keeping Exploitation Subject to Accountability Act). The law would make it a crime for anyone to create and distribute a piece of media that makes it look as though someone said or did something they didn’t say or do without including a digital watermark and text description that states it has been modified. The act also gives victims of “synthetic media” the right to sue the creators and “vindicate their reputations.”
Mutale Nkonde, a fellow with the Berkman Klein Center at Harvard and an expert in artificial intelligence policy, advised Congress on the DEEPFAKES Accountability Act and wrote in a post on Medium that the technology “could usher in a time where the most private parts of our lives could be outed through the release of manipulated online content — or even worse, as was the case with Speaker Pelosi, could be invented [out of] whole cloth.” In describing how the law came to be, Nkonde says that since repealing Section 230 of the Communications and Decency Act (which protects the platforms from liability for third-party content) would be difficult, legislators chose instead to amend the law related to preventing identity theft, “putting the distribution of deepfake content alongside misappropriation of information such as names, addresses, or social security numbers.”
Not everyone is enamored of this idea. While the artists who created the Zuckerberg video and the Hader video might be willing to add digital watermarks and textual descriptions to their creations identifying them as fakes, the really bad actors who are trying to manipulate public opinion and swing elections aren’t likely to volunteer to do so. And it’s not clear how this new law would force them, or make it easier to find them so they could be prosecuted. The Zuckerberg and Hader videos were also clearly created for entertainment purposes. Should every form of entertainment that takes liberties with the truth (in other words, all of them) also carry a watermark and impose a potential criminal penalty on creators? According to the Electronic Frontier Foundation, the bill has some potential First Amendment problems.
Some believe this type of law attacks a symptom rather than a cause: the overall disinformation environment on Facebook and other platforms. “While I understand everyone’s desire to protect themselves and one another from deepfakes, it seems to me that writing legislation on these videos without touching the larger issues of disinformation, propaganda, and the social media algorithms that spread them misses the forest for the trees,” Brooke Binkowski, the former managing editor of fact-checking site Snopes.com who now works for a similar site called Truth or Fiction, says. What’s needed, she says, is legislation aimed at all elements of the disinformation ecosystem. “Without that, the tech will continue to grow and evolve and it will be a never-ending game of legislative catch-up.”
A number of experts, including disinformation researcher Joan Donovan of Harvard’s Shorenstein Center (who did a recent interview on CJR’s Galley discussion platform), have pointed out that you don’t need sophisticated technology to fool large numbers of people into believing things that aren’t true. The conspiracy theorists who peddle the rampant idiocy known as QAnon on Reddit and 4chan, or who create hoaxes such as the Pizzagate conspiracy theory, haven’t needed any kind of specialized technology beyond storytelling skill. Neither did those who promoted the idea that Barack Obama was born in Kenya. Even the Russian troll armies who spread disinformation to hundreds of millions of Facebook users during the 2016 election only needed a few fake images and plausible-sounding names.
There are those, including Joshua Benton, director of the Nieman Lab at Harvard, who don’t believe deepfakes are even that big a problem. “Media is wildly overreacting to deepfakes, which will have almost no impact on the 2020 election,” Benton said on Twitter after the Pelosi video sparked concern about deepfakes swamping voters with disinformation. Others, including the EFF, argue that existing laws are more than enough to handle deepfakes. In any case, rushing forward with legislation aimed at correcting a problem before it even becomes obvious what the scope of the problem is—especially when that legislation has some obvious First Amendment issues—doesn’t seem wise.
NYT promotes questionable study on Google and the media
A New York Times story published on Sunday contains an eye-opening allegation: Google “made $4.7 billion from the news industry in 2018,” according to a new report. The lede of the story quotes the figure again, with all of the zeroes, and mentions that this number is “more than the combined ticket sales of the […]
Should The Daily Beast have exposed the man behind ‘drunk Pelosi’ video?
A modified video of House Speaker Nancy Pelosi that started circulating recently—with the vocal track slowed down to make her appear drunk—raised a number of questions, including why YouTube removed it but Facebook did not. (Instead, Facebook down-ranked the clip in its News Feed and added a link to more reporting on the topic.) Another […]
Media can help fight misinformation, says Harvard’s Joan Donovan
Thanks to globe-spanning social platforms like Facebook, YouTube, and Twitter, misinformation (any wrong information) and disinformation (intentional misinformation like propaganda) have never been able to spread so rapidly or so far, powered by algorithms and automated filters. But misinformation expert Joan Donovan, who runs the Technology and Social Change Research Project at Harvard’s Shorenstein Center, […]
I regret my role at Facebook, but I’m keeping the money
Journalists like to say that three examples of something makes a trend. In that case, there is definitely something happening around Facebook, as former staffers—and in some cases co-founders—renounce the company and its ill effects on society. The latest is Chris Hughes, Mark Zuckerberg’s Harvard roommate, who helped design and market the service in its […]
Should the media quit Facebook?
With all that has transpired between Facebook and the media industry over the past couple of years—the repeated algorithm changes, the head fakes about switching to video, the siphoning off of a significant chunk of the industry’s advertising revenue—most publishers approach the giant social network with skepticism, if not outright hostility. And yet, the vast […]
Facebook’s PR game is showing
Facebook no doubt thought banning the accounts of prominent alt-right misinformation vectors like Alex Jones, Milo Yiannopoulos, and Laura Loomer would be a win-win. Not only would it allow the company to get rid of some obvious troublemakers, but it would also make Facebook look decisive about misinformation on its platform, a problem it has […]
The hiring spreadsheet and the clash at The Markup
There are things about the recent implosion of The Markup that make it unique—in particular, that it raised $23 million with nothing but a trio of co-founders and a brief description of the product they wanted to create. A launch like that places enormous pressure on a project. After not very long, Julia Angwin, one […]
Here’s what happened inside The Markup
The Markup was one of the most highly anticipated media startups in recent memory. Julia Angwin, a former Wall Street Journal investigative reporter, teamed up with her ProPublica writing partner, data journalist Jeff Larson, and brought in Sue Gardner, the former head of Wikimedia and a number of other well-regarded non-profit projects. The team raised […]
Facebook tries to figure out what a fact is in an era of politicized truth
Facebook’s third-party fact-checking project, which was launched with much fanfare in December of 2016, has been criticized a number of times over the past year or so. And it came under fire again this week after the social network announced a list of partners that included a fact-checking site called Check Your Fact. The site is […]
Twitter deletes links to news story due to bogus copyright claims
Have you ever had something you posted mysteriously disappear from the internet? It’s a bizarre experience, especially when it’s a result of an overreaching copyright claim. That’s what happened to me this weekend, after I posted a link on Twitter to an interesting (and disturbing) news story at TorrentFreak, a site that writes about copyright […]
Misinformation and platform influence dominate Perugia media conference
It’s difficult to sum up the main themes of a conference like the International Journalism Festival, in part because it is so vast. One of the oldest and largest journalism conferences, it takes place in Perugia, a small town two hours north of Rome that probably peaked in popularity sometime in the 3rd century BC, […]
YouTube has done too little, too late to fight misinformation
The metaphor YouTube CEO Susan Wojcicki likes to rely on when she’s describing the Google video-sharing service is a wholesome one: it’s like a library, she says—a custodian of content provided by others, giving users an easy way to find things they might be interested in. There are disturbing and even offensive books in the […]
What should publishers make of Zuckerberg’s newest plan to pay them?
Facebook appears to be mounting something of a charm offensive lately. A commitment to fund journalism to the tune of about $300 million over the next three years was followed on Saturday by an op-ed from CEO Mark Zuckerberg in The Washington Post suggesting ways in which the giant social network could (and should) be […]
Crowdfunded journalism startup The Correspondent under fire
The Correspondent is one of the most successful crowdfunded journalism startups of all time: it raised $2.6 million in just 30 days, in a campaign that ended in December, and drew in a number of high-profile supporters, including activist DeRay Mckesson, musician Roseanne Cash, and Jordan Hewson, daughter of U2 frontman Bono. The campaign’s success […]
Facebook: We care deeply about journalism. Please believe us
This week, journalists from dozens of small startups and non-profits joined funders and journalism academics at a small, art-filled boutique hotel in Denver to talk about how to save local journalism. There were drinks and dinners and tasteful snacks during the various sessions designed to encourage brainstorming among the 140 or so attendees, and heated […]