In a spectacularly rare admission of likely very common fuckery, police copped to using face recognition to make a wrongful arrest, according to the ACLU, confirming a long-suspected but nearly-impossible-to-prove practice. On Wednesday, the civil rights litigation group lodged a complaint against the Detroit Police Department for allegedly arresting Robert Williams in early January and admitting, only after holding him in a crowded cell overnight, that â€œthe computer must have gotten it wrong.â€ Williams is Black, and facial recognition software notoriously misidentifies people of colour.
In a New York Times story today, reporter Kashmir Hill relates how police arrested Williams, on his lawn and in front of his family, for allegedly stealing five watches valued at $US3,800 ($5,515) from a store in October 2018. According to the complaint, the Detroit police had used â€œblurryâ€ security footage of the crime and matched it to Williams’s driver’s licence photo, which they then showed to a security guard who didn’t witness the incident.
The police didn’t give him any reason for the arrest, and told Williams’s wife to â€œGoogle itâ€ when she asked where they were taking him. After a night in jail, police interrogated Williams, showed him a surveillance image from the scene, and asked if it was him. It was not, he said, at which point a detective reportedly said, â€œI guess the computer got it wrong.â€ According to the Times, Williams was held for several hours after the interrogation.
A Detroit police spokesperson told the Times that the department â€œdoes not make arrests based solely on facial recognition,â€ and that there were witness interviews, a photo lineup, and that â€œthe investigator reviewed video.â€ That doesn’t square with a subsequent response from the Wayne County prosecutor’s office, confirming that the Detroit Police Department used facial recognition to identify Williams based on the security footage, and that an eyewitness to the crime was not shown the photo line-up (again, based on the facial recognition match).
The office adds that Williams can have the case expunged and his fingerprints removed from the record. In the statement, Prosecutor Kym L. Worthy said that in 2019, the DPD had asked her to adopt their facial recognition â€œpolicyâ€ and declined because of the faulty technology and its built-in racial bias. â€œThis case should not have been issued based on the DPD investigation, and for that we apologise,â€ Worthy wrote. â€œThis does not in any way make up for the hours that Mr. Williams spent in jail.â€
Reuters reported that it reviewed government documents showing that the police made the match using the Michigan state police’s digital analysis identification section, which reportedly uses facial recognition technology from Rank One Computing. The section’s website notes that it pulls from the Statewide Network of Agency Photos, which specifically states on its own site that facial recognition â€œshould never be considered a form of positive identification.â€
As the ACLU points out, this instance is exceptional in part because police never admit to using facial recognition. â€œHad Robert not heard a glib comment from the officer who was interrogating him, he likely never would have known that his ordeal stemmed from a false face recognition match,â€ two ACLU attorneys familiar with Williams’ case wrote. â€œIn fact, people are almost never told when face recognition has identified them as a suspect. The FBI reportedly used this technology hundreds of thousands of times ” yet couldn’t even clearly answer whether it notified people arrested as a result of the technology.â€ The police obstructed numerous attempts by Williams’ lawyer to obtain documentation on the arrest.
We’ve known that police have used facial recognition to make arrests in the past; in 2016, the ACLU uncovered an internal marketing document from the social media location tracking company Geofeedia, which bragged that its technology enabled police to use facial recognition to identify Freddie Grey â€œriotersâ€ with outstanding warrants and arrest them from the crowds. The implications are boundless; just after protests began over George Floyd’s death last month, the ACLU filed a lawsuit against the facial recognition company Clearview AI, which provides law enforcement agencies and private companies the ability to match (or â€œmatchâ€) faceprints scraped from social media and even Venmo accounts.
The ACLU demands in its complaint that the Detroit Police Department stop using facial recognition in its investigations, â€œas the facts of Mr. Williams’ case prove both that the technology is flawed and that DPD investigators are not competent in making use of such technology.â€
The Detroit Police Department, Rank One, and the ACLU were unavailable for comment.