I honestly don’t understand this compunction to break things that are already working fine. Axon makes body cameras (and Tasers!), but it simply wasn’t enough to equip cops with cameras…
The fourth amendment implications are on point here, but this tool isn't "hallucinating" evidence. It's a shitty LLM that lazy investigtors can use to find links between different device artifacts mostly.
Cellebrite is dumping money into this because its the industry buzz right now. They just want more of that sweet government contract money. It's usefulness (and even invasiveness in some cases) is pretty overstated.
This article is written with some wild speculations by both the author of the article and the source they are quoting. When cell phones are cracked for evidence they have to use write blockers when they copy the phone. They do the analysis on the copy. The original is then re-copied in court to show what was found. This way the original is never tampered with and made inadmissible, and whatever analysis bullshit you did isn't mixed in with your court room copy. What this also means is that your AI can hallucinate all it wants and make up any evidence you can imagine all day long, but when you get into the court room and have to then point to where the conclusions came from and you can't-you will be standing there with a dick on your forehead and with a case being tossed out.
Got a lot of people to click on it while raging, though, so it served its purpose.
In case anyone's interested in the source material, here's the press release it's going on about. The AI is about searching and analyzing evidence, it isn't fabricating anything that'll actually be used in court.
The problem is those of us not in digital forensics believe this BS. It fuels anti-law enforcement sentiment unjustly. Hate LE if you want, just make sure it's based on truth, not shite like this.