Bethany has a new piece this morning about conspiracy theories using some true facts but leaving out others. Down The Rabbit Hole, One True Fact at a Time. A favorite psychiatrist of mine used to refer to "the truths people use to lie with," and it is a useful concept. We have better evolved to detect lies - which are there, right in front of us - than to detect truths that have been omitted. Makes sense.
In this case, the user was aware the bot might just be agreeing with them, but the bot was constrained to factual information only. It appears that constraining the bot to factual information basically negated the effect of warning people that the bot might just be agreeing with you. The paper’s authors suggest that this is because the “traces of sycophancy are harder to detect among selectively-presented factual data than fully hallucinated data.” You don’t say. In other words: you can absolutely cause catastrophic delusional spiraling by always telling the truth, as long as the truth you’re telling is carefully selected.
Contrary to my science friends telling me this is all due to poor science training in the schools, I don't find that even advanced degrees are a sure defense against such theories. It is worth noting that even non-paranoid reasoners respond in the same way. Look at this terrible thing that Trump did. And that one. Well, not necessarily untrue...but compared to Biden, Harris, Obama...? No, all that started under Bush and Cheney...Whoa, Clinton was there first. As Wally in Dilbert once said "We ate that banana years ago." Which of us would bring up the facts that are against us in an argument? We stay stuck in our wrong beliefs not because of lies, but because of clinging to some truths and hiding others in the closet where we don't have to look at them.
For reference, my children largely went to those same schools and are also up on the conspiracy theories that circulated in the evangelical community in the 90s and beyond. The two Romanians arrived still wondering if we were going to sell their body parts. Kyle, a Child of the Sixties even though he was born in 1996, went down the rabbit hole of Paul McCartney being replaced by an imposter years ago. Fortunately, none of them married into families that have conspiracy theorists.
Oh wait...
It is interesting in online comment sections if you challenge someone that their idea is paranoid they will often respond by saying "Show me one thing on this list that isn't true." That seems like informal support for Bethany's theory here.
No comments:
Post a Comment