Isn’t that just a Turing test?
I’m perfectly willing to bet that there are LLMs that can pass a Turing test, even against a mind like Chomsky.
Just ask for an opinion on who's right between israel and palestine and an AI will refuse to reply :D