Yes, a couple times and only nonsense comes back. If you paste any challenge into AI and ask “are you sure” the AI will probably say something “you are right, I apologize for my mistake, actually it is another answer” and it keeps changing its mind the more you ask.
AI is not reliable to solve logic challenges, most AIs are language models, they write wrong information/solutions very convincingly because they are good at language, not necessarily logic (although they are getting better as language and logic are closely related)