I've not actually come across that being done but it's certainly possible with the right prompt engineered to handle it. That's something a lot have missed is that with enough skill creating a prompt, AI could be being used and would not be detectable.
One of the huge downsides to trying to create policies against an emerging technology is that the skilled users get away with going around them while the casual user gets caught up in it.
There will always be those who use emerging tech to abuse other systems. The challenge is to deal with them without hurting others.