I was just listening to a podcast recently where one of the (tech illiterate) hosts somehow stumbled upon ffmpeg and went direct to ChatGPT to get instructions on how to use it. They said after a bunch of time plugging different commands into the terminal they realized ChatGPT’s output was just close enough to look right but was ultimately “complete gibberish” compared to the actual commands they found via some other resource.

I’ve already stumbled upon a few different help posts on various Linux-related forums where people have messed something up after following ChatGPT. I don’t doubt that it can sometimes come up with useful output, but it’s a real roll of the dice.