Not long after the model’s launch, OpenAI CEO Sam Altman tweeted, “ChatGPT is incredibly limited, but good enough at some things to create a misleading impression of greatness. It’s a mistake to be relying on it for anything important right now. It’s a preview of progress; we have lots of work to do on robustness and truthfulness.” In a later tweet, he wrote, “It does know a lot, but the danger is that it is confident and wrong a significant fraction of the time.”

Source: Why ChatGPT and Bing Chat are so good at making things up

This should be understood by more people.