Skip to main content

Here’s why people are claiming GPT-4 just got way better

It appears that OpenAI is busy playing cleanup with its GPT language models after accusations that GPT-4 has been getting “lazy,” “dumb,” and has been experiencing errors outside of the norm for the ChatGPT chatbot circulated social media in late November.

Some are even speculating that GPT-4.5 has secretly been rolled out to some users, based on some responses from ChatGPT itself. Regardless of whether or not that’s true, there’s definitely been some positive internal changes over the past behind GPT-4.

More GPUs, better performance?

Posts started rolling in as early as last Thursday that noticed the improvement in GPT-4’s performance. Wharton Professor Ethan Mollick, who previously commented on the sharp downturn in GPT-4 performance in November, has also noted a revitalization in the model, without seeing any proof of a switch to GPT-4.5 for himself. Consistently using a code interpreter to fix his code, he described the change as “night and day, for both speed and answer quality” after experiencing ChatGPT-4 being “unreliable and a little dull for weeks.”

While this was happening, OpenAI quietly reopened its ChatGPT Plus subscriptions last Wednesday, which had registration down since November 14. Altman stated in an X post, “Thanks for your patience while we found more GPUs.”

There is no word whether there is a correlation between the reinstating of ChatGPT Plus signups and the improvement of GPT-4, but the timing is interesting. Notably, signups for the paid version closed shortly after OpenAI’s first DevDay developers’, where the company unveiled a host of new functions for the paid version of the AI chatbot. The company put a waitlist in place for ChatGPT Plus subscriptions due to post-DevDay signups exceeding the service’s capacity to process functions.

People complained that GPT-4 would explain how to execute commands instead of executing the task.

Shortly after that, users began reporting unusual behavior from GPT-4 beyond the traditional AI quips that are already known. One common grievance was that GPT-4 would “back talk” users or require multiple explanations of a command before being able to execute the query. Another complaint was that the model would explain to users how to execute their command instead of executing the task.

Degradation of GPT-4 dates back to at least July, when a study observed a steep decline in accuracy between March and June. Many, including OpenAI Product Vice President Peter Welinder, have suggested that answer quality might appear insufficient as a psychological phenomenon as the model further updates. Some have added that users might benefit from changing their queries to get desired results.

Though OpenAI has kept largely mum about its inner workings, Altman’s X post about GPUs was likely a large indicator of what is happening behind the scenes. Reports from April indicated that OpenAI would need an excess of 30,000 GPU units to maintain its commercial performance for the remainder of the year. That was before the spike in interest in November.

Secret GPT-4.5 testing or just hallucinations?

Beyond that, speculation about GPT-4.5 has ramped up with several other details about a potential new GPT version leaking.

Founder of the @therundownai newsletter, Rowan Cheung, recently shared on X (formerly Twitter) leaked pricing details for a new GPT-4.5 model that OpenAI has in development. The details include new pricing tiers and information about advanced multimodal capabilities.

Cheung asked OpenAI CEO Sam Altman via the social media platform about the validity of the leak, to which he replied, “Nah.”

The GPT 4.5 speculation started on Thursday with a ‘leaked‘ image showing a new GPT-4.5 model with new advanced multimodal capabilities and new pricing.

However, Sam Altman commented "nah" when asked if the rumors were true.

But there's more to the story… pic.twitter.com/iUJkFUqTMh

— Rowan Cheung (@rowancheung) December 18, 2023

However, several users who have handled the proposed update are convinced that they are using GPT-4.5 and that it is new and better than ever. Some have asked the chatbot, which they believed to be running GPT-4 what its model was — and it replied “GPT-4.5 Turbo.”

This has led many to believe that OpenAI has been testing GPT-4.5, primarily on its mobile apps, hoping to evade savvy users. However, not everyone has been able to recreate these results, and the model will tell them the latest version is simply GPT-4. OpenAI employee Will Depue also commented on the matter, calling it a “very weird and oddly consistent hallucination.”

Cheung noted a post from the official ChatGPT X page, with the brain and head in the clouds emojis, which he believes is OpenAI’s vague way of reiterating that the responses are hallucinations.

Notably, OpenAI gives early and exclusive access to its paid users, which includes ChatGPT Plus users, developer API users, and enterprise users. When features are announced, these are among the first to experience the latest GPT versions and their features. Many tinkering with the models and noticing the subtle changes likely have some form of developer API access or are using the service to test code and are sharing their input with the public.

Even if OpenAI is testing GPT-4.5, there’s no telling when an update could occur, especially when the company is settling down from service and organizational destabilization. Additionally, the company and product are still new, and it’s not yet clear what a routine update cycle looks like. For now, I suppose it doesn’t matter what “version” of ChatGPT we’re on because the improvements seem real.

Editors' Recommendations

Fionna Agomuoh
Fionna Agomuoh is a technology journalist with over a decade of experience writing about various consumer electronics topics…
One year ago, ChatGPT started a revolution
The ChatGPT website on a laptop's screen as the laptop sits on a counter in front of a black background.

Exactly one year ago, OpenAI put a simple little web app online called ChatGPT. It wasn't the first publicly available AI chatbot on the internet, and it also wasn't the first large language model. But over the following few months, it would grow into one of the biggest tech phenomenons in recent memory.

Thanks to how precise and natural its language abilities were, people were quick to shout that the sky was falling and that sentient artificial intelligence had arrived to consume us all. Or, the opposite side, which puts its hope for humanity within the walls of OpenAI. The debate between these polar extremes has continued to rage up until today, punctuated by the drama at OpenAI and the series of conspiracy theories that have been proposed as an explanation.

Read more
Here’s why people are saying GPT-4 is getting ‘lazy’
OpenAI announced its latest iteration of ChatGPT with greater accuracy and creativity.

OpenAI and its technologies have been in the midst of scandal for most of November. Between the swift firing and rehiring of CEO Sam Altman and the curious case of the halted ChatGPT Plus paid subscriptions, OpenAI has kept the artificial intelligence industry in the news for weeks.

Now, AI enthusiasts have rehashed an issue that has many wondering whether GPT-4 is getting "lazier" as the language model continues to be trained. Many who use it speed up more intensive tasks have taken to X (formerly Twitter) to air their grievances about the perceived changes.

Read more
Here’s why you can’t sign up for ChatGPT Plus right now
A person sits in front of a laptop. On the laptop screen is the home page for OpenAI's ChatGPT artificial intelligence chatbot.

CEO Sam Altman's sudden departure from OpenAI weekend isn't the only drama happening with ChatGPT. Due to high demand, paid subscriptions for OpenAI's ChatGPT Plus have been halted for nearly a week.

The company has a waitlist for those interested in registering for ChatGPT to be notified of when the text-to-speech AI generator is available once more.

Read more