Earlier in November, Microsoft announced that the BingChat name for its online generative AI chatbot would no longer be used and that it would now use Copilot to refer to the service. No matter what name Microsoft uses for the chatbot, the company is still working to improve the service for users.
One of the announced plans is that Microsoft will upgrade the chatbot to the GPT-4Turbo model recently released by its partner OpenAI. One of its big upgrades is support for 128k context windows. This means that users can enter the equivalent of 300 pages of text prompts into this window.
Over the past few days, Mikhail Parakhin, head of Microsoft's advertising and network services group and head of the company's recently announced new Windows and network experience team, responded to a user's post on
Bing Chat/Copilot currently has a strict 5,000 character limit per chat. When asked if the character limit could be increased with the addition of GPT-4 Turbo, Parakhin wrote: "Yes, Turbo has a larger context window and therefore will try to increase the limit. This will certainly be a big help to many users who have been asking if the current limit will be exceeded."
Another X user asked Parakhin what makes GPT-4Turbo better than the ordinary GPT-4 mode. He replied:
It outperforms regular GPT-4 on "perceptual intelligence", which is our internal metric of how smart the system feels when you talk to it, but we still need to work out some math and coding aspects. It has higher throughput, so you can have more users, or run less "hot" on the DC, thus improving latency.
We're still waiting for third-party plugin support to be fully rolled out. This weekend, Parakhin said on