The Technology section is published with the support of Favbet Tech
Microsoft appears to be working on its own large language model, which will potentially become the main competitor for AI Google, Anthropic and OpenAI – despite the fact that the corporation itself invested $10 billion in the ChatGPT developer and received priority rights to use its products.
According to The Information, the development of MAI-1 is being led by Mustafa Suleiman, an ex-Google AI executive who was Inflection's CEO before Microsoft acquired the startup's intellectual property for $650 million in March and took over more of its staff.
Even though MAI-1 may be based on techniques developed at Inflection, Microsoft is positioning the product as an entirely new major language model, two unnamed employees said. The model allegedly contains 500 billion parameters – significantly more than previous open source Microsoft models (such as Phi-3), bringing MAI-1 closer to OpenAI's GPT-4, which is rumored to boast 1 trillion parameters and significantly exceeds the competition Meta and Mistral models with 70 billion parameters.
MAI-1's development envisions a two-pronged approach to AI at Microsoft, focusing on small, on-premises LLMs as well as more advanced, larger models running in the cloud (Apple is considering a similar approach). MAI-1 is also evidence that Microsoft is finally ready to explore artificial intelligence independently of OpenAI, which powers the company's generative capabilities, including the Copilot assistant built into Windows.
It is reported that the exact purpose of the MAI-1 has not yet been determined, but will depend on performance. To train the model, Microsoft dedicated a large cluster of servers with Nvidia GPUs and collected training data from various sources, including text generated by GPT-4 and public data from the Internet.
An announcement about MAI-1 should probably be expected this month at the Microsoft Build developer conference.
The Technology section is published with the support of Favbet Tech
Favbet Tech is IT a company with 100% Ukrainian DNA, which creates perfect services for iGaming and Betting using advanced technologies and provides access to them. Favbet Tech develops innovative software through a complex multi-component platform that can withstand enormous loads and create a unique experience for players. The IT company is part of the FAVBET group of companies.