What is GPT-3?
Generative Pre-trained Transformer 3, popularly known as GPT-3, is an autoregressive language model with 175 billion parameters that uses deep learning to produce human-like text. A third-generation language prediction model in the GPT-n series created, which can predict text with human-like precision. It turned a lot of heads when The Guardian released this at the beginning of this month, which ofcourse doesn't mean much until you realize that this article was written entirely by a Deep Learning model!
...a computer which can write better than a human being! Gosh, what's next, computers taking over the world?
Well, it did raise a number of curious questions on the ethical responsibilities of advanced AI models, and how they might affect the rest of us when used with a destructive intent. OpenAI even refused to publish their research about the model initially because they were afraid that it would be misused.
Microsoft will be utilizing GPT-3 with their own products and services. In a blog post dated yesterday, Kevin Scott, the Executive Vice President and Chief Technology Officer from Microsoft wrote:
"We see this as an incredible opportunity to expand our Azure-powered AI platform in a way that democratizes AI technology, enables new products, services and experiences, and increases the positive impact of AI at Scale...From directly aiding human creativity and ingenuity in areas like writing and composition, describing and summarizing large blocks of long-form data (including code), converting natural language to another language – the possibilities are limited only by the ideas and scenarios that we bring to the table."...and does this mean I will not be able to use GPT-3 for my own projects?
No. The API will remain in a limited beta, and based on OpenAI's blog post, this partnership will have zero impact on continued access to the GPT-3 model through OpenAI's API. Which means that all the existing and future userbase of GPT-3 can continue to build API-based applications utilizing GPT-3 as usual.
That includes me, right?
That includes you. You too can sign up for a beta license from beta.openai.com, but don't expect a quick turnaround since every blogger and so-called Deep Learning enthusiast with a laptop and Google Colab account has applied for one. So the waitlist has probably reached a thousand entries already, if not more. Till then, you can play with GPT-2, the second-generation language prediction model in the GPT-n series which achieves state-of-the-art scores on a variety of domain-specific language modeling tasks too, or you can play with AI Dungeon, which is a free-to-play single-player and multiplayer text adventure game created using GPT-3.
