There is a frustrating struggle for humans and machines to understand one another in natural language that is holding artificial intelligence back.
Thanks to the arrival of large language models powered by transformer architectures, this is changing.
Neural networks designed to model sequential data are called transformer networks. The idea of attention allows the transformer to attend to the most important features of an input instead of trying to process everything.
Enhancements to applications using natural language have been delivered by these new models. Each used to require custom architectures. State-of-the-art results are being delivered by transformer.
In 2020, Openai became the first to demonstrate its power at scale, with the launch of GPT 3. It was the biggest language model ever created.
The wave of excitement was caused by GPT 3's ability to produce humanlike text. The beginning was only the beginning. Large language models are getting better by the day.
The proxy for a model's capabilities is called theParameter count. As the number of parameters increases, models perform better on many tasks. The models have grown by an order of magnitude every year for the past five years. These models are expensive to produce.
They have been getting smaller and more efficient in the last year. Small models are a lot cheaper to run and are performing well. Barriers to experimenting with and deployment of new artificial intelligence models are being reduced. They will become more widely integrated into services that you use every day.
They will soon be able to create high-quality content. A torrent of advanced capabilities will be unleashed into existing and new products as a result of this new wave of artificial intelligence.
Language is what I am most excited about. Humans have had to use technology to input their thoughts in the past. We will begin chatting with machines in our language in 2023. We will be able to have conversations with all our devices. This promises to change the way humans interact with machines.
We have focused on teaching people how to code in order to teach the language of computers. It will be important. We will flip that script and computers will speak our language. Access to tools for creativity, learning, and playing will be greatly expanded by that.
New, artificial intelligence-first products are in great demand as the age of utility begins. In the future, we will live in a world where curiosity and imagination are the main limitations.