ABSTRACT:

The past few years have seen a revolution in Artificial Intelligence (AI). There are now commercial products built on new AI technologies for problems and tasks that seemed out of reach only a few years ago. This rapid progress shows no signs of slowing, with breakthrough models coming out every few months. This revolution is driven by Large Language Models, a type of natural language processing model that learns to mimic human language by examining billions of examples. While language models have been used for decades, recent advances in deep learning have dramatically improved their capabilities and revealed emergent properties of these massive models.

BIO:

This talk will survey the current state of the art in large language models. We will review their history and the rapid progress they have made in the past few years. We will then consider the emergent behaviors of these models, abilities that appear in large models that are completely absent from previous models. Finally, we will consider the future: what should we expect in the next few years, and what new challenges are presented by these models.

Hosted by Professor Kai-Wei Chang