The past year has seen a dramatic shift in the landscape for the economics of AI. Artificial intelligence has made remarkable progress, particularly in the space of large language models, and this progress has been faster than many (including myself) expected. As we enter 2023, I’d like to share some facts, thoughts and opinions on the implications of these developments.
- Cognitive automation: This is set to be a major trend in 2023 and beyond. As the capabilities of large language models continue to expand, cognitive workers (such as myself) are increasingly at risk of being automated. This means that economists must abandon the notion that automation only affects routine jobs, and that human creativity is somehow — miraculously — immune to automation. To keep up with this new reality, economic models must be adapted accordingly.
- Exponential growth in compute: Progress in AI is continuing relentlessly, propelled by a combination of advances in hardware and software as well as ever-growing training budgets. This has resulted in doubling times in compute of about six months for cutting-edge models — much faster than Moore’s Law — a regularity that has held for almost a decade now. Note that the dollar cost of training runs is also growing exponentially for cutting-edge models — and currently in the realm of eight-digit dollar amounts. Since expenditure on compute is growing much faster than the overall economy, an ever-growing portion of our economy’s resources is devoted to compute — the beginning of an AI takeoff!
- Economic growth: Compared to the macroeconomy, investment in AI is still relatively small, and it will take several more rounds of doubling for the macroeconomic effects to be felt. The economy is like a large vessel that takes a long time to turn, so I don't anticipate that the recent advances will be reflected in investment, productivity and growth numbers at the macro level in 2023.
- Growing public attention: OpenAI's ChatGPT, released in November, gave the public a firsthand experience of the power of advanced AI and significantly increased public awareness of the abilities of large language models. (If you haven’t already, try it out to get a glimpse of what the personal assistants of the future will look like.) Technically, the system is just one customization of one large language model (GPT3.5) among several others that have demonstrated a growing level of general intelligence. But it represents yet another small step forward toward artificial general intelligence (AGI), i.e., toward AI systems that can perform all cognitive tasks that humans can perform. The next generation of language models are rumored to be released soon and will display even greater general intelligence.