2023 State of AI Report: A Comprehensive Guide to the Current State and Future Trajectory of AI
The 163-page 2023 State of AI Report, produced by venture capital firm Air Street Capital, provides a comprehensive overview of the current state and future trajectory of artificial intelligence (AI). The report, now in its sixth year, has been reviewed by leading experts in AI research and industry. It focuses on five key dimensions: Research, Industry, Politics, Safety, and Predictions. This year’s edition introduces a new section on Safety. The report and accompanying blog post were authored by Nathan Benaich and published on October 12, 2023.
Nathan Benaich: General Partner at Air Street Capital
Nathan Benaich is the General Partner at Air Street Capital and has made significant contributions to the field of AI. He founded RAAIS, London.AI, the RAAIS Foundation, and Spinout.fyi. Benaich completed his undergraduate studies in biology at Williams College and earned a PhD in cancer research from Cambridge University.
GPT-4: The Most Advanced Large Language Model
According to Benaich’s report, GPT-4 is currently the most advanced large language model (LLM), surpassing others in various benchmarks and human-designed tests. This highlights the effectiveness of proprietary architectures and reinforcement learning based on human feedback. Smaller models, improved datasets, and extended context are also being developed to replicate or even surpass GPT-4’s performance. This is crucial as concerns arise about the sustainability of AI scaling based on human-generated data.
Advancements in LLMs and Diffusion Models
Benaich’s report emphasizes significant advancements in LLMs and diffusion models in the commercial sphere, particularly in the life sciences. These models have contributed to major breakthroughs in molecular biology and drug discovery. The report also highlights the increasing use of GPUs by startups to gain a competitive edge, stating that “Compute is the new oil,” referencing NVIDIA’s record earnings.
The Political Landscape: U.S.-China Trade Restrictions and “Chip Wars”
The report discusses the tightening of U.S. trade restrictions on China and the mobilization of allies in what is referred to as the “chip wars.” Major chip manufacturers like NVIDIA, Intel, and AMD are selling chips immune to export controls, allowing them to scale their operations despite the restrictions.
Generative AI Startups and Venture Capital
Benaich highlights generative AI startups as a saving grace for venture capital during a downturn in tech valuations. These startups, focusing on video, text, and coding applications, have raised over $18 billion from venture capital and corporate investors.
Safety Concerns and Global Governance
Safety has become a mainstream topic with governments and regulators taking action. However, Benaich’s report points out divisions within the AI community and a lack of progress in establishing global governance. Conflicting approaches adopted by different governments make it challenging to develop a unified strategy.
Difficulties in Assessing State-of-the-Art Models
The report addresses difficulties in assessing state-of-the-art models. Standard LLMs often face robustness issues, and Benaich argues that a casual evaluation approach is insufficient given the high stakes involved.
Predictions for the Future of AI
The report includes predictions for the future of AI by Air Street Capital. These predictions will be reviewed in subsequent reports to maintain accountability.
AI Explained Video: Key Points and Analysis
The YouTube channel “AI Explained” released a video discussing the 2023 State of AI Report. The video covers various topics, including advancements in AI modalities, the extensive coverage of GPT-4, open-ended learning with LLMs, medical applications of AI, industry developments, and chip export bans. It provides additional insights and analysis on these subjects.
Hot Take: The State of AI Report Highlights Advancements, Challenges, and Future Predictions
The 2023 State of AI Report offers a comprehensive analysis of the current state and future trajectory of AI. It highlights the remarkable advancements in large language models like GPT-4 and their impact on various industries, particularly in the life sciences. However, the report also addresses challenges related to safety, global governance, and assessing state-of-the-art models. Looking ahead, Air Street Capital’s predictions provide valuable insights into the future of AI. As AI continues to evolve rapidly, it is crucial to stay informed about the latest developments and navigate the opportunities and challenges that lie ahead.