全球人工智能指数报告2024年度

Introduction to theAI Index Report 2024 Welcome to the seventh edition of the AI Index report. The 2024 Index is our most comprehensive to date andarrives at an important moment when AI’s influence on society has never been more pronounced. This year,we have broadened our scope to more extensively cover essential trends such as technical advancementsin AI, public perceptions of the technology, and the geopolitical dynamics surrounding its development.Featuring more original data than ever before, this edition introduces new estimates on AI training costs,detailed analyses of the responsible AI landscape, and an entirely new chapter dedicated to AI’s impact onscience and medicine. The AI Index report tracks, collates, distills, and visualizes data related to artificial intelligence (AI). Ourmission is to provide unbiased, rigorously vetted, broadly sourced data in order for policymakers, researchers,executives, journalists, and the general public to develop a more thorough and nuanced understanding of thecomplex field of AI. The AI Index is recognized globally as one of the most credible and authoritative sources for data and insightson artificial intelligence. Previous editions have been cited in major newspapers, including the The New YorkTimes, Bloomberg, and The Guardian, have amassed hundreds of academic citations, and been referencedby high-level policymakers in the United States, the United Kingdom, and the European Union, amongother places. This year’s edition surpasses all previous ones in size, scale, and scope, reflecting the growingsignificance that AI is coming to hold in all of our lives. Message Fromthe Co-directors A decade ago, the best AI systems in the world were unable to classify objects in images at a human level. AIstruggled with language comprehension and could not solve math problems. Today, AI systems routinely exceedhuman performance on standard benchmarks. Progress accelerated in 2023. New state-of-the-art systems like GPT-4, Gemini, and Claude 3 are impressivelymultimodal: They can generate fluent text in dozens of languages, process audio, and even explain memes. As AIhas improved, it has increasingly forced its way into our lives. Companies are racing to build AI-based products,and AI is increasingly being used by the general public. But current AI technology still has significant problems. Itcannot reliably deal with facts, perform complex reasoning, or explain its conclusions. AI faces two interrelated futures. First, technology continues to improve and is increasingly used, having majorconsequences for productivity and employment. It can be put to both good and bad uses. In the second future,the adoption of AI is constrained by the limitations of the technology. Regardless of which future unfolds,governments are increasingly concerned. They are stepping in to encourage the upside, such as funding universityR&D and incentivizing private investment. Governments are also aiming to manage the potential downsides, suchas impacts on employment, privacy concerns, misinformation, and intellectual property rights. As AI rapidly evolves, the AI Index aims to help the AI community, policymakers, business leaders, journalists, andthe general public navigate this complex landscape. It provides ongoing, objective snapshots tracking severalkey areas: technical progress in AI capabilities, the community and investments driving AI development anddeployment, public opinion on current and potential future impacts, and policy measures taken to stimulate AIinnovation while managing its risks and challenges. By comprehensively monitoring the AI ecosystem, the Indexserves as an important resource for understanding this transformative technological force. On the technical front, this year’s AI Index reports that the number of new large language models releasedworldwide in 2023 doubled over the previous year. Two-thirds were open-source, but the highest-performingmodels came from industry players with closed systems. Gemini Ultra became the first LLM to reach human-level performance on the Massive Multitask Language Understanding (MMLU) benchmark; performance on thebenchmark has improved by 15 percentage points since last year. Additionally, GPT-4 achieved an impressive 0.96mean win rate score on the comprehensive Holistic Evaluation of Language Models (HELM) benchmark, whichincludes MMLU among other evaluations. Message From theCo-directors (cont’d) Although global private investment in AI decreased for the second consecutive year, investment in generativeAI skyrocketed. More Fortune 500 earnings calls mentioned AI than ever before, and new studies show that AItangibly boosts worker productivity. On the policymaking front, global mentions of AI in legislative proceedingshave never been higher. U.S. regulators passed more AI-related regulations in 2023 than ever before. Still, manyexpressed concerns about AI’s ability to generate deepfakes and impact elections. The public became moreaware