Key Points:
Qualcomm collaborates with Meta to optimize the Meta Llama 3 large language model, enabling terminal-side execution on future Snapdragon flagship platforms.
Developers will have access to resources and tools in Qualcomm’s AI Hub to optimize running Llama 3 on Snapdragon platforms, reducing time to market and fully leveraging terminal-side AI advantages.
Qualcomm’s terminal-side AI capabilities include industry-leading combinations of NPU, CPU, and GPU technologies, empowering generative AI applications to achieve immediacy, enhanced reliability, privacy, contextual awareness, personalization, and cost-effectiveness.
San Diego, April 19, 2024 – Qualcomm Technologies, Inc. and Meta announced a collaboration to optimize the execution of the Meta Llama 3 large language model (LLM) directly on terminals such as smartphones, PCs, VR/AR headsets, and automobiles. Running Llama 3 on the terminal side offers significant advantages, including excellent responsiveness, enhanced privacy and reliability, and delivering more personalized experiences for users.
“We appreciate Meta’s open strategy for Meta Llama 3,” said Madhuri Maganti, Senior Vice President of Qualcomm Technologies, Inc., and General Manager of Technical Planning and Edge Solutions Business. “Both Qualcomm and Meta are committed to empowering developers to drive AI innovation. Qualcomm’s leadership in terminal-side AI, combined with its extensive market presence across various edge terminals, enables us to expand the advantages of the Llama ecosystem globally, empowering customers, partners, and developers to create a new generation of pioneering AI experiences.”
The collaboration aims to empower OEMs and developers to support Llama 3 on terminals featuring future flagship Snapdragon platforms, promoting the widespread adoption of generative AI capabilities. Qualcomm Technologies, Inc.’s powerful heterogeneous computing can seamlessly utilize leading CPU, GPU, and NPU processors, combined with advanced memory architecture, empowering customers, partners, and developers to achieve optimal application performance, efficiency, and battery life.
Developers can access relevant resources and tools through Qualcomm’s AI Hub to optimize running Llama 3 on Snapdragon platforms. Qualcomm’s AI Hub currently offers around 100 optimized AI models, enabling developers to reduce time to market and leverage the advantages of terminal-side AI in their applications. For the latest updates, subscribe to Qualcomm’s monthly developer newsletter.
Qualcomm Technologies, Inc. and Meta are committed to driving innovation and creating the next generation of AI experiences. This collaboration marks an important milestone in the ongoing partnership between the two companies, demonstrating their relentless efforts to empower developers and users with robust AI capabilities.
About Qualcomm Incorporated
Qualcomm is relentlessly innovating to enable ubiquitous intelligent computing and address some of the world’s most significant challenges. Our proven solutions drive major industry transformations, while the Snapdragon brand platforms empower exceptional consumer experiences. Leveraging our nearly 40 years of leadership in setting standards and creating groundbreaking technologies for the industry, we provide leading-edge edge AI, high-performance, low-power computing, and unparalleled connectivity. We collaborate with ecosystem partners to enable the next generation of digital transformation, enriching lives, improving business operations, and driving societal progress. At Qualcomm, we are committed to advancing humanity.
Qualcomm Incorporated includes our licensing business, Qualcomm Technology Licensing (QTL), and the vast majority of our patent portfolio. Qualcomm Technologies, Inc. (QTI), a wholly-owned subsidiary of Qualcomm Incorporated, operates all of our engineering, research and development activities, and all of our products and services businesses, including the semiconductor business, QCT. Snapdragon and Qualcomm are trademarks or registered trademarks of Qualcomm Technologies, Inc., and/or its subsidiaries. Qualcomm patented technologies are licensed by Qualcomm Incorporated.