Qualcomm Enables Meta Llama 3 to Run on Devices Powered by Snapdragon

 

Developers will be able to access resources and tools in the Qualcomm AI Hub to run Llama 3 optimally on Snapdragon platforms, reducing time-to-market and unlocking on-device AI benefits. Qualcomm Technologies’ on-device AI capabilities including industry-leading mix of NPU, CPU and GPU technology enables immediacy, improved reliability, privacy, context-aware personalization, and cost-effectiveness for generative AI applications.

Qualcomm Technologies, Inc. and Meta announced a collaboration to optimize the execution of Meta Llama 3 large language models directly on smartphones, PCs, VR/AR headsets, vehicles, and more. The ability to run Llama 3 on devices offers significant advantages, including superior responsiveness, enhanced privacy, improved reliability, and more personalized experiences for users.

 
“We celebrate Meta’s open approach with Meta Llama 3, and we share their commitment to empower developers and spur AI innovation,” said Durga Malladi, senior vice president and general manager of technology, planning and edge solutions, Qualcomm Technologies, Inc. “Our leadership in on-device AI, coupled with our vast reach across various devices at the edge, positions us to expand the benefits of the Llama ecosystem worldwide, and enable customers, partners and developers to create a new generation of groundbreaking AI experiences.”

The collaboration aims to democratize access to generative AI capabilities by enabling OEMs and developers to make Llama 3 accessible on devices powered by upcoming flagship Snapdragon^® platforms. The utilization of Qualcomm Technologies’ powerful heterogeneous computing architecture, which seamlessly leverages our industry-leading CPU, GPU, and NPU, in conjunction with a cutting-edge memory architecture, empowers customers, partners, and developers to maximize application performance, thermal efficiency, and battery life.

Developers will be able to access the resources and tools to run Llama 3 optimally on Snapdragon platforms via the Qualcomm^® AI Hub, which currently offers approximately 100 optimized AI models. The Qualcomm AI Hub reduces time-to-market for developers and unlocks the benefits of on‑device AI for their apps.

Qualcomm Technologies and Meta are committed to driving innovation and delivering the next generation of AI experiences. This engagement represents a significant milestone in their ongoing collaboration and showcases their dedication to empowering developers and users with powerful AI capabilities.

www.qualcomm.com