Click to Skip Ad
Closing in...

Meta reveals LLaMA language model as AI wars heat up

Published Feb 24th, 2023 1:50PM EST
A pedestrian walks in front of a new logo and the name 'Meta' on the sign in front of Facebook headquarters on October 28, 2021 in Menlo Park, California.
Image: Justin Sullivan/Getty Images

If you buy through a BGR link, we may earn an affiliate commission, helping support our expert product labs.

Generative AI might upend society as we know it or fail to have much of a substantive impact on our lives, but as long as it continues to make headlines, the biggest tech companies on the planet will continue to stake their claims. In recent weeks, Microsoft and Google have thrown their hats in the ring with their Bing and Bard chatbots. Now it’s Meta’s turn, as the company behind Facebook announced LLaMA (Large Language Model Meta AI) on Friday.

Meet LLaMA, Meta’s large language model

On Facebook’s AI blog, Meta describes LLaMA as a “foundational large language model designed to help researchers advance their work in this subfield of AI.” In other words, LLaMA is not coming for ChatGPT’s throne. Rather, Meta wants researchers to utilize LLaMA to better understand how and why large language models work as well as why they sometimes don’t.

LLaMA comes in four different sizes: 7 billion, 13 billion, 33 billion, and 65 billion parameters. Even the smallest model is said to beat OpenAI’s GPT-3 “on most benchmarks.”

“Even with all the recent advancements in large language models, full research access to them remains limited because of the resources that are required to train and run such large models,” Meta explains. “This restricted access has limited researchers’ ability to understand how and why these large language models work, hindering progress on efforts to improve their robustness and mitigate known issues, such as bias, toxicity, and the potential for generating misinformation.”

Although Meta did not name any specific large language models, the toxicity of Bing’s AI chat has made headlines repeatedly in recent weeks. We saw Google’s Bard provide incorrect information in its first public demo as well, causing Alphabet shares to plummet.

Unlike ChatGPT and Bing, which are both available to the public, Meta is releasing LLaMA under a noncommercial license focused on research use cases. Meta will grant access to the model on a case-by-case basis to researchers, institutions, and labs.

If you want to learn more about LLaMA, check out Meta’s research paper here.

Jacob Siegal
Jacob Siegal Associate Editor

Jacob Siegal is Associate Editor at BGR, having joined the news team in 2013. He has over a decade of professional writing and editing experience, and helps to lead our technology and entertainment product launch and movie release coverage.