Llama Guard 2 (8B) API

Llama Guard 2 (8B) Description

• Model Type: Text Classification

Overview

LlamaGuard-2-8B is an 8 billion parameter model developed by Meta AI to classify content safety in large language models (LLMs). It is based on the Meta Llama 3 architecture and is trained to predict safety labels across 11 categories from the MLCommons taxonomy of hazards.

Key Features

• Outperforms other popular content moderation APIs like Azure, OpenAI Moderation, and Perspective
• Achieves high F1 score of 0.915 and low false positive rate of 0.040
• Supports prompt and response safety classification for LLMs
• Easily fine-tunable to create custom safety taxonomies for specific applications

Intended Use

LlamaGuard-2-8B is designed to be integrated into LLM-powered applications to ensure the safety and responsibility of generated content. It can be used to filter out potentially harmful or inappropriate text before it is displayed to users.

Language Support

The model is currently trained on English text, but it could potentially be fine-tuned to support other languages as well.

Architecture

LlamaGuard-2-8B is based on the Meta Llama 3 model, a large language model using the Transformer architecture.

Use cases

Filter user inputs before passing them to downstream models to prevent unsafe queries like hate speech or self-harm requests.

Scan model-generated outputs, and if unsafe, halt display and notify user of risk category.

Use as a classifier to tag large datasets for content policy compliance or training feedback loops.

Deploy to review generative responses against established policies (e.g. MLCommons taxonomy) for compliance checks.

Capabilities

• Function calling
• Streaming
• Structured outputs