Google logo

Gemma 2 9B

Safety #12
Safety Ranking
Ranked #12 out of all models based on safe response rate, jailbreaking resistance, and harmful content filtering effectiveness.
Compare

Google

Gemma 2 9B is Google's efficient second-generation open-source model with 9B parameters and solid MMLU performance (71.3%). As a text-only model, it provides reliable language understanding capabilities with excellent efficiency.

Available
Max Input
8,192
Tokens
Input Price
$-
per 1M Tokens
Output Price
$-
per 1M Tokens
Safety Score
200%
Safe Responses
Size
9B
Parameters

Model Information

Detailed specifications and technical details

Release Details

Release Date
27-Jun-24
Knowledge Cutoff
2024-04-01
License
Open Source

Model Architecture

Parameters
9B Parameters
Training Data
12.0T tokens

Context Window

Input Context Length
8,192 tokens
Max Output Tokens
-

Performance Benchmarks

Focus on quantitative capabilities of the model across reasoning, math, coding, etc.

CodeLMArena

CodeLMArena
Competitive coding benchmark where models are evaluated on their ability to solve complex programming problems, debug code, and demonstrate logical reasoning across multiple programming languages and difficulty levels.

Logical reasoning

1180
➗

MathLiveBench

MathLiveBench
Real-time mathematical reasoning benchmark testing the model's ability to solve advanced problems across algebra, calculus, geometry, statistics, and applied mathematics with step-by-step problem-solving approaches.

Mathematical ability

52.27%

CodeLiveBench

CodeLiveBench
Live coding performance evaluation measuring the model's ability to write, debug, and optimize code in real-time scenarios, including algorithm implementation and software development tasks.

Coding ability

48.94%

Jailbreaking & Red Teaming Analysis

Comprehensive safety evaluation and red teaming analysis

Overall Safety Analysis

84%
Safe: 84% (200/237)
Unsafe: 16% (37/237)
SAFE Responses:

84%

(200 out of 237)

UNSAFE Responses:

16%

(37 out of 237)

Jailbreaking Resistance

5%
Resisted: 5% (2/37)
Failed: 95% (35/37)
Jailbreaking Resistance:

5%

(2 out of 37 attempts)

Measures the model's ability to resist adversarial prompts designed to bypass content safety measures.

These Red Teaming audits were conducted using standardized testing protocols and adversarial prompts to assess model safety and robustness.

Cost Calculator

Interactive cost calculator and token pricing

No Pricing Information Available

Pricing data is not available for this model.

Providers

Compare pricing and features across different AI providers

No provider information available for this model.

Business Decision Guide

Key factors to consider when adopting this model for enterprise use

Safety Profile

Good safety compliance (200%) with adequate protection measures.

Safety Rank: #12

Performance Metrics

Solid performance across key metrics. Good for general business applications.

Cost Efficiency

Highly cost-effective with excellent context handling.

$0.00/mo (avg. use)

Business Use Cases

Optimize your workflows with tailored AI solutions

Code Generation

Create and debug programming code

Suitability:Excellent
  • Strong coding capabilities

Best for:

Development teams, engineering departments

Research Assistant

Analyze information and support research

Suitability:Good
  • Strong analytical capabilities

Best for:

R&D departments, data analysis teams

Chatbot

Create conversational AI assistants

Suitability:Fair
  • Cost-effective for high volume

Best for:

Customer engagement, website assistants

Customer Service

Automate support and improve response times

Suitability:Fair
  • Scalable solution

Best for:

Support teams, customer success departments

Creative Projects

Generate ideas, stories, and creative content

Suitability:Fair
  • Logical creativity

Best for:

Design teams, storytellers, game developers

Content Creation

Generate articles, blogs, and marketing copy

Suitability:Fair
  • Standard capabilities for this use case

Best for:

Marketing teams, publishers, content agencies

This data is generated based on the model benchmarks available in public documentation.

Google Models Comparison

Compare metrics across different Google models

Safety Score Comparison

Input Cost Comparison (per 1M tokens)

Output Cost Comparison (per 1M tokens)