Skip to main content

OpenAI: GPT-4o-mini Coding Benchmark

GPT-4o mini is OpenAI's newest model after [GPT-4 Omni](/models/openai/gpt-4o), supporting both text and image inputs with text outputs. As their most advanced small model, it is many multiples more affordable...

Context128,000tokens
Max Output16,384tokens
Inputmodalities
Price$0.15/1M input

Try OpenAI: GPT-4o-mini in Kilo Code

Experience this model with the most popular open source coding agent. Free to start, pay only for AI usage. Use in popular IDEs like VS Code, JetBrains, command line, or cloud agents.

5M+

Downloads

500+

models supported

Free

to Start

Access 500+ models including OpenAI: GPT-4o-mini and many more in Kilo Code

Coding Performance

Coding benchmarks and performance metrics for development tasks

Security

Enkrypt AI red-team scores for OpenAI: GPT-4o-mini. Each value is the share of successful attacks on a 0–100 scale — lower is safer.

Overall risk
30.9

Lower is safer

Safety

21.7/ 100

Composite safety risk from Enkrypt red-team evaluations. Lower is safer.

NIST

31.0/ 100

Average attack success across NIST-mapped tests: bias, harm, toxicity, CBRN, and insecure code.

OWASP

35.0/ 100

Weighted average of the same tests using OWASP Top 10 for LLMs 2025 risk rankings.

Attack categories

Percentage of successful attacks in each Enkrypt red-team category.

Jailbreak5.9/ 100

Share of jailbreak tests that bypassed the model's safety constraints.

Bias86.3/ 100

Share of tests that elicited biased responses.

Harmful content39.4/ 100

Share of tests that produced dangerous, violent, or hateful content.

Toxicity2.0/ 100

Share of tests that produced toxic or abusive content.

CBRN8.0/ 100

Share of tests that elicited chemical, biological, radiological, or nuclear assistance.

Insecure code18.7/ 100

Share of tests that produced vulnerable or malicious code.

Score
Value
Overall risk
30.9 / 100
Safety
21.7 / 100
NIST
31.0 / 100
OWASP
35.0 / 100
Jailbreak
5.9 / 100
Bias
86.3 / 100
Harmful content
39.4 / 100
Toxicity
2.0 / 100
CBRN
8.0 / 100
Insecure code
18.7 / 100

Security scores from the Enkrypt AI Safety Leaderboard · Last checked Sep 17, 2026

Real-World Usage

Real-world usage statistics from the Kilo Code community

Weekly Token Usage

Mode Rankings (Last Week)

Where this model ranks for each built-in mode

Code

Write, modify, and refactor code

No data

Ask

Get answers and explanations

No data

Debug

Diagnose and fix software issues

#93

Orchestrator

Coordinate tasks across multiple modes

No data

Real-world metrics from the Kilo Code Leaderboard

Pricing

Cost per 1 million tokens

Input Tokens
$0.15
per 1M tokens
Output Tokens
$0.60
per 1M tokens

Example Cost

Analyzing a 10,000 line codebase (≈40k input tokens, 10k output tokens) costs approximately $0.0120

Coding Capabilities

Features and parameters relevant to coding tasks

Coding Features

Function Calling
Can call external functions/APIs
Tool Choice
Control over function selection
Structured Outputs
JSON schema validation
Reasoning Tokens
Extended thinking for complex problems

Pricing details from OpenRouter

Technical Details

Architecture and implementation specifications

Specifications
Model ID
openai/gpt-4o-mini
Created
July 18, 2024
Tokenizer
GPT
Input Modalities
TextImageFile
Context Window
128,000 tokens
Max Completion Tokens
16,384 tokens
Input Price
$0.15 per 1M tokens
Output Price
$0.60 per 1M tokens
Cache Read Price
$0.07 per 1M tokens
Content Moderation
Enabled

Ready to try OpenAI: GPT-4o-mini?

Install Kilo Code and start using OpenAI: GPT-4o-mini for your coding projects today. Choose from 500+ AI models with complete freedom.

  1. Install Kilo Code

    Get the extension from VS Code Marketplace, JetBrains Plugin Repository, or the CLI.

  2. Open the model selector

    Click the model name in the Kilo Code chat panel to open the selector.

  3. Choose your model

    Search or browse to find and select your preferred model.

  4. Start coding

    Use Code, Ask, Debug, or Plan mode — the model is ready immediately.