RUN THIS LLM
Search local LLM hardware requirements
Gemma 3 12B
Google · 12B · Vision
Mid-range Gemma with vision. Excellent quality-to-size ratio from Google's training infrastructure.
VRAM Requirements
| Quantization | VRAM |
|---|---|
| Q4_K_M (smallest) | 7.2 GB |
| Q8_0 (balanced) | 13.2 GB |
| FP16 (full quality) | 24 GB |
Specifications
- Parameters: 12B
- Category: Vision
- Max context: 128K tokens
- System RAM: 16 GB minimum
- HuggingFace: google/gemma-3-12b-it
Benchmarks
- MMLU: 74 — General knowledge & reasoning (5-shot)
- HumanEval: 62 — Code generation (pass@1)
- MATH: 48 — Competition-level math reasoning
Loading interactive analysis...