RUN THIS LLM
Search local LLM hardware requirements
Granite 3.1 2B
IBM · 2B · General
IBM's enterprise-focused small model. Designed for business document processing.
VRAM Requirements
| Quantization | VRAM |
|---|---|
| Q4_K_M (smallest) | 1.2 GB |
| Q8_0 (balanced) | 2.2 GB |
| FP16 (full quality) | 4 GB |
Specifications
- Parameters: 2B
- Category: General
- Max context: 8K tokens
- System RAM: 4 GB minimum
- HuggingFace: ibm-granite/granite-3.1-2b-instruct
Benchmarks
- MMLU: 52 — General knowledge & reasoning (5-shot)
Loading interactive analysis...