RUN THIS LLM
Search local LLM hardware requirements
DBRX 132B
Databricks · 132B MoE · General
Databricks' MoE model. 36B active params with strong code and general performance.
VRAM Requirements
| Quantization | VRAM |
|---|---|
| Q4_K_M (smallest) | 79.2 GB |
| Q8_0 (balanced) | 145.2 GB |
| FP16 (full quality) | 264 GB |
Specifications
- Parameters: 132B MoE (36B active per token)
- Category: General
- Max context: 32K tokens
- System RAM: 96 GB minimum
- HuggingFace: databricks/dbrx-instruct
Benchmarks
- MMLU: 73 — General knowledge & reasoning (5-shot)
- HumanEval: 56 — Code generation (pass@1)
Loading interactive analysis...