RUN THIS LLM
Search local LLM hardware requirements
CodeLlama 7B
Meta · 7B · Code
Code-specialized Llama fine-tune. Supports code generation, completion, and debugging across many languages.
VRAM Requirements
| Quantization | VRAM |
|---|---|
| Q4_K_M (smallest) | 4.2 GB |
| Q8_0 (balanced) | 7.7 GB |
| FP16 (full quality) | 14 GB |
Specifications
- Parameters: 7B
- Category: Code
- Max context: 16K tokens
- System RAM: 8 GB minimum
- HuggingFace: codellama/CodeLlama-7b-Instruct-hf
Benchmarks
- HumanEval: 34 — Code generation (pass@1)
Loading interactive analysis...