RUN THIS LLM
Search local LLM hardware requirements
IDEFICS 3 8B
HuggingFace · 8B · Vision
HuggingFace's open VLM. Strong document understanding and visual Q&A.
VRAM Requirements
| Quantization | VRAM |
|---|---|
| Q4_K_M (smallest) | 4.8 GB |
| Q8_0 (balanced) | 8.8 GB |
| FP16 (full quality) | 16 GB |
Specifications
- Parameters: 8B
- Category: Vision
- Max context: 128K tokens
- System RAM: 10 GB minimum
- HuggingFace: HuggingFaceM4/Idefics3-8B-Llama3
Loading interactive analysis...