RUN THIS LLM
Search local LLM hardware requirements
GLM-4V 9B
Zhipu · 9B · Vision
GLM with vision support. Understands Chinese and English text in images.
VRAM Requirements
| Quantization | VRAM |
|---|---|
| Q4_K_M (smallest) | 5.4 GB |
| Q8_0 (balanced) | 9.9 GB |
| FP16 (full quality) | 18 GB |
Specifications
- Parameters: 9B
- Category: Vision
- Max context: 128K tokens
- System RAM: 12 GB minimum
- HuggingFace: THUDM/glm-4v-9b
Loading interactive analysis...