RUN THIS LLM
Search local LLM hardware requirements
BioMistral 7B
BioMistral · 7B · Medical
Mistral fine-tuned on biomedical literature. Good for medical and life science tasks.
VRAM Requirements
| Quantization | VRAM |
|---|---|
| Q4_K_M (smallest) | 4.2 GB |
| Q8_0 (balanced) | 7.7 GB |
| FP16 (full quality) | 14 GB |
Specifications
- Parameters: 7B
- Category: Medical
- Max context: 32K tokens
- System RAM: 8 GB minimum
- HuggingFace: BioMistral/BioMistral-7B
Loading interactive analysis...